Oct 20 01:58:20 user nova-compute[74242]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74242) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74242) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74242) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 20 01:58:20 user nova-compute[74242]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.018s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 01:58:20 user nova-compute[74242]: INFO nova.virt.driver [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 20 01:58:20 user nova-compute[74242]: INFO nova.compute.provider_config [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] Acquiring lock "singleton_lock" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] Acquired lock "singleton_lock" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] Releasing lock "singleton_lock" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] Full set of CONF: {{(pid=74242) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ******************************************************************************** {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] Configuration options gathered from: {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ================================================================================ {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] allow_resize_to_same_host      = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] arq_binding_timeout            = 300 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] backdoor_port                  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] backdoor_socket                = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] block_device_allocate_retries  = 300 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] block_device_allocate_retries_interval = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cert                           = self.pem {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] compute_monitors               = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] config_dir                     = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] config_drive_format            = iso9660 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] config_source                  = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] console_host                   = user {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] control_exchange               = nova {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cpu_allocation_ratio           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] daemon                         = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] debug                          = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] default_access_ip_network_name = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] default_availability_zone      = nova {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] default_ephemeral_format       = ext4 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] default_green_pool_size        = 1000 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] default_schedule_zone          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] disk_allocation_ratio          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] enable_new_services            = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] enabled_ssl_apis               = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] flat_injected                  = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] force_config_drive             = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] force_raw_images               = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] graceful_shutdown_timeout      = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] heal_instance_info_cache_interval = 60 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] host                           = user {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] instance_build_timeout         = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] instance_delete_interval       = 300 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] instance_name_template         = instance-%08x {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] instance_usage_audit           = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] instance_usage_audit_period    = month {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] internal_service_availability_zone = internal {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] key                            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] live_migration_retry_count     = 30 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] log_config_append              = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] log_dir                        = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] log_file                       = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] log_options                    = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] log_rotate_interval            = 1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] log_rotate_interval_type       = days {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] log_rotation_type              = none {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] long_rpc_timeout               = 1800 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] max_concurrent_builds          = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] max_concurrent_live_migrations = 1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] max_concurrent_snapshots       = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] max_local_block_devices        = 3 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] max_logfile_count              = 30 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] max_logfile_size_mb            = 200 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] maximum_instance_delete_attempts = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] metadata_listen                = 0.0.0.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] metadata_listen_port           = 8775 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] metadata_workers               = 3 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] migrate_max_retries            = -1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] mkisofs_cmd                    = genisoimage {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] my_ip                          = 10.0.0.210 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] network_allocate_retries       = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] osapi_compute_listen_port      = 8774 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] osapi_compute_unique_server_name_scope =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] osapi_compute_workers          = 3 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] password_length                = 12 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] periodic_enable                = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] periodic_fuzzy_delay           = 60 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] pointer_model                  = ps2mouse {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] preallocate_images             = none {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] publish_errors                 = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] pybasedir                      = /opt/stack/nova {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ram_allocation_ratio           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] rate_limit_burst               = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] rate_limit_except_level        = CRITICAL {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] rate_limit_interval            = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] reboot_timeout                 = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] reclaim_instance_interval      = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] record                         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] reimage_timeout_per_gb         = 60 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] report_interval                = 120 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] rescue_timeout                 = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] reserved_host_cpus             = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] reserved_host_disk_mb          = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] reserved_host_memory_mb        = 512 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] reserved_huge_pages            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] resize_confirm_window          = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] resize_fs_using_block_device   = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] resume_guests_state_on_host_boot = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] rpc_response_timeout           = 60 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] run_external_periodic_tasks    = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] running_deleted_instance_action = reap {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] running_deleted_instance_timeout = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] scheduler_instance_sync_interval = 120 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] service_down_time              = 720 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] servicegroup_driver            = db {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] shelved_offload_time           = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] shelved_poll_interval          = 3600 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] shutdown_timeout               = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] source_is_ipv6                 = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ssl_only                       = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] state_path                     = /opt/stack/data/nova {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] sync_power_state_interval      = 600 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] sync_power_state_pool_size     = 1000 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] syslog_log_facility            = LOG_USER {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] tempdir                        = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] timeout_nbd                    = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] transport_url                  = **** {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] update_resources_interval      = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] use_cow_images                 = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] use_eventlog                   = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] use_journal                    = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] use_json                       = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] use_rootwrap_daemon            = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] use_stderr                     = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] use_syslog                     = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vcpu_pin_set                   = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vif_plugging_is_fatal          = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vif_plugging_timeout           = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] virt_mkfs                      = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] volume_usage_poll_interval     = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] watch_log_file                 = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] web                            = /usr/share/spice-html5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_concurrency.disable_process_locking = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.auth_strategy              = keystone {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.compute_link_prefix        = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.dhcp_domain                = novalocal {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.enable_instance_password   = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.glance_link_prefix         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.instance_list_per_project_cells = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.list_records_by_skipping_down_cells = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.local_metadata_per_cell    = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.max_limit                  = 1000 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.metadata_cache_expiration  = 15 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.neutron_default_tenant_id  = default {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.use_forwarded_for          = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.use_neutron_default_nets   = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.vendordata_dynamic_targets = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.vendordata_jsonfile_path   = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.backend_argument         = **** {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.config_prefix            = cache.oslo {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.dead_timeout             = 60.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.debug_cache_backend      = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.enable_retry_client      = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.enable_socket_keepalive  = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.enabled                  = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.expiration_time          = 600 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.hashclient_retry_attempts = 2 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.memcache_dead_retry      = 300 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.memcache_password        =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.memcache_sasl_enabled    = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.memcache_username        =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.proxies                  = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.retry_attempts           = 2 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.retry_delay              = 0.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.socket_keepalive_count   = 1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.socket_keepalive_idle    = 1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.socket_keepalive_interval = 1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.tls_allowed_ciphers      = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.tls_cafile               = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.tls_certfile             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.tls_enabled              = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cache.tls_keyfile              = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cinder.auth_section            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cinder.auth_type               = password {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cinder.cafile                  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cinder.certfile                = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cinder.collect_timing          = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cinder.cross_az_attach         = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cinder.debug                   = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cinder.endpoint_template       = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cinder.http_retries            = 3 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cinder.insecure                = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cinder.keyfile                 = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cinder.os_region_name          = RegionOne {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cinder.split_loggers           = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cinder.timeout                 = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] compute.cpu_dedicated_set      = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] compute.cpu_shared_set         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] compute.image_type_exclude_list = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] compute.resource_provider_association_refresh = 300 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] compute.shutdown_retry_interval = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] conductor.workers              = 3 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] console.allowed_origins        = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] console.ssl_ciphers            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] console.ssl_minimum_version    = default {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] consoleauth.token_ttl          = 600 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.cafile                  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.certfile                = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.collect_timing          = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.connect_retries         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.connect_retry_delay     = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.endpoint_override       = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.insecure                = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.keyfile                 = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.max_version             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.min_version             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.region_name             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.service_name            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.service_type            = accelerator {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.split_loggers           = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.status_code_retries     = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.status_code_retry_delay = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.timeout                 = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] cyborg.version                 = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.backend               = sqlalchemy {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.connection            = **** {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.connection_debug      = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.connection_parameters =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.connection_recycle_time = 3600 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.connection_trace      = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.db_inc_retry_interval = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.db_max_retries        = 20 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.db_max_retry_interval = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.db_retry_interval     = 1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.max_overflow          = 50 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.max_pool_size         = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.max_retries           = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.mysql_wsrep_sync_wait = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.pool_timeout          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.retry_interval        = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.slave_connection      = **** {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] database.sqlite_synchronous    = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.backend           = sqlalchemy {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.connection        = **** {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.connection_debug  = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.connection_parameters =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.connection_recycle_time = 3600 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.connection_trace  = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.db_inc_retry_interval = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.db_max_retries    = 20 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.db_max_retry_interval = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.db_retry_interval = 1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.max_overflow      = 50 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.max_pool_size     = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.max_retries       = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.pool_timeout      = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.retry_interval    = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.slave_connection  = **** {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] api_database.sqlite_synchronous = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] devices.enabled_mdev_types     = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ephemeral_storage_encryption.enabled = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.api_servers             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.cafile                  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.certfile                = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.collect_timing          = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.connect_retries         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.connect_retry_delay     = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.debug                   = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.default_trusted_certificate_ids = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.enable_certificate_validation = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.enable_rbd_download     = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.endpoint_override       = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.insecure                = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.keyfile                 = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.max_version             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.min_version             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.num_retries             = 3 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.rbd_ceph_conf           =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.rbd_connect_timeout     = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.rbd_pool                =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.rbd_user                =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.region_name             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.service_name            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.service_type            = image {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.split_loggers           = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.status_code_retries     = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.status_code_retry_delay = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.timeout                 = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.verify_glance_signatures = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] glance.version                 = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] guestfs.debug                  = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.config_drive_cdrom      = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.config_drive_inject_password = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.enable_remotefx         = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.instances_path_share    =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.limit_cpu_features      = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.use_multipath_io        = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.vswitch_name            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] mks.enabled                    = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] image_cache.manager_interval   = 2400 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] image_cache.precache_concurrency = 1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] image_cache.remove_unused_base_images = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] image_cache.subdirectory_name  = _base {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.api_max_retries         = 60 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.api_retry_interval      = 2 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.auth_section            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.auth_type               = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.cafile                  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.certfile                = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.collect_timing          = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.conductor_group         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.connect_retries         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.connect_retry_delay     = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.endpoint_override       = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.insecure                = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.keyfile                 = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.max_version             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.min_version             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.peer_list               = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.region_name             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.serial_console_state_timeout = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.service_name            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.service_type            = baremetal {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.split_loggers           = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.status_code_retries     = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.status_code_retry_delay = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.timeout                 = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ironic.version                 = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] key_manager.fixed_key          = **** {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.barbican_api_version  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.barbican_endpoint     = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.barbican_endpoint_type = public {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.barbican_region_name  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.cafile                = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.certfile              = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.collect_timing        = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.insecure              = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.keyfile               = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.number_of_retries     = 60 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.retry_delay           = 1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.send_service_user_token = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.split_loggers         = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.timeout               = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.verify_ssl            = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican.verify_ssl_path       = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican_service_user.auth_section = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican_service_user.auth_type = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican_service_user.cafile   = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican_service_user.certfile = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican_service_user.collect_timing = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican_service_user.insecure = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican_service_user.keyfile  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican_service_user.split_loggers = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] barbican_service_user.timeout  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.approle_role_id          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.approle_secret_id        = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.cafile                   = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.certfile                 = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.collect_timing           = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.insecure                 = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.keyfile                  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.kv_mountpoint            = secret {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.kv_path                  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.kv_version               = 2 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.namespace                = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.root_token_id            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.split_loggers            = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.ssl_ca_crt_file          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.timeout                  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.use_ssl                  = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.auth_section          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.auth_type             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.cafile                = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.certfile              = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.collect_timing        = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.connect_retries       = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.connect_retry_delay   = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.endpoint_override     = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.insecure              = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.keyfile               = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.max_version           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.min_version           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.region_name           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.service_name          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.service_type          = identity {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.split_loggers         = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.status_code_retries   = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.status_code_retry_delay = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.timeout               = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] keystone.version               = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.connection_uri         =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.cpu_mode               = custom {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: WARNING oslo_config.cfg [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.cpu_power_governor_high = performance {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.cpu_power_management   = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.device_detach_attempts = 8 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.device_detach_timeout  = 20 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.disk_cachemodes        = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.disk_prefix            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.enabled_perf_events    = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.file_backed_memory     = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.gid_maps               = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.hw_disk_discard        = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.hw_machine_type        = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.images_rbd_pool        = rbd {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.images_type            = default {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.images_volume_group    = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.inject_key             = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.inject_partition       = -2 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.inject_password        = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.iscsi_iface            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.iser_use_multipath     = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.live_migration_downtime = 500 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.live_migration_inbound_addr = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.live_migration_scheme  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.live_migration_timeout_action = abort {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.live_migration_tunnelled = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: WARNING oslo_config.cfg [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 20 01:58:20 user nova-compute[74242]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 20 01:58:20 user nova-compute[74242]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 20 01:58:20 user nova-compute[74242]: and ``live_migration_inbound_addr`` respectively.
Oct 20 01:58:20 user nova-compute[74242]: ).  Its value may be silently ignored in the future.
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.live_migration_with_native_tls = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.max_queues             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.nfs_mount_options      = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.num_pcie_ports         = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.pmem_namespaces        = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.quobyte_client_cfg     = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.rbd_secret_uuid        = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.rbd_user               = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.rescue_image_id        = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.rescue_kernel_id       = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.rx_queue_size          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.smbfs_mount_options    =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.snapshot_compression   = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.snapshot_image_format  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.sparse_logical_volumes = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.swtpm_enabled          = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.swtpm_group            = tss {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.swtpm_user             = tss {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.sysinfo_serial         = unique {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.tb_cache_size          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.tx_queue_size          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.uid_maps               = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.use_virtio_for_bridges = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.virt_type              = kvm {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.volume_clear           = zero {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.volume_clear_size      = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.volume_use_multipath   = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.vzstorage_cache_path   = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.auth_section           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.auth_type              = password {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.cafile                 = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.certfile               = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.collect_timing         = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.connect_retries        = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.connect_retry_delay    = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.default_floating_pool  = public {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.endpoint_override      = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.extension_sync_interval = 600 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.http_retries           = 3 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.insecure               = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.keyfile                = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.max_version            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.min_version            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.ovs_bridge             = br-int {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.physnets               = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.region_name            = RegionOne {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.service_metadata_proxy = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.service_name           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.service_type           = network {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.split_loggers          = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.status_code_retries    = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.status_code_retry_delay = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.timeout                = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] neutron.version                = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] notifications.bdms_in_notifications = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] notifications.default_level    = INFO {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] notifications.notification_format = unversioned {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] notifications.notify_on_state_change = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] pci.alias                      = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] pci.device_spec                = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] pci.report_in_placement        = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.auth_section         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.auth_type            = password {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.cafile               = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.certfile             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.collect_timing       = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.connect_retries      = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.connect_retry_delay  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.default_domain_id    = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.default_domain_name  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.domain_id            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.domain_name          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.endpoint_override    = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.insecure             = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.keyfile              = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.max_version          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.min_version          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.password             = **** {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.project_domain_id    = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.project_domain_name  = Default {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.project_id           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.project_name         = service {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.region_name          = RegionOne {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.service_name         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.service_type         = placement {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.split_loggers        = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.status_code_retries  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.status_code_retry_delay = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.system_scope         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.timeout              = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.trust_id             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.user_domain_id       = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.user_domain_name     = Default {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.user_id              = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.username             = placement {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] placement.version              = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] quota.cores                    = 20 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] quota.count_usage_from_placement = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] quota.injected_file_content_bytes = 10240 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] quota.injected_file_path_length = 255 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] quota.injected_files           = 5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] quota.instances                = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] quota.key_pairs                = 100 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] quota.metadata_items           = 128 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] quota.ram                      = 51200 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] quota.recheck_quota            = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] quota.server_group_members     = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] quota.server_groups            = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] rdp.enabled                    = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] scheduler.image_metadata_prefilter = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] scheduler.max_attempts         = 3 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] scheduler.max_placement_results = 1000 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] scheduler.workers              = 3 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.host_subset_size = 1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.isolated_hosts = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.isolated_images = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.pci_in_placement = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.track_instance_changes = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] metrics.required               = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] metrics.weight_multiplier      = 1.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] metrics.weight_setting         = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] serial_console.enabled         = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] serial_console.port_range      = 10000:20000 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] serial_console.serialproxy_port = 6083 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] service_user.auth_section      = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] service_user.auth_type         = password {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] service_user.cafile            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] service_user.certfile          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] service_user.collect_timing    = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] service_user.insecure          = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] service_user.keyfile           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] service_user.send_service_user_token = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] service_user.split_loggers     = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] service_user.timeout           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] spice.agent_enabled            = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] spice.enabled                  = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] spice.html5proxy_port          = 6082 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] spice.image_compression        = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] spice.jpeg_compression         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] spice.playback_compression     = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] spice.server_listen            = 127.0.0.1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] spice.streaming_mode           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] spice.zlib_compression         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] upgrade_levels.baseapi         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] upgrade_levels.cert            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] upgrade_levels.compute         = auto {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] upgrade_levels.conductor       = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] upgrade_levels.scheduler       = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vendordata_dynamic_auth.cafile = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vendordata_dynamic_auth.certfile = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vendordata_dynamic_auth.insecure = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vendordata_dynamic_auth.timeout = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.api_retry_count         = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.ca_file                 = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.cache_prefix            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.cluster_name            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.connection_pool_size    = 10 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.console_delay_seconds   = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.datastore_regex         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.host_ip                 = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.host_password           = **** {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.host_port               = 443 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.host_username           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.insecure                = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.integration_bridge      = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.maximum_objects         = 100 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.pbm_default_policy      = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.pbm_enabled             = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.pbm_wsdl_location       = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.serial_port_proxy_uri   = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.serial_port_service_uri = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.task_poll_interval      = 0.5 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.use_linked_clone        = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.vnc_keymap              = en-us {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.vnc_port                = 5900 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vmware.vnc_port_total          = 10000 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vnc.auth_schemes               = ['none'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vnc.enabled                    = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vnc.novncproxy_port            = 6080 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vnc.vencrypt_ca_certs          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vnc.vencrypt_client_cert       = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vnc.vencrypt_client_key        = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.disable_rootwrap   = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.enable_numa_live_migration = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.libvirt_disable_apic = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] wsgi.client_socket_timeout     = 900 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] wsgi.default_pool_size         = 1000 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] wsgi.keep_alive                = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] wsgi.max_header_line           = 16384 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] wsgi.ssl_ca_file               = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] wsgi.ssl_cert_file             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] wsgi.ssl_key_file              = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] wsgi.tcp_keepidle              = 600 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] zvm.ca_file                    = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] zvm.cloud_connector_url        = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] zvm.reachable_timeout          = 300 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_policy.enforce_new_defaults = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_policy.enforce_scope      = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_policy.policy_default_rule = default {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] profiler.connection_string     = messaging:// {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] profiler.enabled               = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] profiler.es_doc_type           = notification {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] profiler.es_scroll_size        = 10000 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] profiler.es_scroll_time        = 2m {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] profiler.filter_error_trace    = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] profiler.hmac_keys             = **** {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] profiler.sentinel_service_name = mymaster {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] profiler.socket_timeout        = 0.1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] profiler.trace_requests        = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] profiler.trace_sqlalchemy      = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] profiler_jaeger.process_tags   = {} {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] profiler_jaeger.service_name_prefix = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] profiler_otlp.service_name_prefix = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] remote_debug.host              = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] remote_debug.port              = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_notifications.retry = -1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.auth_section        = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.auth_type           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.cafile              = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.certfile            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.collect_timing      = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.connect_retries     = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.connect_retry_delay = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.endpoint_id         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.endpoint_override   = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.insecure            = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.keyfile             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.max_version         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.min_version         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.region_name         = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.service_name        = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.service_type        = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.split_loggers       = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.status_code_retries = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.status_code_retry_delay = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.timeout             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.valid_interfaces    = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_limit.version             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_reports.file_event_handler = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] oslo_reports.log_dir           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vif_plug_ovs_privileged.group  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] vif_plug_ovs_privileged.user   = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_vif_ovs.isolate_vif         = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] os_brick.lock_path             = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] privsep_osbrick.capabilities   = [21] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] privsep_osbrick.group          = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] privsep_osbrick.helper_command = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] privsep_osbrick.user           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] nova_sys_admin.group           = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] nova_sys_admin.helper_command  = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] nova_sys_admin.user            = None {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG oslo_service.service [None req-6819128b-8a65-437d-bafb-0399a520a380 None None] ******************************************************************************** {{(pid=74242) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 20 01:58:20 user nova-compute[74242]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 20 01:58:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Connecting to libvirt: qemu:///system {{(pid=74242) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fb8d9462440> {{(pid=74242) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 20 01:58:20 user nova-compute[74242]: libvirt:  error : internal error: could not initialize domain event timer
Oct 20 01:58:20 user nova-compute[74242]: WARNING nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 20 01:58:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fb8d9462440> {{(pid=74242) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Starting native event thread {{(pid=74242) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Starting green dispatch thread {{(pid=74242) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 20 01:58:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Starting connection event dispatch thread {{(pid=74242) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 20 01:58:20 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Connection event '1' reason 'None'
Oct 20 01:58:20 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 01:58:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.mount [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Initialising _HostMountState generation 0 {{(pid=74242) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 20 01:58:28 user nova-compute[74242]: INFO nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Libvirt host capabilities <capabilities>
Oct 20 01:58:28 user nova-compute[74242]:   <host>
Oct 20 01:58:28 user nova-compute[74242]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 20 01:58:28 user nova-compute[74242]:     <cpu>
Oct 20 01:58:28 user nova-compute[74242]:       <arch>x86_64</arch>
Oct 20 01:58:28 user nova-compute[74242]:       <model>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <vendor>Intel</vendor>
Oct 20 01:58:28 user nova-compute[74242]:       <microcode version='1070'/>
Oct 20 01:58:28 user nova-compute[74242]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 20 01:58:28 user nova-compute[74242]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature name='ss'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature name='vmx'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature name='pcid'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature name='osxsave'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature name='hypervisor'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature name='arat'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature name='tsc_adjust'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature name='md-clear'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature name='stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature name='arch-capabilities'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature name='ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature name='invtsc'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature name='rsba'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature name='skip-l1dfl-vmentry'/>
Oct 20 01:58:28 user nova-compute[74242]:       <pages unit='KiB' size='4'/>
Oct 20 01:58:28 user nova-compute[74242]:       <pages unit='KiB' size='2048'/>
Oct 20 01:58:28 user nova-compute[74242]:     </cpu>
Oct 20 01:58:28 user nova-compute[74242]:     <power_management>
Oct 20 01:58:28 user nova-compute[74242]:       <suspend_mem/>
Oct 20 01:58:28 user nova-compute[74242]:       <suspend_disk/>
Oct 20 01:58:28 user nova-compute[74242]:       <suspend_hybrid/>
Oct 20 01:58:28 user nova-compute[74242]:     </power_management>
Oct 20 01:58:28 user nova-compute[74242]:     <iommu support='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     <migration_features>
Oct 20 01:58:28 user nova-compute[74242]:       <live/>
Oct 20 01:58:28 user nova-compute[74242]:       <uri_transports>
Oct 20 01:58:28 user nova-compute[74242]:         <uri_transport>tcp</uri_transport>
Oct 20 01:58:28 user nova-compute[74242]:         <uri_transport>rdma</uri_transport>
Oct 20 01:58:28 user nova-compute[74242]:       </uri_transports>
Oct 20 01:58:28 user nova-compute[74242]:     </migration_features>
Oct 20 01:58:28 user nova-compute[74242]:     <topology>
Oct 20 01:58:28 user nova-compute[74242]:       <cells num='2'>
Oct 20 01:58:28 user nova-compute[74242]:         <cell id='0'>
Oct 20 01:58:28 user nova-compute[74242]:           <memory unit='KiB'>8189224</memory>
Oct 20 01:58:28 user nova-compute[74242]:           <pages unit='KiB' size='4'>2047306</pages>
Oct 20 01:58:28 user nova-compute[74242]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 01:58:28 user nova-compute[74242]:           <distances>
Oct 20 01:58:28 user nova-compute[74242]:             <sibling id='0' value='10'/>
Oct 20 01:58:28 user nova-compute[74242]:             <sibling id='1' value='20'/>
Oct 20 01:58:28 user nova-compute[74242]:           </distances>
Oct 20 01:58:28 user nova-compute[74242]:           <cpus num='6'>
Oct 20 01:58:28 user nova-compute[74242]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 20 01:58:28 user nova-compute[74242]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 20 01:58:28 user nova-compute[74242]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 20 01:58:28 user nova-compute[74242]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 20 01:58:28 user nova-compute[74242]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 20 01:58:28 user nova-compute[74242]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 20 01:58:28 user nova-compute[74242]:           </cpus>
Oct 20 01:58:28 user nova-compute[74242]:         </cell>
Oct 20 01:58:28 user nova-compute[74242]:         <cell id='1'>
Oct 20 01:58:28 user nova-compute[74242]:           <memory unit='KiB'>8206460</memory>
Oct 20 01:58:28 user nova-compute[74242]:           <pages unit='KiB' size='4'>2051615</pages>
Oct 20 01:58:28 user nova-compute[74242]:           <pages unit='KiB' size='2048'>0</pages>
Oct 20 01:58:28 user nova-compute[74242]:           <distances>
Oct 20 01:58:28 user nova-compute[74242]:             <sibling id='0' value='20'/>
Oct 20 01:58:28 user nova-compute[74242]:             <sibling id='1' value='10'/>
Oct 20 01:58:28 user nova-compute[74242]:           </distances>
Oct 20 01:58:28 user nova-compute[74242]:           <cpus num='6'>
Oct 20 01:58:28 user nova-compute[74242]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 20 01:58:28 user nova-compute[74242]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 20 01:58:28 user nova-compute[74242]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 20 01:58:28 user nova-compute[74242]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 20 01:58:28 user nova-compute[74242]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 20 01:58:28 user nova-compute[74242]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 20 01:58:28 user nova-compute[74242]:           </cpus>
Oct 20 01:58:28 user nova-compute[74242]:         </cell>
Oct 20 01:58:28 user nova-compute[74242]:       </cells>
Oct 20 01:58:28 user nova-compute[74242]:     </topology>
Oct 20 01:58:28 user nova-compute[74242]:     <cache>
Oct 20 01:58:28 user nova-compute[74242]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 20 01:58:28 user nova-compute[74242]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 20 01:58:28 user nova-compute[74242]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 20 01:58:28 user nova-compute[74242]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 20 01:58:28 user nova-compute[74242]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 20 01:58:28 user nova-compute[74242]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 20 01:58:28 user nova-compute[74242]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 20 01:58:28 user nova-compute[74242]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 20 01:58:28 user nova-compute[74242]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 20 01:58:28 user nova-compute[74242]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 20 01:58:28 user nova-compute[74242]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 20 01:58:28 user nova-compute[74242]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 20 01:58:28 user nova-compute[74242]:     </cache>
Oct 20 01:58:28 user nova-compute[74242]:     <secmodel>
Oct 20 01:58:28 user nova-compute[74242]:       <model>apparmor</model>
Oct 20 01:58:28 user nova-compute[74242]:       <doi>0</doi>
Oct 20 01:58:28 user nova-compute[74242]:     </secmodel>
Oct 20 01:58:28 user nova-compute[74242]:     <secmodel>
Oct 20 01:58:28 user nova-compute[74242]:       <model>dac</model>
Oct 20 01:58:28 user nova-compute[74242]:       <doi>0</doi>
Oct 20 01:58:28 user nova-compute[74242]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 20 01:58:28 user nova-compute[74242]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 20 01:58:28 user nova-compute[74242]:     </secmodel>
Oct 20 01:58:28 user nova-compute[74242]:   </host>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='alpha'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>64</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>clipper</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='armv6l'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>32</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>spitz</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>nuri</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>kzm</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sx1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>z2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>tosa</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>n810</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>n800</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>terrier</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>midway</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>microbit</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>verdex</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>highbank</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>akita</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>connex</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>collie</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='armv7l'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>32</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>spitz</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>nuri</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>kzm</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sx1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>z2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>tosa</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>n810</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>n800</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>terrier</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>midway</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>microbit</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>verdex</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>highbank</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>akita</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>connex</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>collie</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='aarch64'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>64</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>integratorcp</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>borzoi</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>spitz</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>nuri</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>musca-b1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>versatileab</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>kzm</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>musca-a</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>smdkc210</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sx1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>z2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>tosa</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>sabrelite</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>realview-eb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>n810</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>n800</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>versatilepb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>terrier</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mainstone</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>midway</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>musicpal</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>microbit</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>cubieboard</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>verdex</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>netduino2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>raspi3b</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>raspi2b</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>cheetah</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>highbank</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>akita</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>connex</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>collie</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>raspi0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <acpi default='on' toggle='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='cris'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>32</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='i686'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>32</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>isapc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>microvm</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='kvm'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <pae/>
Oct 20 01:58:28 user nova-compute[74242]:       <nonpae/>
Oct 20 01:58:28 user nova-compute[74242]:       <acpi default='on' toggle='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:       <apic default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='m68k'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>32</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>an5206</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>q800</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>next-cube</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='microblaze'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>32</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='microblazeel'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>32</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='mips'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>32</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='16'>malta</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='mipsel'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>32</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='16'>malta</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='mips64'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>64</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='16'>malta</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>pica61</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>magnum</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='mips64el'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>64</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='16'>malta</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mipssim</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>pica61</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>magnum</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='16'>boston</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='ppc'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>32</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mac99</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>40p</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>taihu</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='ppc64'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>64</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>taihu</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>40p</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mac99</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='ppc64le'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>64</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2048'>powernv9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>taihu</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2048'>powernv10</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>ppce500</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>40p</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>pegasos2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>bamboo</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>g3beige</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>mac99</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sam460ex</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>ref405ep</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2048'>powernv8</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='riscv32'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>32</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='8'>spike</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>opentitan</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='8'>virt</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='riscv64'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>64</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='8'>spike</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='5'>sifive_u</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>shakti_c</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sifive_e</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='8'>virt</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='s390x'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>64</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='sh4'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>32</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>shix</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>r2d</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='sh4eb'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>64</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>shix</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>r2d</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='sparc'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>32</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>SS-5</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>SS-20</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>LX</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>SS-4</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>SS-10</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>Voyager</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='sparc64'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>64</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sun4u</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>niagara</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>sun4v</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='x86_64'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>64</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>x-remote</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='1'>isapc</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>microvm</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='kvm'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <acpi default='on' toggle='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:       <apic default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='xtensa'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>32</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>sim</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>kc705</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>ml605</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>virt</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>lx200</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>lx60</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]:   <guest>
Oct 20 01:58:28 user nova-compute[74242]:     <os_type>hvm</os_type>
Oct 20 01:58:28 user nova-compute[74242]:     <arch name='xtensaeb'>
Oct 20 01:58:28 user nova-compute[74242]:       <wordsize>32</wordsize>
Oct 20 01:58:28 user nova-compute[74242]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='4'>sim</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>kc705</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>ml605</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>virt</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>lx200</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>lx60</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 20 01:58:28 user nova-compute[74242]:       <domain type='qemu'/>
Oct 20 01:58:28 user nova-compute[74242]:     </arch>
Oct 20 01:58:28 user nova-compute[74242]:     <features>
Oct 20 01:58:28 user nova-compute[74242]:       <cpuselection/>
Oct 20 01:58:28 user nova-compute[74242]:       <deviceboot/>
Oct 20 01:58:28 user nova-compute[74242]:       <disksnapshot default='on' toggle='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     </features>
Oct 20 01:58:28 user nova-compute[74242]:   </guest>
Oct 20 01:58:28 user nova-compute[74242]: </capabilities>
Oct 20 01:58:28 user nova-compute[74242]: 
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 20 01:58:28 user nova-compute[74242]: <domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 01:58:28 user nova-compute[74242]:   <domain>kvm</domain>
Oct 20 01:58:28 user nova-compute[74242]:   <machine>pc-i440fx-6.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:   <arch>i686</arch>
Oct 20 01:58:28 user nova-compute[74242]:   <vcpu max='255'/>
Oct 20 01:58:28 user nova-compute[74242]:   <iothreads supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:   <os supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='firmware'/>
Oct 20 01:58:28 user nova-compute[74242]:     <loader supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>rom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pflash</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='readonly'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>yes</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='secure'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </loader>
Oct 20 01:58:28 user nova-compute[74242]:   </os>
Oct 20 01:58:28 user nova-compute[74242]:   <cpu>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-passthrough' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='hostPassthroughMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='maximum' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='maximumMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>on</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-model' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <vendor>Intel</vendor>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ss'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='vmx'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='pcid'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='hypervisor'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arat'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='umip'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='md-clear'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibpb'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibrs'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='erms'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='lm'/>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='custom' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>qemu64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>qemu32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>phenom</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>n270</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>kvm64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>kvm32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>coreduo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>core2duo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>athlon</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Westmere</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Snowridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Penryn</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G5</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G4</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G1</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Nehalem</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Rome</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Milan</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Dhyana</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cooperlake</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Conroe</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>486</model>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:   </cpu>
Oct 20 01:58:28 user nova-compute[74242]:   <memoryBacking supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='sourceType'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>file</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>anonymous</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>memfd</value>
Oct 20 01:58:28 user nova-compute[74242]:     </enum>
Oct 20 01:58:28 user nova-compute[74242]:   </memoryBacking>
Oct 20 01:58:28 user nova-compute[74242]:   <devices>
Oct 20 01:58:28 user nova-compute[74242]:     <disk supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='diskDevice'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>disk</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cdrom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>floppy</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>lun</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='bus'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>ide</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>fdc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sata</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </disk>
Oct 20 01:58:28 user nova-compute[74242]:     <graphics supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sdl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vnc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>spice</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egl-headless</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </graphics>
Oct 20 01:58:28 user nova-compute[74242]:     <video supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='modelType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cirrus</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vmvga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>qxl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>none</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>bochs</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>ramfb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </video>
Oct 20 01:58:28 user nova-compute[74242]:     <hostdev supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='mode'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>subsystem</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='startupPolicy'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>default</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>mandatory</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>requisite</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>optional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='subsysType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pci</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='capsType'/>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='pciBackend'/>
Oct 20 01:58:28 user nova-compute[74242]:     </hostdev>
Oct 20 01:58:28 user nova-compute[74242]:     <rng supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>random</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egd</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>builtin</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </rng>
Oct 20 01:58:28 user nova-compute[74242]:     <filesystem supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='driverType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>path</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>handle</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtiofs</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </filesystem>
Oct 20 01:58:28 user nova-compute[74242]:     <tpm supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-tis</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-crb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>passthrough</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>emulator</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </tpm>
Oct 20 01:58:28 user nova-compute[74242]:   </devices>
Oct 20 01:58:28 user nova-compute[74242]:   <features>
Oct 20 01:58:28 user nova-compute[74242]:     <gic supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     <vmcoreinfo supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <genid supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backingStoreInput supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backup supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <sev supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:   </features>
Oct 20 01:58:28 user nova-compute[74242]: </domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:  {{(pid=74242) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 20 01:58:28 user nova-compute[74242]: <domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 01:58:28 user nova-compute[74242]:   <domain>kvm</domain>
Oct 20 01:58:28 user nova-compute[74242]:   <machine>pc-i440fx-jammy</machine>
Oct 20 01:58:28 user nova-compute[74242]:   <arch>i686</arch>
Oct 20 01:58:28 user nova-compute[74242]:   <vcpu max='255'/>
Oct 20 01:58:28 user nova-compute[74242]:   <iothreads supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:   <os supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='firmware'/>
Oct 20 01:58:28 user nova-compute[74242]:     <loader supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>rom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pflash</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='readonly'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>yes</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='secure'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </loader>
Oct 20 01:58:28 user nova-compute[74242]:   </os>
Oct 20 01:58:28 user nova-compute[74242]:   <cpu>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-passthrough' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='hostPassthroughMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='maximum' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='maximumMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>on</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-model' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <vendor>Intel</vendor>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ss'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='vmx'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='pcid'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='hypervisor'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arat'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='umip'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='md-clear'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibpb'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibrs'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='erms'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='lm'/>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='custom' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>qemu64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>qemu32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>phenom</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>n270</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>kvm64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>kvm32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>coreduo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>core2duo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>athlon</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Westmere</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Snowridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Penryn</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G5</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G4</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G1</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Nehalem</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Rome</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Milan</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Dhyana</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cooperlake</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Conroe</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>486</model>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:   </cpu>
Oct 20 01:58:28 user nova-compute[74242]:   <memoryBacking supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='sourceType'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>file</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>anonymous</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>memfd</value>
Oct 20 01:58:28 user nova-compute[74242]:     </enum>
Oct 20 01:58:28 user nova-compute[74242]:   </memoryBacking>
Oct 20 01:58:28 user nova-compute[74242]:   <devices>
Oct 20 01:58:28 user nova-compute[74242]:     <disk supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='diskDevice'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>disk</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cdrom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>floppy</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>lun</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='bus'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>ide</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>fdc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sata</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </disk>
Oct 20 01:58:28 user nova-compute[74242]:     <graphics supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sdl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vnc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>spice</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egl-headless</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </graphics>
Oct 20 01:58:28 user nova-compute[74242]:     <video supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='modelType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cirrus</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vmvga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>qxl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>none</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>bochs</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>ramfb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </video>
Oct 20 01:58:28 user nova-compute[74242]:     <hostdev supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='mode'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>subsystem</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='startupPolicy'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>default</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>mandatory</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>requisite</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>optional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='subsysType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pci</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='capsType'/>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='pciBackend'/>
Oct 20 01:58:28 user nova-compute[74242]:     </hostdev>
Oct 20 01:58:28 user nova-compute[74242]:     <rng supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>random</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egd</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>builtin</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </rng>
Oct 20 01:58:28 user nova-compute[74242]:     <filesystem supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='driverType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>path</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>handle</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtiofs</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </filesystem>
Oct 20 01:58:28 user nova-compute[74242]:     <tpm supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-tis</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-crb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>passthrough</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>emulator</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </tpm>
Oct 20 01:58:28 user nova-compute[74242]:   </devices>
Oct 20 01:58:28 user nova-compute[74242]:   <features>
Oct 20 01:58:28 user nova-compute[74242]:     <gic supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     <vmcoreinfo supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <genid supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backingStoreInput supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backup supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <sev supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:   </features>
Oct 20 01:58:28 user nova-compute[74242]: </domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:  {{(pid=74242) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 20 01:58:28 user nova-compute[74242]: <domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 01:58:28 user nova-compute[74242]:   <domain>kvm</domain>
Oct 20 01:58:28 user nova-compute[74242]:   <machine>pc-q35-6.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:   <arch>i686</arch>
Oct 20 01:58:28 user nova-compute[74242]:   <vcpu max='288'/>
Oct 20 01:58:28 user nova-compute[74242]:   <iothreads supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:   <os supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='firmware'/>
Oct 20 01:58:28 user nova-compute[74242]:     <loader supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>rom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pflash</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='readonly'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>yes</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='secure'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </loader>
Oct 20 01:58:28 user nova-compute[74242]:   </os>
Oct 20 01:58:28 user nova-compute[74242]:   <cpu>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-passthrough' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='hostPassthroughMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='maximum' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='maximumMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>on</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-model' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <vendor>Intel</vendor>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ss'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='vmx'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='pcid'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='hypervisor'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arat'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='umip'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='md-clear'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibpb'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibrs'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='erms'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='lm'/>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='custom' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>qemu64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>qemu32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>phenom</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>n270</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>kvm64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>kvm32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>coreduo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>core2duo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>athlon</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Westmere</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Snowridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Penryn</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G5</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G4</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G1</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Nehalem</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Rome</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Milan</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Dhyana</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cooperlake</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Conroe</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>486</model>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:   </cpu>
Oct 20 01:58:28 user nova-compute[74242]:   <memoryBacking supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='sourceType'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>file</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>anonymous</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>memfd</value>
Oct 20 01:58:28 user nova-compute[74242]:     </enum>
Oct 20 01:58:28 user nova-compute[74242]:   </memoryBacking>
Oct 20 01:58:28 user nova-compute[74242]:   <devices>
Oct 20 01:58:28 user nova-compute[74242]:     <disk supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='diskDevice'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>disk</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cdrom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>floppy</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>lun</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='bus'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>fdc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sata</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </disk>
Oct 20 01:58:28 user nova-compute[74242]:     <graphics supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sdl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vnc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>spice</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egl-headless</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </graphics>
Oct 20 01:58:28 user nova-compute[74242]:     <video supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='modelType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cirrus</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vmvga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>qxl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>none</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>bochs</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>ramfb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </video>
Oct 20 01:58:28 user nova-compute[74242]:     <hostdev supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='mode'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>subsystem</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='startupPolicy'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>default</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>mandatory</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>requisite</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>optional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='subsysType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pci</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='capsType'/>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='pciBackend'/>
Oct 20 01:58:28 user nova-compute[74242]:     </hostdev>
Oct 20 01:58:28 user nova-compute[74242]:     <rng supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>random</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egd</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>builtin</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </rng>
Oct 20 01:58:28 user nova-compute[74242]:     <filesystem supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='driverType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>path</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>handle</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtiofs</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </filesystem>
Oct 20 01:58:28 user nova-compute[74242]:     <tpm supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-tis</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-crb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>passthrough</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>emulator</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </tpm>
Oct 20 01:58:28 user nova-compute[74242]:   </devices>
Oct 20 01:58:28 user nova-compute[74242]:   <features>
Oct 20 01:58:28 user nova-compute[74242]:     <gic supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     <vmcoreinfo supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <genid supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backingStoreInput supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backup supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <sev supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:   </features>
Oct 20 01:58:28 user nova-compute[74242]: </domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:  {{(pid=74242) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 20 01:58:28 user nova-compute[74242]: <domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:   <path>/usr/bin/qemu-system-i386</path>
Oct 20 01:58:28 user nova-compute[74242]:   <domain>kvm</domain>
Oct 20 01:58:28 user nova-compute[74242]:   <machine>pc-q35-jammy</machine>
Oct 20 01:58:28 user nova-compute[74242]:   <arch>i686</arch>
Oct 20 01:58:28 user nova-compute[74242]:   <vcpu max='288'/>
Oct 20 01:58:28 user nova-compute[74242]:   <iothreads supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:   <os supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='firmware'/>
Oct 20 01:58:28 user nova-compute[74242]:     <loader supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>rom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pflash</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='readonly'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>yes</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='secure'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </loader>
Oct 20 01:58:28 user nova-compute[74242]:   </os>
Oct 20 01:58:28 user nova-compute[74242]:   <cpu>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-passthrough' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='hostPassthroughMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='maximum' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='maximumMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>on</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-model' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <vendor>Intel</vendor>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ss'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='vmx'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='pcid'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='hypervisor'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arat'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='umip'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='md-clear'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibpb'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibrs'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='erms'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='lm'/>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='custom' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>qemu64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>qemu32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>phenom</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>n270</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>kvm64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>kvm32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>coreduo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>core2duo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>athlon</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Westmere-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Westmere</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Snowridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Penryn</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G5</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G4</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G1</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Nehalem-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Nehalem</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Rome</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Milan</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Dhyana</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cooperlake</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Conroe</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>486</model>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:   </cpu>
Oct 20 01:58:28 user nova-compute[74242]:   <memoryBacking supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='sourceType'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>file</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>anonymous</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>memfd</value>
Oct 20 01:58:28 user nova-compute[74242]:     </enum>
Oct 20 01:58:28 user nova-compute[74242]:   </memoryBacking>
Oct 20 01:58:28 user nova-compute[74242]:   <devices>
Oct 20 01:58:28 user nova-compute[74242]:     <disk supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='diskDevice'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>disk</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cdrom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>floppy</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>lun</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='bus'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>fdc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sata</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </disk>
Oct 20 01:58:28 user nova-compute[74242]:     <graphics supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sdl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vnc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>spice</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egl-headless</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </graphics>
Oct 20 01:58:28 user nova-compute[74242]:     <video supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='modelType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cirrus</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vmvga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>qxl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>none</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>bochs</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>ramfb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </video>
Oct 20 01:58:28 user nova-compute[74242]:     <hostdev supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='mode'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>subsystem</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='startupPolicy'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>default</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>mandatory</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>requisite</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>optional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='subsysType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pci</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='capsType'/>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='pciBackend'/>
Oct 20 01:58:28 user nova-compute[74242]:     </hostdev>
Oct 20 01:58:28 user nova-compute[74242]:     <rng supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>random</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egd</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>builtin</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </rng>
Oct 20 01:58:28 user nova-compute[74242]:     <filesystem supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='driverType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>path</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>handle</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtiofs</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </filesystem>
Oct 20 01:58:28 user nova-compute[74242]:     <tpm supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-tis</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-crb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>passthrough</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>emulator</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </tpm>
Oct 20 01:58:28 user nova-compute[74242]:   </devices>
Oct 20 01:58:28 user nova-compute[74242]:   <features>
Oct 20 01:58:28 user nova-compute[74242]:     <gic supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     <vmcoreinfo supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <genid supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backingStoreInput supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backup supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <sev supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:   </features>
Oct 20 01:58:28 user nova-compute[74242]: </domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:  {{(pid=74242) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 20 01:58:28 user nova-compute[74242]: <domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 01:58:28 user nova-compute[74242]:   <domain>kvm</domain>
Oct 20 01:58:28 user nova-compute[74242]:   <machine>pc-i440fx-6.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:   <arch>x86_64</arch>
Oct 20 01:58:28 user nova-compute[74242]:   <vcpu max='255'/>
Oct 20 01:58:28 user nova-compute[74242]:   <iothreads supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:   <os supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='firmware'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>efi</value>
Oct 20 01:58:28 user nova-compute[74242]:     </enum>
Oct 20 01:58:28 user nova-compute[74242]:     <loader supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>rom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pflash</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='readonly'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>yes</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='secure'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </loader>
Oct 20 01:58:28 user nova-compute[74242]:   </os>
Oct 20 01:58:28 user nova-compute[74242]:   <cpu>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-passthrough' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='hostPassthroughMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>on</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='maximum' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='maximumMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>on</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-model' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <vendor>Intel</vendor>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ss'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='vmx'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='pcid'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='hypervisor'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arat'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='umip'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='md-clear'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='invtsc'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibpb'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibrs'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='rsba'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='erms'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='custom' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>qemu64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>qemu32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>phenom</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>n270</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>kvm64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>kvm32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>coreduo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>core2duo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>athlon</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Westmere</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Snowridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Penryn</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G5</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G4</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Opteron_G1</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Nehalem</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Rome</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Milan</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Dhyana</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cooperlake</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Conroe</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>486</model>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:   </cpu>
Oct 20 01:58:28 user nova-compute[74242]:   <memoryBacking supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='sourceType'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>file</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>anonymous</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>memfd</value>
Oct 20 01:58:28 user nova-compute[74242]:     </enum>
Oct 20 01:58:28 user nova-compute[74242]:   </memoryBacking>
Oct 20 01:58:28 user nova-compute[74242]:   <devices>
Oct 20 01:58:28 user nova-compute[74242]:     <disk supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='diskDevice'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>disk</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cdrom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>floppy</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>lun</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='bus'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>ide</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>fdc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sata</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </disk>
Oct 20 01:58:28 user nova-compute[74242]:     <graphics supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sdl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vnc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>spice</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egl-headless</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </graphics>
Oct 20 01:58:28 user nova-compute[74242]:     <video supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='modelType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cirrus</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vmvga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>qxl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>none</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>bochs</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>ramfb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </video>
Oct 20 01:58:28 user nova-compute[74242]:     <hostdev supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='mode'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>subsystem</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='startupPolicy'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>default</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>mandatory</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>requisite</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>optional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='subsysType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pci</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='capsType'/>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='pciBackend'/>
Oct 20 01:58:28 user nova-compute[74242]:     </hostdev>
Oct 20 01:58:28 user nova-compute[74242]:     <rng supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>random</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egd</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>builtin</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </rng>
Oct 20 01:58:28 user nova-compute[74242]:     <filesystem supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='driverType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>path</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>handle</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtiofs</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </filesystem>
Oct 20 01:58:28 user nova-compute[74242]:     <tpm supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-tis</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-crb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>passthrough</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>emulator</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </tpm>
Oct 20 01:58:28 user nova-compute[74242]:   </devices>
Oct 20 01:58:28 user nova-compute[74242]:   <features>
Oct 20 01:58:28 user nova-compute[74242]:     <gic supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     <vmcoreinfo supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <genid supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backingStoreInput supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backup supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <sev supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:   </features>
Oct 20 01:58:28 user nova-compute[74242]: </domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:  {{(pid=74242) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 20 01:58:28 user nova-compute[74242]: <domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 01:58:28 user nova-compute[74242]:   <domain>kvm</domain>
Oct 20 01:58:28 user nova-compute[74242]:   <machine>pc-i440fx-jammy</machine>
Oct 20 01:58:28 user nova-compute[74242]:   <arch>x86_64</arch>
Oct 20 01:58:28 user nova-compute[74242]:   <vcpu max='255'/>
Oct 20 01:58:28 user nova-compute[74242]:   <iothreads supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:   <os supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='firmware'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>efi</value>
Oct 20 01:58:28 user nova-compute[74242]:     </enum>
Oct 20 01:58:28 user nova-compute[74242]:     <loader supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>rom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pflash</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='readonly'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>yes</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='secure'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </loader>
Oct 20 01:58:28 user nova-compute[74242]:   </os>
Oct 20 01:58:28 user nova-compute[74242]:   <cpu>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-passthrough' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='hostPassthroughMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>on</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='maximum' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='maximumMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>on</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-model' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <vendor>Intel</vendor>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ss'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='vmx'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='pcid'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='hypervisor'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arat'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='umip'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='md-clear'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='invtsc'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibpb'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibrs'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='rsba'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='erms'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='custom' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>qemu64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>qemu32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>phenom</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>n270</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>kvm64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>kvm32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>coreduo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>core2duo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>athlon</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Westmere</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Snowridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Penryn</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G5</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G4</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Opteron_G1</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Nehalem</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Rome</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Milan</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Dhyana</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cooperlake</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Conroe</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>486</model>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:   </cpu>
Oct 20 01:58:28 user nova-compute[74242]:   <memoryBacking supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='sourceType'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>file</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>anonymous</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>memfd</value>
Oct 20 01:58:28 user nova-compute[74242]:     </enum>
Oct 20 01:58:28 user nova-compute[74242]:   </memoryBacking>
Oct 20 01:58:28 user nova-compute[74242]:   <devices>
Oct 20 01:58:28 user nova-compute[74242]:     <disk supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='diskDevice'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>disk</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cdrom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>floppy</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>lun</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='bus'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>ide</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>fdc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sata</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </disk>
Oct 20 01:58:28 user nova-compute[74242]:     <graphics supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sdl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vnc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>spice</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egl-headless</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </graphics>
Oct 20 01:58:28 user nova-compute[74242]:     <video supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='modelType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cirrus</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vmvga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>qxl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>none</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>bochs</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>ramfb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </video>
Oct 20 01:58:28 user nova-compute[74242]:     <hostdev supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='mode'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>subsystem</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='startupPolicy'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>default</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>mandatory</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>requisite</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>optional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='subsysType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pci</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='capsType'/>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='pciBackend'/>
Oct 20 01:58:28 user nova-compute[74242]:     </hostdev>
Oct 20 01:58:28 user nova-compute[74242]:     <rng supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>random</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egd</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>builtin</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </rng>
Oct 20 01:58:28 user nova-compute[74242]:     <filesystem supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='driverType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>path</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>handle</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtiofs</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </filesystem>
Oct 20 01:58:28 user nova-compute[74242]:     <tpm supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-tis</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-crb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>passthrough</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>emulator</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </tpm>
Oct 20 01:58:28 user nova-compute[74242]:   </devices>
Oct 20 01:58:28 user nova-compute[74242]:   <features>
Oct 20 01:58:28 user nova-compute[74242]:     <gic supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     <vmcoreinfo supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <genid supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backingStoreInput supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backup supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <sev supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:   </features>
Oct 20 01:58:28 user nova-compute[74242]: </domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:  {{(pid=74242) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 20 01:58:28 user nova-compute[74242]: <domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 01:58:28 user nova-compute[74242]:   <domain>kvm</domain>
Oct 20 01:58:28 user nova-compute[74242]:   <machine>pc-q35-6.2</machine>
Oct 20 01:58:28 user nova-compute[74242]:   <arch>x86_64</arch>
Oct 20 01:58:28 user nova-compute[74242]:   <vcpu max='288'/>
Oct 20 01:58:28 user nova-compute[74242]:   <iothreads supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:   <os supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='firmware'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>efi</value>
Oct 20 01:58:28 user nova-compute[74242]:     </enum>
Oct 20 01:58:28 user nova-compute[74242]:     <loader supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>rom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pflash</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='readonly'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>yes</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='secure'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>yes</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </loader>
Oct 20 01:58:28 user nova-compute[74242]:   </os>
Oct 20 01:58:28 user nova-compute[74242]:   <cpu>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-passthrough' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='hostPassthroughMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>on</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='maximum' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='maximumMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>on</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-model' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <vendor>Intel</vendor>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ss'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='vmx'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='pcid'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='hypervisor'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arat'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='umip'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='md-clear'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='invtsc'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibpb'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibrs'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='rsba'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='erms'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='custom' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>qemu64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>qemu32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>phenom</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>n270</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>kvm64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>kvm32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>coreduo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>core2duo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>athlon</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Westmere</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Snowridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Penryn</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G5</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G4</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Opteron_G1</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Nehalem</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Rome</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Milan</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Dhyana</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cooperlake</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Conroe</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>486</model>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:   </cpu>
Oct 20 01:58:28 user nova-compute[74242]:   <memoryBacking supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='sourceType'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>file</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>anonymous</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>memfd</value>
Oct 20 01:58:28 user nova-compute[74242]:     </enum>
Oct 20 01:58:28 user nova-compute[74242]:   </memoryBacking>
Oct 20 01:58:28 user nova-compute[74242]:   <devices>
Oct 20 01:58:28 user nova-compute[74242]:     <disk supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='diskDevice'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>disk</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cdrom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>floppy</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>lun</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='bus'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>fdc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sata</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </disk>
Oct 20 01:58:28 user nova-compute[74242]:     <graphics supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sdl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vnc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>spice</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egl-headless</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </graphics>
Oct 20 01:58:28 user nova-compute[74242]:     <video supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='modelType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cirrus</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vmvga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>qxl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>none</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>bochs</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>ramfb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </video>
Oct 20 01:58:28 user nova-compute[74242]:     <hostdev supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='mode'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>subsystem</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='startupPolicy'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>default</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>mandatory</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>requisite</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>optional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='subsysType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pci</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='capsType'/>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='pciBackend'/>
Oct 20 01:58:28 user nova-compute[74242]:     </hostdev>
Oct 20 01:58:28 user nova-compute[74242]:     <rng supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>random</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egd</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>builtin</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </rng>
Oct 20 01:58:28 user nova-compute[74242]:     <filesystem supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='driverType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>path</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>handle</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtiofs</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </filesystem>
Oct 20 01:58:28 user nova-compute[74242]:     <tpm supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-tis</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-crb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>passthrough</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>emulator</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </tpm>
Oct 20 01:58:28 user nova-compute[74242]:   </devices>
Oct 20 01:58:28 user nova-compute[74242]:   <features>
Oct 20 01:58:28 user nova-compute[74242]:     <gic supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     <vmcoreinfo supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <genid supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backingStoreInput supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backup supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <sev supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:   </features>
Oct 20 01:58:28 user nova-compute[74242]: </domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:  {{(pid=74242) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 20 01:58:28 user nova-compute[74242]: <domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 20 01:58:28 user nova-compute[74242]:   <domain>kvm</domain>
Oct 20 01:58:28 user nova-compute[74242]:   <machine>pc-q35-jammy</machine>
Oct 20 01:58:28 user nova-compute[74242]:   <arch>x86_64</arch>
Oct 20 01:58:28 user nova-compute[74242]:   <vcpu max='288'/>
Oct 20 01:58:28 user nova-compute[74242]:   <iothreads supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:   <os supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='firmware'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>efi</value>
Oct 20 01:58:28 user nova-compute[74242]:     </enum>
Oct 20 01:58:28 user nova-compute[74242]:     <loader supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>rom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pflash</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='readonly'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>yes</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='secure'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>yes</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>no</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </loader>
Oct 20 01:58:28 user nova-compute[74242]:   </os>
Oct 20 01:58:28 user nova-compute[74242]:   <cpu>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-passthrough' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='hostPassthroughMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>on</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='maximum' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='maximumMigratable'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>on</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>off</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='host-model' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <vendor>Intel</vendor>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ss'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='vmx'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='pcid'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='hypervisor'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arat'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='tsc_adjust'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='umip'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='md-clear'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='arch-capabilities'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='invtsc'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibpb'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='ibrs'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-stibp'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='amd-ssbd'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='rsba'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='require' name='pschange-mc-no'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='erms'/>
Oct 20 01:58:28 user nova-compute[74242]:       <feature policy='disable' name='xsaveopt'/>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:     <mode name='custom' supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>qemu64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>qemu32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>phenom</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>pentium</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>n270</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>kvm64</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>kvm32</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>coreduo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>core2duo</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>athlon</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Westmere-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Westmere</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Snowridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Skylake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>SandyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Penryn</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G5</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G4</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G3</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Opteron_G2</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Opteron_G1</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Nehalem</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>IvyBridge</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Icelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Haswell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Rome</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-Milan</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC-IBPB</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>EPYC</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Dhyana</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cooperlake</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>Conroe</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Cascadelake-Server</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-noTSX</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell-IBRS</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='no'>Broadwell</model>
Oct 20 01:58:28 user nova-compute[74242]:       <model usable='yes'>486</model>
Oct 20 01:58:28 user nova-compute[74242]:     </mode>
Oct 20 01:58:28 user nova-compute[74242]:   </cpu>
Oct 20 01:58:28 user nova-compute[74242]:   <memoryBacking supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:     <enum name='sourceType'>
Oct 20 01:58:28 user nova-compute[74242]:       <value>file</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>anonymous</value>
Oct 20 01:58:28 user nova-compute[74242]:       <value>memfd</value>
Oct 20 01:58:28 user nova-compute[74242]:     </enum>
Oct 20 01:58:28 user nova-compute[74242]:   </memoryBacking>
Oct 20 01:58:28 user nova-compute[74242]:   <devices>
Oct 20 01:58:28 user nova-compute[74242]:     <disk supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='diskDevice'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>disk</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cdrom</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>floppy</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>lun</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='bus'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>fdc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sata</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </disk>
Oct 20 01:58:28 user nova-compute[74242]:     <graphics supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='type'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>sdl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vnc</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>spice</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egl-headless</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </graphics>
Oct 20 01:58:28 user nova-compute[74242]:     <video supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='modelType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>cirrus</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>vmvga</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>qxl</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>none</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>bochs</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>ramfb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </video>
Oct 20 01:58:28 user nova-compute[74242]:     <hostdev supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='mode'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>subsystem</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='startupPolicy'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>default</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>mandatory</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>requisite</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>optional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='subsysType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>usb</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>pci</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>scsi</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='capsType'/>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='pciBackend'/>
Oct 20 01:58:28 user nova-compute[74242]:     </hostdev>
Oct 20 01:58:28 user nova-compute[74242]:     <rng supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtio-non-transitional</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>random</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>egd</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>builtin</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </rng>
Oct 20 01:58:28 user nova-compute[74242]:     <filesystem supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='driverType'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>path</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>handle</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>virtiofs</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </filesystem>
Oct 20 01:58:28 user nova-compute[74242]:     <tpm supported='yes'>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='model'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-tis</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>tpm-crb</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:       <enum name='backendModel'>
Oct 20 01:58:28 user nova-compute[74242]:         <value>passthrough</value>
Oct 20 01:58:28 user nova-compute[74242]:         <value>emulator</value>
Oct 20 01:58:28 user nova-compute[74242]:       </enum>
Oct 20 01:58:28 user nova-compute[74242]:     </tpm>
Oct 20 01:58:28 user nova-compute[74242]:   </devices>
Oct 20 01:58:28 user nova-compute[74242]:   <features>
Oct 20 01:58:28 user nova-compute[74242]:     <gic supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:     <vmcoreinfo supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <genid supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backingStoreInput supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <backup supported='yes'/>
Oct 20 01:58:28 user nova-compute[74242]:     <sev supported='no'/>
Oct 20 01:58:28 user nova-compute[74242]:   </features>
Oct 20 01:58:28 user nova-compute[74242]: </domainCapabilities>
Oct 20 01:58:28 user nova-compute[74242]:  {{(pid=74242) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74242) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74242) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Checking secure boot support for host arch (x86_64) {{(pid=74242) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Checking secure boot support for host arch (x86_64) {{(pid=74242) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Checking secure boot support for host arch (x86_64) {{(pid=74242) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Checking secure boot support for host arch (x86_64) {{(pid=74242) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Checking secure boot support for host arch (x86_64) {{(pid=74242) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 20 01:58:28 user nova-compute[74242]: INFO nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Secure Boot support detected
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] cpu compare xml: <cpu match="exact">
Oct 20 01:58:28 user nova-compute[74242]:   <model>Nehalem</model>
Oct 20 01:58:28 user nova-compute[74242]: </cpu>
Oct 20 01:58:28 user nova-compute[74242]:  {{(pid=74242) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 20 01:58:28 user nova-compute[74242]: INFO nova.virt.node [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Generated node identity 07b40460-b6ac-48c1-8447-e1778d50b26e
Oct 20 01:58:28 user nova-compute[74242]: INFO nova.virt.node [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Wrote node identity 07b40460-b6ac-48c1-8447-e1778d50b26e to /opt/stack/data/nova/compute_id
Oct 20 01:58:28 user nova-compute[74242]: WARNING nova.compute.manager [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Compute nodes ['07b40460-b6ac-48c1-8447-e1778d50b26e'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 20 01:58:28 user nova-compute[74242]: INFO nova.compute.manager [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 20 01:58:28 user nova-compute[74242]: WARNING nova.compute.manager [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 20 01:58:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 01:58:28 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 01:58:28 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Hypervisor/Node resource view: name=user free_ram=10936MB free_disk=26.06018829345703GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 01:58:28 user nova-compute[74242]: WARNING nova.compute.resource_tracker [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] No compute node record for user:07b40460-b6ac-48c1-8447-e1778d50b26e: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 07b40460-b6ac-48c1-8447-e1778d50b26e could not be found.
Oct 20 01:58:28 user nova-compute[74242]: INFO nova.compute.resource_tracker [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Compute node record created for user:user with uuid: 07b40460-b6ac-48c1-8447-e1778d50b26e
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 01:58:28 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 01:58:29 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] [req-651185f0-a734-4bda-91bf-b13286f90822] Created resource provider record via placement API for resource provider with UUID 07b40460-b6ac-48c1-8447-e1778d50b26e and name user.
Oct 20 01:58:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74242) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 20 01:58:29 user nova-compute[74242]: INFO nova.virt.libvirt.host [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] kernel doesn't support AMD SEV
Oct 20 01:58:29 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Updating inventory in ProviderTree for provider 07b40460-b6ac-48c1-8447-e1778d50b26e with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 01:58:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 01:58:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Libvirt baseline CPU <cpu>
Oct 20 01:58:29 user nova-compute[74242]:   <arch>x86_64</arch>
Oct 20 01:58:29 user nova-compute[74242]:   <model>Nehalem</model>
Oct 20 01:58:29 user nova-compute[74242]:   <vendor>Intel</vendor>
Oct 20 01:58:29 user nova-compute[74242]:   <topology sockets="6" cores="1" threads="1"/>
Oct 20 01:58:29 user nova-compute[74242]: </cpu>
Oct 20 01:58:29 user nova-compute[74242]:  {{(pid=74242) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 20 01:58:29 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Updated inventory for provider 07b40460-b6ac-48c1-8447-e1778d50b26e with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 20 01:58:29 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Updating resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e generation from 0 to 1 during operation: update_inventory {{(pid=74242) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 01:58:29 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Updating inventory in ProviderTree for provider 07b40460-b6ac-48c1-8447-e1778d50b26e with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 01:58:29 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Updating resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e generation from 1 to 2 during operation: update_traits {{(pid=74242) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 20 01:58:29 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 01:58:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.606s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 01:58:29 user nova-compute[74242]: DEBUG nova.service [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Creating RPC server for service compute {{(pid=74242) start /opt/stack/nova/nova/service.py:182}}
Oct 20 01:58:29 user nova-compute[74242]: DEBUG nova.service [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] Join ServiceGroup membership for this service compute {{(pid=74242) start /opt/stack/nova/nova/service.py:199}}
Oct 20 01:58:29 user nova-compute[74242]: DEBUG nova.servicegroup.drivers.db [None req-a11aa446-3bf6-471a-bb61-fdd2e72c858e None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74242) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Didn't find any instances for network info cache update. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 01:59:20 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 01:59:20 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 01:59:20 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=10375MB free_disk=25.963916778564453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 01:59:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:00:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:00:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:00:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:00:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:00:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Didn't find any instances for network info cache update. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 02:00:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:00:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:00:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:00:21 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:00:21 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:00:21 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:00:22 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:00:22 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:00:22 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:00:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:00:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:00:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:00:22 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:00:22 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:00:22 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:00:22 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=10283MB free_disk=26.027912139892578GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:00:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:00:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:00:22 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:00:22 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:00:22 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:00:22 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:00:22 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:00:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.100s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:01:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:01:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:01:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:01:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Didn't find any instances for network info cache update. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 02:01:21 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:01:21 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:01:21 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:01:22 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:01:22 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:01:22 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=10301MB free_disk=25.781646728515625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:01:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:01:23 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:01:24 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:02:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:02:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:02:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:02:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Didn't find any instances for network info cache update. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 02:02:22 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:02:22 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:02:23 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:02:23 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:02:23 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=9590MB free_disk=25.801738739013672GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:02:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:24 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:02:24 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:02:25 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:02:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:26 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:02:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:26 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:02:26 user nova-compute[74242]: INFO nova.compute.claims [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Claim successful on node user
Oct 20 02:02:26 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:02:26 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:02:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.714s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:02:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:02:27 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:02:27 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:02:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:02:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:02:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:02:27 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Creating image(s)
Oct 20 02:02:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "/opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "/opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "/opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8.part --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:28 user nova-compute[74242]: DEBUG nova.policy [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fee6d4bd2fe04600a6962eeca70b0645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8561fb233b4571a47c188a1d9555dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:02:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:28 user nova-compute[74242]: DEBUG nova.virt.images [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] 1ba817e4-0454-4c11-9ff7-3af381824874 was qcow2, converting to raw {{(pid=74242) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 02:02:28 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:02:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8.part /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8.converted {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8.part /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8.converted" returned: 0 in 0.207s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8.converted --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8.converted --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.469s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:28 user nova-compute[74242]: INFO oslo.privsep.daemon [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpmb180gbv/privsep.sock']
Oct 20 02:02:28 user sudo[83485]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpmb180gbv/privsep.sock
Oct 20 02:02:28 user sudo[83485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 02:02:30 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Successfully created port: b98a0d98-dfbf-4307-a04b-23d585652343 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:02:30 user sudo[83485]: pam_unix(sudo:session): session closed for user root
Oct 20 02:02:30 user nova-compute[74242]: INFO oslo.privsep.daemon [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Spawned new privsep daemon via rootwrap
Oct 20 02:02:30 user nova-compute[74242]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 02:02:30 user nova-compute[74242]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 02:02:30 user nova-compute[74242]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 20 02:02:30 user nova-compute[74242]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83494
Oct 20 02:02:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:02:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.216s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:30 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:02:30 user nova-compute[74242]: INFO nova.compute.claims [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Claim successful on node user
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk 1073741824" returned: 0 in 0.041s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.170s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:02:31 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:02:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Cannot resize image /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Ensure instance console log exists: /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:02:31 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Creating image(s)
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "/opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "/opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "/opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.164s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG nova.policy [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3d6645596e24f24a216d2b4e7809073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a2695b5ad341e0afd133522f680bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.227s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk 1073741824" returned: 0 in 0.058s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.163s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Cannot resize image /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Ensure instance console log exists: /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Acquiring lock "b07619e3-0e20-4514-ba34-0340d72cfb54" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:02:32 user nova-compute[74242]: INFO nova.compute.claims [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Claim successful on node user
Oct 20 02:02:33 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:02:33 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:02:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:02:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:02:33 user nova-compute[74242]: DEBUG nova.network.neutron [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:02:33 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:02:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:02:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:02:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:02:33 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Creating image(s)
Oct 20 02:02:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Acquiring lock "/opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "/opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "/opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:33 user nova-compute[74242]: DEBUG nova.policy [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '20389ce0a8a945a081f4edaceff1952b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c21e1a86f7164259a0ebf3d7a0972e2c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:02:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.218s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Successfully updated port: b98a0d98-dfbf-4307-a04b-23d585652343 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "refresh_cache-af9f3d52-79f0-4ce0-9b14-3373b30c2b26" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquired lock "refresh_cache-af9f3d52-79f0-4ce0-9b14-3373b30c2b26" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.167s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk 1073741824" returned: 0 in 0.039s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.210s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.193s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-cde72b91-0fb0-45c1-a4c8-dff828cebf5c req-cf3c77ff-fffb-4b5c-ab8e-d207b31703fa service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Received event network-changed-b98a0d98-dfbf-4307-a04b-23d585652343 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-cde72b91-0fb0-45c1-a4c8-dff828cebf5c req-cf3c77ff-fffb-4b5c-ab8e-d207b31703fa service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Refreshing instance network info cache due to event network-changed-b98a0d98-dfbf-4307-a04b-23d585652343. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cde72b91-0fb0-45c1-a4c8-dff828cebf5c req-cf3c77ff-fffb-4b5c-ab8e-d207b31703fa service nova] Acquiring lock "refresh_cache-af9f3d52-79f0-4ce0-9b14-3373b30c2b26" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG nova.network.neutron [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Successfully created port: daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Cannot resize image /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Ensure instance console log exists: /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Updating instance_info_cache with network_info: [{"id": "b98a0d98-dfbf-4307-a04b-23d585652343", "address": "fa:16:3e:83:01:9b", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a0d98-df", "ovs_interfaceid": "b98a0d98-dfbf-4307-a04b-23d585652343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Releasing lock "refresh_cache-af9f3d52-79f0-4ce0-9b14-3373b30c2b26" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Instance network_info: |[{"id": "b98a0d98-dfbf-4307-a04b-23d585652343", "address": "fa:16:3e:83:01:9b", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a0d98-df", "ovs_interfaceid": "b98a0d98-dfbf-4307-a04b-23d585652343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cde72b91-0fb0-45c1-a4c8-dff828cebf5c req-cf3c77ff-fffb-4b5c-ab8e-d207b31703fa service nova] Acquired lock "refresh_cache-af9f3d52-79f0-4ce0-9b14-3373b30c2b26" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG nova.network.neutron [req-cde72b91-0fb0-45c1-a4c8-dff828cebf5c req-cf3c77ff-fffb-4b5c-ab8e-d207b31703fa service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Refreshing network info cache for port b98a0d98-dfbf-4307-a04b-23d585652343 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:02:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Start _get_guest_xml network_info=[{"id": "b98a0d98-dfbf-4307-a04b-23d585652343", "address": "fa:16:3e:83:01:9b", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a0d98-df", "ovs_interfaceid": "b98a0d98-dfbf-4307-a04b-23d585652343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:02:35 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:02:35 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-263833210',display_name='tempest-ServersNegativeTestJSON-server-263833210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-263833210',id=1,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a8561fb233b4571a47c188a1d9555dc',ramdisk_id='',reservation_id='r-npoqb0x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-873263142',owner_user_name='tempest-ServersNegativeTestJSON-873263142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:02:27Z,user_data=None,user_id='fee6d4bd2fe04600a6962eeca70b0645',uuid=af9f3d52-79f0-4ce0-9b14-3373b30c2b26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b98a0d98-dfbf-4307-a04b-23d585652343", "address": "fa:16:3e:83:01:9b", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a0d98-df", "ovs_interfaceid": "b98a0d98-dfbf-4307-a04b-23d585652343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Converting VIF {"id": "b98a0d98-dfbf-4307-a04b-23d585652343", "address": "fa:16:3e:83:01:9b", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a0d98-df", "ovs_interfaceid": "b98a0d98-dfbf-4307-a04b-23d585652343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:01:9b,bridge_name='br-int',has_traffic_filtering=True,id=b98a0d98-dfbf-4307-a04b-23d585652343,network=Network(1b405f0d-8443-4073-9a46-631015e6ac57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98a0d98-df') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lazy-loading 'pci_devices' on Instance uuid af9f3d52-79f0-4ce0-9b14-3373b30c2b26 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:02:35 user nova-compute[74242]:   <uuid>af9f3d52-79f0-4ce0-9b14-3373b30c2b26</uuid>
Oct 20 02:02:35 user nova-compute[74242]:   <name>instance-00000001</name>
Oct 20 02:02:35 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:02:35 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:02:35 user nova-compute[74242]:   <metadata>
Oct 20 02:02:35 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:02:35 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:02:35 user nova-compute[74242]:       <nova:name>tempest-ServersNegativeTestJSON-server-263833210</nova:name>
Oct 20 02:02:35 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:02:35</nova:creationTime>
Oct 20 02:02:35 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:02:35 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:02:35 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:02:35 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:02:35 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:02:35 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:02:35 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:02:35 user nova-compute[74242]:       <nova:owner>
Oct 20 02:02:35 user nova-compute[74242]:         <nova:user uuid="fee6d4bd2fe04600a6962eeca70b0645">tempest-ServersNegativeTestJSON-873263142-project-member</nova:user>
Oct 20 02:02:35 user nova-compute[74242]:         <nova:project uuid="5a8561fb233b4571a47c188a1d9555dc">tempest-ServersNegativeTestJSON-873263142</nova:project>
Oct 20 02:02:35 user nova-compute[74242]:       </nova:owner>
Oct 20 02:02:35 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:02:35 user nova-compute[74242]:       <nova:ports>
Oct 20 02:02:35 user nova-compute[74242]:         <nova:port uuid="b98a0d98-dfbf-4307-a04b-23d585652343">
Oct 20 02:02:35 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 02:02:35 user nova-compute[74242]:         </nova:port>
Oct 20 02:02:35 user nova-compute[74242]:       </nova:ports>
Oct 20 02:02:35 user nova-compute[74242]:     </nova:instance>
Oct 20 02:02:35 user nova-compute[74242]:   </metadata>
Oct 20 02:02:35 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:02:35 user nova-compute[74242]:     <system>
Oct 20 02:02:35 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:02:35 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:02:35 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:02:35 user nova-compute[74242]:       <entry name="serial">af9f3d52-79f0-4ce0-9b14-3373b30c2b26</entry>
Oct 20 02:02:35 user nova-compute[74242]:       <entry name="uuid">af9f3d52-79f0-4ce0-9b14-3373b30c2b26</entry>
Oct 20 02:02:35 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:02:35 user nova-compute[74242]:     </system>
Oct 20 02:02:35 user nova-compute[74242]:   </sysinfo>
Oct 20 02:02:35 user nova-compute[74242]:   <os>
Oct 20 02:02:35 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:02:35 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:02:35 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:02:35 user nova-compute[74242]:   </os>
Oct 20 02:02:35 user nova-compute[74242]:   <features>
Oct 20 02:02:35 user nova-compute[74242]:     <acpi/>
Oct 20 02:02:35 user nova-compute[74242]:     <apic/>
Oct 20 02:02:35 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:02:35 user nova-compute[74242]:   </features>
Oct 20 02:02:35 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:02:35 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:02:35 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:02:35 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:02:35 user nova-compute[74242]:   </clock>
Oct 20 02:02:35 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:02:35 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:02:35 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:02:35 user nova-compute[74242]:   </cpu>
Oct 20 02:02:35 user nova-compute[74242]:   <devices>
Oct 20 02:02:35 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:02:35 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:02:35 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk"/>
Oct 20 02:02:35 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:02:35 user nova-compute[74242]:     </disk>
Oct 20 02:02:35 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:02:35 user nova-compute[74242]:       <mac address="fa:16:3e:83:01:9b"/>
Oct 20 02:02:35 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:02:35 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:02:35 user nova-compute[74242]:       <target dev="tapb98a0d98-df"/>
Oct 20 02:02:35 user nova-compute[74242]:     </interface>
Oct 20 02:02:35 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:02:35 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/console.log" append="off"/>
Oct 20 02:02:35 user nova-compute[74242]:     </serial>
Oct 20 02:02:35 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:02:35 user nova-compute[74242]:     <video>
Oct 20 02:02:35 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:02:35 user nova-compute[74242]:     </video>
Oct 20 02:02:35 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:02:35 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:02:35 user nova-compute[74242]:     </rng>
Oct 20 02:02:35 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:02:35 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:02:35 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:02:35 user nova-compute[74242]:     </memballoon>
Oct 20 02:02:35 user nova-compute[74242]:   </devices>
Oct 20 02:02:35 user nova-compute[74242]: </domain>
Oct 20 02:02:35 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-263833210',display_name='tempest-ServersNegativeTestJSON-server-263833210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-263833210',id=1,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a8561fb233b4571a47c188a1d9555dc',ramdisk_id='',reservation_id='r-npoqb0x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-873263142',owner_user_name='tempest-ServersNegativeTestJSON-873263142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:02:27Z,user_data=None,user_id='fee6d4bd2fe04600a6962eeca70b0645',uuid=af9f3d52-79f0-4ce0-9b14-3373b30c2b26,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b98a0d98-dfbf-4307-a04b-23d585652343", "address": "fa:16:3e:83:01:9b", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a0d98-df", "ovs_interfaceid": "b98a0d98-dfbf-4307-a04b-23d585652343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Converting VIF {"id": "b98a0d98-dfbf-4307-a04b-23d585652343", "address": "fa:16:3e:83:01:9b", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a0d98-df", "ovs_interfaceid": "b98a0d98-dfbf-4307-a04b-23d585652343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:01:9b,bridge_name='br-int',has_traffic_filtering=True,id=b98a0d98-dfbf-4307-a04b-23d585652343,network=Network(1b405f0d-8443-4073-9a46-631015e6ac57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98a0d98-df') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG os_vif [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:01:9b,bridge_name='br-int',has_traffic_filtering=True,id=b98a0d98-dfbf-4307-a04b-23d585652343,network=Network(1b405f0d-8443-4073-9a46-631015e6ac57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98a0d98-df') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Created schema index Interface.name {{(pid=74242) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Created schema index Port.name {{(pid=74242) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Created schema index Bridge.name {{(pid=74242) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [POLLOUT] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bfa96999-b2b2-5817-a863-f17684f20f89', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:02:35 user nova-compute[74242]: INFO oslo.privsep.daemon [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmplcj9vbnm/privsep.sock']
Oct 20 02:02:35 user sudo[83557]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmplcj9vbnm/privsep.sock
Oct 20 02:02:35 user sudo[83557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.network.neutron [req-cde72b91-0fb0-45c1-a4c8-dff828cebf5c req-cf3c77ff-fffb-4b5c-ab8e-d207b31703fa service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Updated VIF entry in instance network info cache for port b98a0d98-dfbf-4307-a04b-23d585652343. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.network.neutron [req-cde72b91-0fb0-45c1-a4c8-dff828cebf5c req-cf3c77ff-fffb-4b5c-ab8e-d207b31703fa service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Updating instance_info_cache with network_info: [{"id": "b98a0d98-dfbf-4307-a04b-23d585652343", "address": "fa:16:3e:83:01:9b", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a0d98-df", "ovs_interfaceid": "b98a0d98-dfbf-4307-a04b-23d585652343", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cde72b91-0fb0-45c1-a4c8-dff828cebf5c req-cf3c77ff-fffb-4b5c-ab8e-d207b31703fa service nova] Releasing lock "refresh_cache-af9f3d52-79f0-4ce0-9b14-3373b30c2b26" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Successfully updated port: daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquired lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Successfully created port: 08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.compute.manager [req-1bfebbb5-7d43-4f24-9486-4b8f7ddd9185 req-9cab6e76-d2c8-49ff-b1c8-422c73ea8c67 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-changed-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.compute.manager [req-1bfebbb5-7d43-4f24-9486-4b8f7ddd9185 req-9cab6e76-d2c8-49ff-b1c8-422c73ea8c67 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Refreshing instance network info cache due to event network-changed-daaa523c-866b-4afd-9e64-cd87cb820350. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1bfebbb5-7d43-4f24-9486-4b8f7ddd9185 req-9cab6e76-d2c8-49ff-b1c8-422c73ea8c67 service nova] Acquiring lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updating instance_info_cache with network_info: [{"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Releasing lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Instance network_info: |[{"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1bfebbb5-7d43-4f24-9486-4b8f7ddd9185 req-9cab6e76-d2c8-49ff-b1c8-422c73ea8c67 service nova] Acquired lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.network.neutron [req-1bfebbb5-7d43-4f24-9486-4b8f7ddd9185 req-9cab6e76-d2c8-49ff-b1c8-422c73ea8c67 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Refreshing network info cache for port daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:02:36 user sudo[83557]: pam_unix(sudo:session): session closed for user root
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Start _get_guest_xml network_info=[{"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:02:36 user nova-compute[74242]: INFO oslo.privsep.daemon [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Spawned new privsep daemon via rootwrap
Oct 20 02:02:36 user nova-compute[74242]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 02:02:36 user nova-compute[74242]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 02:02:36 user nova-compute[74242]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 20 02:02:36 user nova-compute[74242]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83562
Oct 20 02:02:36 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:02:36 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-566546331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-566546331',id=2,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLO87wbKYFm5G333AGmDldzgoH1ghPEuADrWLYYKcEP5y09FucUxX6mOkAqUfawuywqPj6azEOJhzxEJ7NSj3401RT/fEXGW0wPMsz7zTIUQkpJLtSnWyr1NkameoGYCrA==',key_name='tempest-keypair-869078676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7a2695b5ad341e0afd133522f680bf9',ramdisk_id='',reservation_id='r-0l3toedx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-750275147',owner_user_name='tempest-AttachVolumeShelveTestJSON-750275147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:02:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d6645596e24f24a216d2b4e7809073',uuid=90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converting VIF {"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=daaa523c-866b-4afd-9e64-cd87cb820350,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaaa523c-86') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.objects.instance [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'pci_devices' on Instance uuid 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:02:36 user nova-compute[74242]:   <uuid>90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36</uuid>
Oct 20 02:02:36 user nova-compute[74242]:   <name>instance-00000002</name>
Oct 20 02:02:36 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:02:36 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:02:36 user nova-compute[74242]:   <metadata>
Oct 20 02:02:36 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:02:36 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:02:36 user nova-compute[74242]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-566546331</nova:name>
Oct 20 02:02:36 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:02:36</nova:creationTime>
Oct 20 02:02:36 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:02:36 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:02:36 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:02:36 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:02:36 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:02:36 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:02:36 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:02:36 user nova-compute[74242]:       <nova:owner>
Oct 20 02:02:36 user nova-compute[74242]:         <nova:user uuid="a3d6645596e24f24a216d2b4e7809073">tempest-AttachVolumeShelveTestJSON-750275147-project-member</nova:user>
Oct 20 02:02:36 user nova-compute[74242]:         <nova:project uuid="a7a2695b5ad341e0afd133522f680bf9">tempest-AttachVolumeShelveTestJSON-750275147</nova:project>
Oct 20 02:02:36 user nova-compute[74242]:       </nova:owner>
Oct 20 02:02:36 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:02:36 user nova-compute[74242]:       <nova:ports>
Oct 20 02:02:36 user nova-compute[74242]:         <nova:port uuid="daaa523c-866b-4afd-9e64-cd87cb820350">
Oct 20 02:02:36 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 02:02:36 user nova-compute[74242]:         </nova:port>
Oct 20 02:02:36 user nova-compute[74242]:       </nova:ports>
Oct 20 02:02:36 user nova-compute[74242]:     </nova:instance>
Oct 20 02:02:36 user nova-compute[74242]:   </metadata>
Oct 20 02:02:36 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:02:36 user nova-compute[74242]:     <system>
Oct 20 02:02:36 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:02:36 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:02:36 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:02:36 user nova-compute[74242]:       <entry name="serial">90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36</entry>
Oct 20 02:02:36 user nova-compute[74242]:       <entry name="uuid">90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36</entry>
Oct 20 02:02:36 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:02:36 user nova-compute[74242]:     </system>
Oct 20 02:02:36 user nova-compute[74242]:   </sysinfo>
Oct 20 02:02:36 user nova-compute[74242]:   <os>
Oct 20 02:02:36 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:02:36 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:02:36 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:02:36 user nova-compute[74242]:   </os>
Oct 20 02:02:36 user nova-compute[74242]:   <features>
Oct 20 02:02:36 user nova-compute[74242]:     <acpi/>
Oct 20 02:02:36 user nova-compute[74242]:     <apic/>
Oct 20 02:02:36 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:02:36 user nova-compute[74242]:   </features>
Oct 20 02:02:36 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:02:36 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:02:36 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:02:36 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:02:36 user nova-compute[74242]:   </clock>
Oct 20 02:02:36 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:02:36 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:02:36 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:02:36 user nova-compute[74242]:   </cpu>
Oct 20 02:02:36 user nova-compute[74242]:   <devices>
Oct 20 02:02:36 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:02:36 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:02:36 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk"/>
Oct 20 02:02:36 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:02:36 user nova-compute[74242]:     </disk>
Oct 20 02:02:36 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:02:36 user nova-compute[74242]:       <mac address="fa:16:3e:0b:d9:3e"/>
Oct 20 02:02:36 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:02:36 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:02:36 user nova-compute[74242]:       <target dev="tapdaaa523c-86"/>
Oct 20 02:02:36 user nova-compute[74242]:     </interface>
Oct 20 02:02:36 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:02:36 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/console.log" append="off"/>
Oct 20 02:02:36 user nova-compute[74242]:     </serial>
Oct 20 02:02:36 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:02:36 user nova-compute[74242]:     <video>
Oct 20 02:02:36 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:02:36 user nova-compute[74242]:     </video>
Oct 20 02:02:36 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:02:36 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:02:36 user nova-compute[74242]:     </rng>
Oct 20 02:02:36 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:02:36 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:02:36 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:02:36 user nova-compute[74242]:     </memballoon>
Oct 20 02:02:36 user nova-compute[74242]:   </devices>
Oct 20 02:02:36 user nova-compute[74242]: </domain>
Oct 20 02:02:36 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-566546331',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-566546331',id=2,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLO87wbKYFm5G333AGmDldzgoH1ghPEuADrWLYYKcEP5y09FucUxX6mOkAqUfawuywqPj6azEOJhzxEJ7NSj3401RT/fEXGW0wPMsz7zTIUQkpJLtSnWyr1NkameoGYCrA==',key_name='tempest-keypair-869078676',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7a2695b5ad341e0afd133522f680bf9',ramdisk_id='',reservation_id='r-0l3toedx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-750275147',owner_user_name='tempest-AttachVolumeShelveTestJSON-750275147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:02:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d6645596e24f24a216d2b4e7809073',uuid=90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converting VIF {"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=daaa523c-866b-4afd-9e64-cd87cb820350,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaaa523c-86') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG os_vif [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=daaa523c-866b-4afd-9e64-cd87cb820350,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaaa523c-86') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab94ebc7-4152-5d54-9c79-ddea077da419', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaaa523c-86, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdaaa523c-86, col_values=(('qos', UUID('97c198ba-097b-4ed8-a1ef-e73811c09d75')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdaaa523c-86, col_values=(('external_ids', {'iface-id': 'daaa523c-866b-4afd-9e64-cd87cb820350', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:d9:3e', 'vm-uuid': '90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:37 user nova-compute[74242]: INFO os_vif [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=daaa523c-866b-4afd-9e64-cd87cb820350,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaaa523c-86')
Oct 20 02:02:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb98a0d98-df, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb98a0d98-df, col_values=(('qos', UUID('d1c8cffb-6b78-4b7f-884a-c4d97efdf97d')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb98a0d98-df, col_values=(('external_ids', {'iface-id': 'b98a0d98-dfbf-4307-a04b-23d585652343', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:01:9b', 'vm-uuid': 'af9f3d52-79f0-4ce0-9b14-3373b30c2b26'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:37 user nova-compute[74242]: INFO os_vif [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:01:9b,bridge_name='br-int',has_traffic_filtering=True,id=b98a0d98-dfbf-4307-a04b-23d585652343,network=Network(1b405f0d-8443-4073-9a46-631015e6ac57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98a0d98-df')
Oct 20 02:02:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] No VIF found with MAC fa:16:3e:0b:d9:3e, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] No VIF found with MAC fa:16:3e:83:01:9b, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG nova.network.neutron [req-1bfebbb5-7d43-4f24-9486-4b8f7ddd9185 req-9cab6e76-d2c8-49ff-b1c8-422c73ea8c67 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updated VIF entry in instance network info cache for port daaa523c-866b-4afd-9e64-cd87cb820350. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG nova.network.neutron [req-1bfebbb5-7d43-4f24-9486-4b8f7ddd9185 req-9cab6e76-d2c8-49ff-b1c8-422c73ea8c67 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updating instance_info_cache with network_info: [{"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:02:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1bfebbb5-7d43-4f24-9486-4b8f7ddd9185 req-9cab6e76-d2c8-49ff-b1c8-422c73ea8c67 service nova] Releasing lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:02:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:38 user nova-compute[74242]: DEBUG nova.network.neutron [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Successfully updated port: 08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:02:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Acquiring lock "refresh_cache-b07619e3-0e20-4514-ba34-0340d72cfb54" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:02:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Acquired lock "refresh_cache-b07619e3-0e20-4514-ba34-0340d72cfb54" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:02:38 user nova-compute[74242]: DEBUG nova.network.neutron [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "0636ce59-3cfb-4959-bb28-bce8f4c30043" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG nova.network.neutron [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:02:39 user nova-compute[74242]: INFO nova.compute.claims [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Claim successful on node user
Oct 20 02:02:39 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG nova.network.neutron [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:39 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:02:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG nova.policy [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1f488a444de49f5bed5351efd55dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9b187fe8443aba57a8c629d78978e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-27e78a10-495e-4eb8-affe-fe75a57520d1 req-53409087-34a2-4bf4-b61b-18b8d4eb4a80 service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received event network-changed-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-27e78a10-495e-4eb8-affe-fe75a57520d1 req-53409087-34a2-4bf4-b61b-18b8d4eb4a80 service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Refreshing instance network info cache due to event network-changed-08118957-0151-44ee-af21-90f8606ec13b. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-27e78a10-495e-4eb8-affe-fe75a57520d1 req-53409087-34a2-4bf4-b61b-18b8d4eb4a80 service nova] Acquiring lock "refresh_cache-b07619e3-0e20-4514-ba34-0340d72cfb54" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:02:39 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Creating image(s)
Oct 20 02:02:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "/opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "/opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "/opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.188s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.236s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk 1073741824" returned: 0 in 0.048s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.network.neutron [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Updating instance_info_cache with network_info: [{"id": "08118957-0151-44ee-af21-90f8606ec13b", "address": "fa:16:3e:d1:6f:54", "network": {"id": "688318e2-607f-48b5-b4f9-a504a17dc4f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1513569583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c21e1a86f7164259a0ebf3d7a0972e2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08118957-01", "ovs_interfaceid": "08118957-0151-44ee-af21-90f8606ec13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Releasing lock "refresh_cache-b07619e3-0e20-4514-ba34-0340d72cfb54" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Instance network_info: |[{"id": "08118957-0151-44ee-af21-90f8606ec13b", "address": "fa:16:3e:d1:6f:54", "network": {"id": "688318e2-607f-48b5-b4f9-a504a17dc4f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1513569583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c21e1a86f7164259a0ebf3d7a0972e2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08118957-01", "ovs_interfaceid": "08118957-0151-44ee-af21-90f8606ec13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-27e78a10-495e-4eb8-affe-fe75a57520d1 req-53409087-34a2-4bf4-b61b-18b8d4eb4a80 service nova] Acquired lock "refresh_cache-b07619e3-0e20-4514-ba34-0340d72cfb54" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.network.neutron [req-27e78a10-495e-4eb8-affe-fe75a57520d1 req-53409087-34a2-4bf4-b61b-18b8d4eb4a80 service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Refreshing network info cache for port 08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Start _get_guest_xml network_info=[{"id": "08118957-0151-44ee-af21-90f8606ec13b", "address": "fa:16:3e:d1:6f:54", "network": {"id": "688318e2-607f-48b5-b4f9-a504a17dc4f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1513569583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c21e1a86f7164259a0ebf3d7a0972e2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08118957-01", "ovs_interfaceid": "08118957-0151-44ee-af21-90f8606ec13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:02:40 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:02:40 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1977573758',display_name='tempest-DeleteServersTestJSON-server-1977573758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1977573758',id=3,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c21e1a86f7164259a0ebf3d7a0972e2c',ramdisk_id='',reservation_id='r-2qoqsixx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-374068335',owner_user_name='tempest-DeleteServersTestJSON-374068335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:02:34Z,user_data=None,user_id='20389ce0a8a945a081f4edaceff1952b',uuid=b07619e3-0e20-4514-ba34-0340d72cfb54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08118957-0151-44ee-af21-90f8606ec13b", "address": "fa:16:3e:d1:6f:54", "network": {"id": "688318e2-607f-48b5-b4f9-a504a17dc4f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1513569583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c21e1a86f7164259a0ebf3d7a0972e2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08118957-01", "ovs_interfaceid": "08118957-0151-44ee-af21-90f8606ec13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Converting VIF {"id": "08118957-0151-44ee-af21-90f8606ec13b", "address": "fa:16:3e:d1:6f:54", "network": {"id": "688318e2-607f-48b5-b4f9-a504a17dc4f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1513569583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c21e1a86f7164259a0ebf3d7a0972e2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08118957-01", "ovs_interfaceid": "08118957-0151-44ee-af21-90f8606ec13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:6f:54,bridge_name='br-int',has_traffic_filtering=True,id=08118957-0151-44ee-af21-90f8606ec13b,network=Network(688318e2-607f-48b5-b4f9-a504a17dc4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08118957-01') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.objects.instance [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lazy-loading 'pci_devices' on Instance uuid b07619e3-0e20-4514-ba34-0340d72cfb54 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.232s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:02:40 user nova-compute[74242]:   <uuid>b07619e3-0e20-4514-ba34-0340d72cfb54</uuid>
Oct 20 02:02:40 user nova-compute[74242]:   <name>instance-00000003</name>
Oct 20 02:02:40 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:02:40 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:02:40 user nova-compute[74242]:   <metadata>
Oct 20 02:02:40 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:02:40 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:02:40 user nova-compute[74242]:       <nova:name>tempest-DeleteServersTestJSON-server-1977573758</nova:name>
Oct 20 02:02:40 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:02:40</nova:creationTime>
Oct 20 02:02:40 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:02:40 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:02:40 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:02:40 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:02:40 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:02:40 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:02:40 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:02:40 user nova-compute[74242]:       <nova:owner>
Oct 20 02:02:40 user nova-compute[74242]:         <nova:user uuid="20389ce0a8a945a081f4edaceff1952b">tempest-DeleteServersTestJSON-374068335-project-member</nova:user>
Oct 20 02:02:40 user nova-compute[74242]:         <nova:project uuid="c21e1a86f7164259a0ebf3d7a0972e2c">tempest-DeleteServersTestJSON-374068335</nova:project>
Oct 20 02:02:40 user nova-compute[74242]:       </nova:owner>
Oct 20 02:02:40 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:02:40 user nova-compute[74242]:       <nova:ports>
Oct 20 02:02:40 user nova-compute[74242]:         <nova:port uuid="08118957-0151-44ee-af21-90f8606ec13b">
Oct 20 02:02:40 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 02:02:40 user nova-compute[74242]:         </nova:port>
Oct 20 02:02:40 user nova-compute[74242]:       </nova:ports>
Oct 20 02:02:40 user nova-compute[74242]:     </nova:instance>
Oct 20 02:02:40 user nova-compute[74242]:   </metadata>
Oct 20 02:02:40 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:02:40 user nova-compute[74242]:     <system>
Oct 20 02:02:40 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:02:40 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:02:40 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:02:40 user nova-compute[74242]:       <entry name="serial">b07619e3-0e20-4514-ba34-0340d72cfb54</entry>
Oct 20 02:02:40 user nova-compute[74242]:       <entry name="uuid">b07619e3-0e20-4514-ba34-0340d72cfb54</entry>
Oct 20 02:02:40 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:02:40 user nova-compute[74242]:     </system>
Oct 20 02:02:40 user nova-compute[74242]:   </sysinfo>
Oct 20 02:02:40 user nova-compute[74242]:   <os>
Oct 20 02:02:40 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:02:40 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:02:40 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:02:40 user nova-compute[74242]:   </os>
Oct 20 02:02:40 user nova-compute[74242]:   <features>
Oct 20 02:02:40 user nova-compute[74242]:     <acpi/>
Oct 20 02:02:40 user nova-compute[74242]:     <apic/>
Oct 20 02:02:40 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:02:40 user nova-compute[74242]:   </features>
Oct 20 02:02:40 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:02:40 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:02:40 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:02:40 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:02:40 user nova-compute[74242]:   </clock>
Oct 20 02:02:40 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:02:40 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:02:40 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:02:40 user nova-compute[74242]:   </cpu>
Oct 20 02:02:40 user nova-compute[74242]:   <devices>
Oct 20 02:02:40 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:02:40 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:02:40 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk"/>
Oct 20 02:02:40 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:02:40 user nova-compute[74242]:     </disk>
Oct 20 02:02:40 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:02:40 user nova-compute[74242]:       <mac address="fa:16:3e:d1:6f:54"/>
Oct 20 02:02:40 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:02:40 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:02:40 user nova-compute[74242]:       <target dev="tap08118957-01"/>
Oct 20 02:02:40 user nova-compute[74242]:     </interface>
Oct 20 02:02:40 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:02:40 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/console.log" append="off"/>
Oct 20 02:02:40 user nova-compute[74242]:     </serial>
Oct 20 02:02:40 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:02:40 user nova-compute[74242]:     <video>
Oct 20 02:02:40 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:02:40 user nova-compute[74242]:     </video>
Oct 20 02:02:40 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:02:40 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:02:40 user nova-compute[74242]:     </rng>
Oct 20 02:02:40 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:02:40 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:02:40 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:02:40 user nova-compute[74242]:     </memballoon>
Oct 20 02:02:40 user nova-compute[74242]:   </devices>
Oct 20 02:02:40 user nova-compute[74242]: </domain>
Oct 20 02:02:40 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1977573758',display_name='tempest-DeleteServersTestJSON-server-1977573758',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1977573758',id=3,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c21e1a86f7164259a0ebf3d7a0972e2c',ramdisk_id='',reservation_id='r-2qoqsixx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-374068335',owner_user_name='tempest-DeleteServersTestJSON-374068335-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:02:34Z,user_data=None,user_id='20389ce0a8a945a081f4edaceff1952b',uuid=b07619e3-0e20-4514-ba34-0340d72cfb54,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08118957-0151-44ee-af21-90f8606ec13b", "address": "fa:16:3e:d1:6f:54", "network": {"id": "688318e2-607f-48b5-b4f9-a504a17dc4f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1513569583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c21e1a86f7164259a0ebf3d7a0972e2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08118957-01", "ovs_interfaceid": "08118957-0151-44ee-af21-90f8606ec13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Converting VIF {"id": "08118957-0151-44ee-af21-90f8606ec13b", "address": "fa:16:3e:d1:6f:54", "network": {"id": "688318e2-607f-48b5-b4f9-a504a17dc4f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1513569583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c21e1a86f7164259a0ebf3d7a0972e2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08118957-01", "ovs_interfaceid": "08118957-0151-44ee-af21-90f8606ec13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:6f:54,bridge_name='br-int',has_traffic_filtering=True,id=08118957-0151-44ee-af21-90f8606ec13b,network=Network(688318e2-607f-48b5-b4f9-a504a17dc4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08118957-01') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG os_vif [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:6f:54,bridge_name='br-int',has_traffic_filtering=True,id=08118957-0151-44ee-af21-90f8606ec13b,network=Network(688318e2-607f-48b5-b4f9-a504a17dc4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08118957-01') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd20e990c-2333-50a3-935d-bf85151a05e3', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08118957-01, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08118957-01, col_values=(('qos', UUID('d13c0c3c-fabc-4099-85c5-77c1185ca6fb')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08118957-01, col_values=(('external_ids', {'iface-id': '08118957-0151-44ee-af21-90f8606ec13b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:6f:54', 'vm-uuid': 'b07619e3-0e20-4514-ba34-0340d72cfb54'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:02:40 user nova-compute[74242]: INFO os_vif [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:6f:54,bridge_name='br-int',has_traffic_filtering=True,id=08118957-0151-44ee-af21-90f8606ec13b,network=Network(688318e2-607f-48b5-b4f9-a504a17dc4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08118957-01')
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] No VIF found with MAC fa:16:3e:d1:6f:54, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Cannot resize image /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Ensure instance console log exists: /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:41 user nova-compute[74242]: DEBUG nova.network.neutron [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Successfully created port: 4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.network.neutron [req-27e78a10-495e-4eb8-affe-fe75a57520d1 req-53409087-34a2-4bf4-b61b-18b8d4eb4a80 service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Updated VIF entry in instance network info cache for port 08118957-0151-44ee-af21-90f8606ec13b. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.network.neutron [req-27e78a10-495e-4eb8-affe-fe75a57520d1 req-53409087-34a2-4bf4-b61b-18b8d4eb4a80 service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Updating instance_info_cache with network_info: [{"id": "08118957-0151-44ee-af21-90f8606ec13b", "address": "fa:16:3e:d1:6f:54", "network": {"id": "688318e2-607f-48b5-b4f9-a504a17dc4f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1513569583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c21e1a86f7164259a0ebf3d7a0972e2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08118957-01", "ovs_interfaceid": "08118957-0151-44ee-af21-90f8606ec13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:02:42 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Instance spawned successfully.
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-27e78a10-495e-4eb8-affe-fe75a57520d1 req-53409087-34a2-4bf4-b61b-18b8d4eb4a80 service nova] Releasing lock "refresh_cache-b07619e3-0e20-4514-ba34-0340d72cfb54" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:42 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Instance spawned successfully.
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:42 user nova-compute[74242]: INFO nova.compute.manager [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Took 10.75 seconds to spawn the instance on the hypervisor.
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:02:42 user nova-compute[74242]: INFO nova.compute.manager [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Took 14.98 seconds to spawn the instance on the hypervisor.
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.network.neutron [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Successfully updated port: 4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquired lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.network.neutron [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:02:42 user nova-compute[74242]: INFO nova.compute.manager [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Took 11.64 seconds to build instance.
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-746ff520-3cb4-4de5-9b2d-1ac2f54f9803 req-5510544c-3d32-430e-ad2d-59f4c2891097 service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Received event network-changed-4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-746ff520-3cb4-4de5-9b2d-1ac2f54f9803 req-5510544c-3d32-430e-ad2d-59f4c2891097 service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Refreshing instance network info cache due to event network-changed-4e64f25c-d50c-4c69-950d-1bccc487367c. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-746ff520-3cb4-4de5-9b2d-1ac2f54f9803 req-5510544c-3d32-430e-ad2d-59f4c2891097 service nova] Acquiring lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG nova.network.neutron [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:02:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d5b932d2-29a5-42bd-9a9d-53a6d4775a1d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.961s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:42 user nova-compute[74242]: INFO nova.compute.manager [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Took 16.39 seconds to build instance.
Oct 20 02:02:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b765920-5a3e-4bc8-9b4d-84467d764021 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.600s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.network.neutron [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updating instance_info_cache with network_info: [{"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Releasing lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.compute.manager [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Instance network_info: |[{"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-746ff520-3cb4-4de5-9b2d-1ac2f54f9803 req-5510544c-3d32-430e-ad2d-59f4c2891097 service nova] Acquired lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.network.neutron [req-746ff520-3cb4-4de5-9b2d-1ac2f54f9803 req-5510544c-3d32-430e-ad2d-59f4c2891097 service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Refreshing network info cache for port 4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Start _get_guest_xml network_info=[{"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:02:43 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:02:43 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1417949016',display_name='tempest-ServerActionsTestOtherA-server-1417949016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1417949016',id=4,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB7bL+2x0x/JgolwV73wEpn90TfE93HD11kN8fWTUdskLHr/+qGh8YX2pmWaISRSrg9SBRQDQmulufko6eTLMYIA5vcJ4clYCIWnNXj2Hp2S/9mOnMK73v45XTwiydUrQ==',key_name='tempest-keypair-1706623376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cf9b187fe8443aba57a8c629d78978e',ramdisk_id='',reservation_id='r-mby22fes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2076229102',owner_user_name='tempest-ServerActionsTestOtherA-2076229102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:02:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1f488a444de49f5bed5351efd55dafa',uuid=0636ce59-3cfb-4959-bb28-bce8f4c30043,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converting VIF {"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:d4:89,bridge_name='br-int',has_traffic_filtering=True,id=4e64f25c-d50c-4c69-950d-1bccc487367c,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e64f25c-d5') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.objects.instance [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lazy-loading 'pci_devices' on Instance uuid 0636ce59-3cfb-4959-bb28-bce8f4c30043 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:02:43 user nova-compute[74242]:   <uuid>0636ce59-3cfb-4959-bb28-bce8f4c30043</uuid>
Oct 20 02:02:43 user nova-compute[74242]:   <name>instance-00000004</name>
Oct 20 02:02:43 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:02:43 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:02:43 user nova-compute[74242]:   <metadata>
Oct 20 02:02:43 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:02:43 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:02:43 user nova-compute[74242]:       <nova:name>tempest-ServerActionsTestOtherA-server-1417949016</nova:name>
Oct 20 02:02:43 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:02:43</nova:creationTime>
Oct 20 02:02:43 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:02:43 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:02:43 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:02:43 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:02:43 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:02:43 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:02:43 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:02:43 user nova-compute[74242]:       <nova:owner>
Oct 20 02:02:43 user nova-compute[74242]:         <nova:user uuid="c1f488a444de49f5bed5351efd55dafa">tempest-ServerActionsTestOtherA-2076229102-project-member</nova:user>
Oct 20 02:02:43 user nova-compute[74242]:         <nova:project uuid="5cf9b187fe8443aba57a8c629d78978e">tempest-ServerActionsTestOtherA-2076229102</nova:project>
Oct 20 02:02:43 user nova-compute[74242]:       </nova:owner>
Oct 20 02:02:43 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:02:43 user nova-compute[74242]:       <nova:ports>
Oct 20 02:02:43 user nova-compute[74242]:         <nova:port uuid="4e64f25c-d50c-4c69-950d-1bccc487367c">
Oct 20 02:02:43 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 02:02:43 user nova-compute[74242]:         </nova:port>
Oct 20 02:02:43 user nova-compute[74242]:       </nova:ports>
Oct 20 02:02:43 user nova-compute[74242]:     </nova:instance>
Oct 20 02:02:43 user nova-compute[74242]:   </metadata>
Oct 20 02:02:43 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:02:43 user nova-compute[74242]:     <system>
Oct 20 02:02:43 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:02:43 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:02:43 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:02:43 user nova-compute[74242]:       <entry name="serial">0636ce59-3cfb-4959-bb28-bce8f4c30043</entry>
Oct 20 02:02:43 user nova-compute[74242]:       <entry name="uuid">0636ce59-3cfb-4959-bb28-bce8f4c30043</entry>
Oct 20 02:02:43 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:02:43 user nova-compute[74242]:     </system>
Oct 20 02:02:43 user nova-compute[74242]:   </sysinfo>
Oct 20 02:02:43 user nova-compute[74242]:   <os>
Oct 20 02:02:43 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:02:43 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:02:43 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:02:43 user nova-compute[74242]:   </os>
Oct 20 02:02:43 user nova-compute[74242]:   <features>
Oct 20 02:02:43 user nova-compute[74242]:     <acpi/>
Oct 20 02:02:43 user nova-compute[74242]:     <apic/>
Oct 20 02:02:43 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:02:43 user nova-compute[74242]:   </features>
Oct 20 02:02:43 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:02:43 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:02:43 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:02:43 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:02:43 user nova-compute[74242]:   </clock>
Oct 20 02:02:43 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:02:43 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:02:43 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:02:43 user nova-compute[74242]:   </cpu>
Oct 20 02:02:43 user nova-compute[74242]:   <devices>
Oct 20 02:02:43 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:02:43 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:02:43 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk"/>
Oct 20 02:02:43 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:02:43 user nova-compute[74242]:     </disk>
Oct 20 02:02:43 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:02:43 user nova-compute[74242]:       <mac address="fa:16:3e:36:d4:89"/>
Oct 20 02:02:43 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:02:43 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:02:43 user nova-compute[74242]:       <target dev="tap4e64f25c-d5"/>
Oct 20 02:02:43 user nova-compute[74242]:     </interface>
Oct 20 02:02:43 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:02:43 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/console.log" append="off"/>
Oct 20 02:02:43 user nova-compute[74242]:     </serial>
Oct 20 02:02:43 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:02:43 user nova-compute[74242]:     <video>
Oct 20 02:02:43 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:02:43 user nova-compute[74242]:     </video>
Oct 20 02:02:43 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:02:43 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:02:43 user nova-compute[74242]:     </rng>
Oct 20 02:02:43 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:02:43 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:02:43 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:02:43 user nova-compute[74242]:     </memballoon>
Oct 20 02:02:43 user nova-compute[74242]:   </devices>
Oct 20 02:02:43 user nova-compute[74242]: </domain>
Oct 20 02:02:43 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1417949016',display_name='tempest-ServerActionsTestOtherA-server-1417949016',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1417949016',id=4,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB7bL+2x0x/JgolwV73wEpn90TfE93HD11kN8fWTUdskLHr/+qGh8YX2pmWaISRSrg9SBRQDQmulufko6eTLMYIA5vcJ4clYCIWnNXj2Hp2S/9mOnMK73v45XTwiydUrQ==',key_name='tempest-keypair-1706623376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cf9b187fe8443aba57a8c629d78978e',ramdisk_id='',reservation_id='r-mby22fes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2076229102',owner_user_name='tempest-ServerActionsTestOtherA-2076229102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:02:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1f488a444de49f5bed5351efd55dafa',uuid=0636ce59-3cfb-4959-bb28-bce8f4c30043,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converting VIF {"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:36:d4:89,bridge_name='br-int',has_traffic_filtering=True,id=4e64f25c-d50c-4c69-950d-1bccc487367c,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e64f25c-d5') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG os_vif [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:d4:89,bridge_name='br-int',has_traffic_filtering=True,id=4e64f25c-d50c-4c69-950d-1bccc487367c,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e64f25c-d5') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dc9d4698-560a-5778-99b6-b7717ef2d71e', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e64f25c-d5, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e64f25c-d5, col_values=(('qos', UUID('bbdb2fe6-df09-400f-9331-914886d3b353')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e64f25c-d5, col_values=(('external_ids', {'iface-id': '4e64f25c-d50c-4c69-950d-1bccc487367c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:36:d4:89', 'vm-uuid': '0636ce59-3cfb-4959-bb28-bce8f4c30043'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:43 user nova-compute[74242]: INFO os_vif [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:36:d4:89,bridge_name='br-int',has_traffic_filtering=True,id=4e64f25c-d50c-4c69-950d-1bccc487367c,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e64f25c-d5')
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] No VIF found with MAC fa:16:3e:36:d4:89, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:02:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:44 user nova-compute[74242]: DEBUG nova.network.neutron [req-746ff520-3cb4-4de5-9b2d-1ac2f54f9803 req-5510544c-3d32-430e-ad2d-59f4c2891097 service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updated VIF entry in instance network info cache for port 4e64f25c-d50c-4c69-950d-1bccc487367c. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:02:44 user nova-compute[74242]: DEBUG nova.network.neutron [req-746ff520-3cb4-4de5-9b2d-1ac2f54f9803 req-5510544c-3d32-430e-ad2d-59f4c2891097 service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updating instance_info_cache with network_info: [{"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:02:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-746ff520-3cb4-4de5-9b2d-1ac2f54f9803 req-5510544c-3d32-430e-ad2d-59f4c2891097 service nova] Releasing lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:02:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:02:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:02:44 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Instance spawned successfully.
Oct 20 02:02:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:02:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:44 user nova-compute[74242]: INFO nova.compute.manager [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Took 11.26 seconds to spawn the instance on the hypervisor.
Oct 20 02:02:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:02:45 user nova-compute[74242]: INFO nova.compute.manager [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Took 12.15 seconds to build instance.
Oct 20 02:02:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0bc68f61-8d58-40c6-a3a3-cb286c5fc903 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.277s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-cf6e5149-8cac-4f82-8d55-4f12ee5b3c65 req-93d0023c-0bf7-47a3-8da3-7d672ba59246 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:02:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cf6e5149-8cac-4f82-8d55-4f12ee5b3c65 req-93d0023c-0bf7-47a3-8da3-7d672ba59246 service nova] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cf6e5149-8cac-4f82-8d55-4f12ee5b3c65 req-93d0023c-0bf7-47a3-8da3-7d672ba59246 service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cf6e5149-8cac-4f82-8d55-4f12ee5b3c65 req-93d0023c-0bf7-47a3-8da3-7d672ba59246 service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-cf6e5149-8cac-4f82-8d55-4f12ee5b3c65 req-93d0023c-0bf7-47a3-8da3-7d672ba59246 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] No waiting events found dispatching network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:02:47 user nova-compute[74242]: WARNING nova.compute.manager [req-cf6e5149-8cac-4f82-8d55-4f12ee5b3c65 req-93d0023c-0bf7-47a3-8da3-7d672ba59246 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received unexpected event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 for instance with vm_state active and task_state None.
Oct 20 02:02:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:02:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:02:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Instance spawned successfully.
Oct 20 02:02:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:02:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:02:48 user nova-compute[74242]: INFO nova.compute.manager [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Took 8.83 seconds to spawn the instance on the hypervisor.
Oct 20 02:02:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:02:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:48 user nova-compute[74242]: INFO nova.compute.manager [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Took 9.80 seconds to build instance.
Oct 20 02:02:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45e1fb0e-9c21-4d23-8cbf-8797ac18adc2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.934s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-da00dc6a-8a70-4284-8d33-a14866b53903 req-7d3145ca-0ad2-432e-9f7a-22ab2277bfa3 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:02:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-da00dc6a-8a70-4284-8d33-a14866b53903 req-7d3145ca-0ad2-432e-9f7a-22ab2277bfa3 service nova] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-da00dc6a-8a70-4284-8d33-a14866b53903 req-7d3145ca-0ad2-432e-9f7a-22ab2277bfa3 service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-da00dc6a-8a70-4284-8d33-a14866b53903 req-7d3145ca-0ad2-432e-9f7a-22ab2277bfa3 service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-da00dc6a-8a70-4284-8d33-a14866b53903 req-7d3145ca-0ad2-432e-9f7a-22ab2277bfa3 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] No waiting events found dispatching network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:02:49 user nova-compute[74242]: WARNING nova.compute.manager [req-da00dc6a-8a70-4284-8d33-a14866b53903 req-7d3145ca-0ad2-432e-9f7a-22ab2277bfa3 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received unexpected event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 for instance with vm_state active and task_state None.
Oct 20 02:02:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "ec8965b7-0f68-4445-bc29-a0584570de8e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:53 user nova-compute[74242]: DEBUG nova.compute.manager [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:02:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:54 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:02:54 user nova-compute[74242]: INFO nova.compute.claims [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Claim successful on node user
Oct 20 02:02:54 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:02:54 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:02:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:54 user nova-compute[74242]: DEBUG nova.compute.manager [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:02:54 user nova-compute[74242]: DEBUG nova.compute.manager [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:02:54 user nova-compute[74242]: DEBUG nova.network.neutron [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:02:54 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 20 02:02:54 user nova-compute[74242]: DEBUG nova.compute.manager [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:02:54 user nova-compute[74242]: DEBUG nova.policy [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '96d07ff6f5a04f8db75dacd6ad291ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34d590ebe2f34743899f05f0ca0f53b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:02:54 user nova-compute[74242]: DEBUG nova.compute.manager [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:02:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:02:54 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Creating image(s)
Oct 20 02:02:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "/opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "/opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "37b8d083f2dab0a6da94aa392cdb99e42f104d70" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "37b8d083f2dab0a6da94aa392cdb99e42f104d70" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70.part --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:55 user nova-compute[74242]: DEBUG nova.compute.manager [req-d3e5f480-0082-495e-b11e-4aba7a42ce72 req-621f8e7a-92c0-4a90-94d8-fea255238e88 service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Received event network-vif-plugged-b98a0d98-dfbf-4307-a04b-23d585652343 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:02:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d3e5f480-0082-495e-b11e-4aba7a42ce72 req-621f8e7a-92c0-4a90-94d8-fea255238e88 service nova] Acquiring lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d3e5f480-0082-495e-b11e-4aba7a42ce72 req-621f8e7a-92c0-4a90-94d8-fea255238e88 service nova] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d3e5f480-0082-495e-b11e-4aba7a42ce72 req-621f8e7a-92c0-4a90-94d8-fea255238e88 service nova] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:55 user nova-compute[74242]: DEBUG nova.compute.manager [req-d3e5f480-0082-495e-b11e-4aba7a42ce72 req-621f8e7a-92c0-4a90-94d8-fea255238e88 service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] No waiting events found dispatching network-vif-plugged-b98a0d98-dfbf-4307-a04b-23d585652343 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:02:55 user nova-compute[74242]: WARNING nova.compute.manager [req-d3e5f480-0082-495e-b11e-4aba7a42ce72 req-621f8e7a-92c0-4a90-94d8-fea255238e88 service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Received unexpected event network-vif-plugged-b98a0d98-dfbf-4307-a04b-23d585652343 for instance with vm_state active and task_state None.
Oct 20 02:02:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70.part --force-share --output=json" returned: 0 in 0.262s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:55 user nova-compute[74242]: DEBUG nova.virt.images [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] 74028ac9-9600-4738-9013-afd4f1f01416 was qcow2, converting to raw {{(pid=74242) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 02:02:55 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:02:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70.part /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70.converted {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70.part /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70.converted" returned: 0 in 0.286s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70.converted --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:56 user nova-compute[74242]: DEBUG nova.network.neutron [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Successfully created port: 021be9fd-6020-4990-803f-08001190c668 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:02:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70.converted --force-share --output=json" returned: 0 in 0.238s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "37b8d083f2dab0a6da94aa392cdb99e42f104d70" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.349s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70 --force-share --output=json" returned: 0 in 0.247s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "37b8d083f2dab0a6da94aa392cdb99e42f104d70" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "37b8d083f2dab0a6da94aa392cdb99e42f104d70" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70 --force-share --output=json" returned: 0 in 0.220s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70,backing_fmt=raw /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70,backing_fmt=raw /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk 1073741824" returned: 0 in 0.065s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "37b8d083f2dab0a6da94aa392cdb99e42f104d70" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.293s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70 --force-share --output=json" returned: 0 in 0.217s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Cannot resize image /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Ensure instance console log exists: /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Received event network-vif-plugged-b98a0d98-dfbf-4307-a04b-23d585652343 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] Acquiring lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] No waiting events found dispatching network-vif-plugged-b98a0d98-dfbf-4307-a04b-23d585652343 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:02:57 user nova-compute[74242]: WARNING nova.compute.manager [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Received unexpected event network-vif-plugged-b98a0d98-dfbf-4307-a04b-23d585652343 for instance with vm_state active and task_state None.
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received event network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] Acquiring lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] No waiting events found dispatching network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:02:57 user nova-compute[74242]: WARNING nova.compute.manager [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received unexpected event network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b for instance with vm_state active and task_state None.
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received event network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] Acquiring lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] No waiting events found dispatching network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:02:57 user nova-compute[74242]: WARNING nova.compute.manager [req-778847a5-b210-47fa-9d0f-32f97a1fe177 req-3ab4e035-cf50-4dc5-b691-ab54c7c4f713 service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received unexpected event network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b for instance with vm_state active and task_state None.
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Successfully updated port: 021be9fd-6020-4990-803f-08001190c668 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "refresh_cache-ec8965b7-0f68-4445-bc29-a0584570de8e" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquired lock "refresh_cache-ec8965b7-0f68-4445-bc29-a0584570de8e" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Updating instance_info_cache with network_info: [{"id": "021be9fd-6020-4990-803f-08001190c668", "address": "fa:16:3e:4d:ba:d2", "network": {"id": "29396b47-375a-4974-a6cb-9b3dcf05dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1285119154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34d590ebe2f34743899f05f0ca0f53b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021be9fd-60", "ovs_interfaceid": "021be9fd-6020-4990-803f-08001190c668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Releasing lock "refresh_cache-ec8965b7-0f68-4445-bc29-a0584570de8e" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Instance network_info: |[{"id": "021be9fd-6020-4990-803f-08001190c668", "address": "fa:16:3e:4d:ba:d2", "network": {"id": "29396b47-375a-4974-a6cb-9b3dcf05dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1285119154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34d590ebe2f34743899f05f0ca0f53b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021be9fd-60", "ovs_interfaceid": "021be9fd-6020-4990-803f-08001190c668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Start _get_guest_xml network_info=[{"id": "021be9fd-6020-4990-803f-08001190c668", "address": "fa:16:3e:4d:ba:d2", "network": {"id": "29396b47-375a-4974-a6cb-9b3dcf05dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1285119154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34d590ebe2f34743899f05f0ca0f53b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021be9fd-60", "ovs_interfaceid": "021be9fd-6020-4990-803f-08001190c668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T02:02:46Z,direct_url=<?>,disk_format='qcow2',id=74028ac9-9600-4738-9013-afd4f1f01416,min_disk=0,min_ram=0,name='',owner='c55799588e134b55bbe04911477b9081',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T02:02:49Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/sda', 'image_id': '74028ac9-9600-4738-9013-afd4f1f01416'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:02:57 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:02:57 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T02:02:46Z,direct_url=<?>,disk_format='qcow2',id=74028ac9-9600-4738-9013-afd4f1f01416,min_disk=0,min_ram=0,name='',owner='c55799588e134b55bbe04911477b9081',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T02:02:49Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1984968572',display_name='tempest-AttachSCSIVolumeTestJSON-server-1984968572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1984968572',id=5,image_ref='74028ac9-9600-4738-9013-afd4f1f01416',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPDkaPgGLXFU1/OzUmYk9jFQmkS5y/OjRQgtaSGkrx9jseoCiUEsBbkG6lHxQ6qpkYzSZcuqmI8rHvkgcYSiT8wmC267m3t1LAcgufa8nzGthd1nxrfV//yTmYwbBxHwA==',key_name='tempest-keypair-1364790523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34d590ebe2f34743899f05f0ca0f53b0',ramdisk_id='',reservation_id='r-e8tovf2a',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='74028ac9-9600-4738-9013-afd4f1f01416',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2135817157',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2135817157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:02:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96d07ff6f5a04f8db75dacd6ad291ca4',uuid=ec8965b7-0f68-4445-bc29-a0584570de8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "021be9fd-6020-4990-803f-08001190c668", "address": "fa:16:3e:4d:ba:d2", "network": {"id": "29396b47-375a-4974-a6cb-9b3dcf05dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1285119154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34d590ebe2f34743899f05f0ca0f53b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021be9fd-60", "ovs_interfaceid": "021be9fd-6020-4990-803f-08001190c668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Converting VIF {"id": "021be9fd-6020-4990-803f-08001190c668", "address": "fa:16:3e:4d:ba:d2", "network": {"id": "29396b47-375a-4974-a6cb-9b3dcf05dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1285119154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34d590ebe2f34743899f05f0ca0f53b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021be9fd-60", "ovs_interfaceid": "021be9fd-6020-4990-803f-08001190c668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ba:d2,bridge_name='br-int',has_traffic_filtering=True,id=021be9fd-6020-4990-803f-08001190c668,network=Network(29396b47-375a-4974-a6cb-9b3dcf05dcbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021be9fd-60') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:02:57 user nova-compute[74242]: DEBUG nova.objects.instance [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lazy-loading 'pci_devices' on Instance uuid ec8965b7-0f68-4445-bc29-a0584570de8e {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:02:58 user nova-compute[74242]:   <uuid>ec8965b7-0f68-4445-bc29-a0584570de8e</uuid>
Oct 20 02:02:58 user nova-compute[74242]:   <name>instance-00000005</name>
Oct 20 02:02:58 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:02:58 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:02:58 user nova-compute[74242]:   <metadata>
Oct 20 02:02:58 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:02:58 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:02:58 user nova-compute[74242]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1984968572</nova:name>
Oct 20 02:02:58 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:02:57</nova:creationTime>
Oct 20 02:02:58 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:02:58 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:02:58 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:02:58 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:02:58 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:02:58 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:02:58 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:02:58 user nova-compute[74242]:       <nova:owner>
Oct 20 02:02:58 user nova-compute[74242]:         <nova:user uuid="96d07ff6f5a04f8db75dacd6ad291ca4">tempest-AttachSCSIVolumeTestJSON-2135817157-project-member</nova:user>
Oct 20 02:02:58 user nova-compute[74242]:         <nova:project uuid="34d590ebe2f34743899f05f0ca0f53b0">tempest-AttachSCSIVolumeTestJSON-2135817157</nova:project>
Oct 20 02:02:58 user nova-compute[74242]:       </nova:owner>
Oct 20 02:02:58 user nova-compute[74242]:       <nova:root type="image" uuid="74028ac9-9600-4738-9013-afd4f1f01416"/>
Oct 20 02:02:58 user nova-compute[74242]:       <nova:ports>
Oct 20 02:02:58 user nova-compute[74242]:         <nova:port uuid="021be9fd-6020-4990-803f-08001190c668">
Oct 20 02:02:58 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 02:02:58 user nova-compute[74242]:         </nova:port>
Oct 20 02:02:58 user nova-compute[74242]:       </nova:ports>
Oct 20 02:02:58 user nova-compute[74242]:     </nova:instance>
Oct 20 02:02:58 user nova-compute[74242]:   </metadata>
Oct 20 02:02:58 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:02:58 user nova-compute[74242]:     <system>
Oct 20 02:02:58 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:02:58 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:02:58 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:02:58 user nova-compute[74242]:       <entry name="serial">ec8965b7-0f68-4445-bc29-a0584570de8e</entry>
Oct 20 02:02:58 user nova-compute[74242]:       <entry name="uuid">ec8965b7-0f68-4445-bc29-a0584570de8e</entry>
Oct 20 02:02:58 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:02:58 user nova-compute[74242]:     </system>
Oct 20 02:02:58 user nova-compute[74242]:   </sysinfo>
Oct 20 02:02:58 user nova-compute[74242]:   <os>
Oct 20 02:02:58 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:02:58 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:02:58 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:02:58 user nova-compute[74242]:   </os>
Oct 20 02:02:58 user nova-compute[74242]:   <features>
Oct 20 02:02:58 user nova-compute[74242]:     <acpi/>
Oct 20 02:02:58 user nova-compute[74242]:     <apic/>
Oct 20 02:02:58 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:02:58 user nova-compute[74242]:   </features>
Oct 20 02:02:58 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:02:58 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:02:58 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:02:58 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:02:58 user nova-compute[74242]:   </clock>
Oct 20 02:02:58 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:02:58 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:02:58 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:02:58 user nova-compute[74242]:   </cpu>
Oct 20 02:02:58 user nova-compute[74242]:   <devices>
Oct 20 02:02:58 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:02:58 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:02:58 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk"/>
Oct 20 02:02:58 user nova-compute[74242]:       <target dev="sda" bus="scsi"/>
Oct 20 02:02:58 user nova-compute[74242]:       <address type="drive" controller="0" unit="0"/>
Oct 20 02:02:58 user nova-compute[74242]:     </disk>
Oct 20 02:02:58 user nova-compute[74242]:     <disk type="file" device="cdrom">
Oct 20 02:02:58 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 02:02:58 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk.config"/>
Oct 20 02:02:58 user nova-compute[74242]:       <target dev="sdb" bus="scsi"/>
Oct 20 02:02:58 user nova-compute[74242]:       <address type="drive" controller="0" unit="1"/>
Oct 20 02:02:58 user nova-compute[74242]:     </disk>
Oct 20 02:02:58 user nova-compute[74242]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 20 02:02:58 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:02:58 user nova-compute[74242]:       <mac address="fa:16:3e:4d:ba:d2"/>
Oct 20 02:02:58 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:02:58 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:02:58 user nova-compute[74242]:       <target dev="tap021be9fd-60"/>
Oct 20 02:02:58 user nova-compute[74242]:     </interface>
Oct 20 02:02:58 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:02:58 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/console.log" append="off"/>
Oct 20 02:02:58 user nova-compute[74242]:     </serial>
Oct 20 02:02:58 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:02:58 user nova-compute[74242]:     <video>
Oct 20 02:02:58 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:02:58 user nova-compute[74242]:     </video>
Oct 20 02:02:58 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:02:58 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:02:58 user nova-compute[74242]:     </rng>
Oct 20 02:02:58 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:02:58 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:02:58 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:02:58 user nova-compute[74242]:     </memballoon>
Oct 20 02:02:58 user nova-compute[74242]:   </devices>
Oct 20 02:02:58 user nova-compute[74242]: </domain>
Oct 20 02:02:58 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1984968572',display_name='tempest-AttachSCSIVolumeTestJSON-server-1984968572',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1984968572',id=5,image_ref='74028ac9-9600-4738-9013-afd4f1f01416',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPDkaPgGLXFU1/OzUmYk9jFQmkS5y/OjRQgtaSGkrx9jseoCiUEsBbkG6lHxQ6qpkYzSZcuqmI8rHvkgcYSiT8wmC267m3t1LAcgufa8nzGthd1nxrfV//yTmYwbBxHwA==',key_name='tempest-keypair-1364790523',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34d590ebe2f34743899f05f0ca0f53b0',ramdisk_id='',reservation_id='r-e8tovf2a',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='74028ac9-9600-4738-9013-afd4f1f01416',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2135817157',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2135817157-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:02:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96d07ff6f5a04f8db75dacd6ad291ca4',uuid=ec8965b7-0f68-4445-bc29-a0584570de8e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "021be9fd-6020-4990-803f-08001190c668", "address": "fa:16:3e:4d:ba:d2", "network": {"id": "29396b47-375a-4974-a6cb-9b3dcf05dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1285119154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34d590ebe2f34743899f05f0ca0f53b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021be9fd-60", "ovs_interfaceid": "021be9fd-6020-4990-803f-08001190c668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Converting VIF {"id": "021be9fd-6020-4990-803f-08001190c668", "address": "fa:16:3e:4d:ba:d2", "network": {"id": "29396b47-375a-4974-a6cb-9b3dcf05dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1285119154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34d590ebe2f34743899f05f0ca0f53b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021be9fd-60", "ovs_interfaceid": "021be9fd-6020-4990-803f-08001190c668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ba:d2,bridge_name='br-int',has_traffic_filtering=True,id=021be9fd-6020-4990-803f-08001190c668,network=Network(29396b47-375a-4974-a6cb-9b3dcf05dcbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021be9fd-60') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG os_vif [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ba:d2,bridge_name='br-int',has_traffic_filtering=True,id=021be9fd-6020-4990-803f-08001190c668,network=Network(29396b47-375a-4974-a6cb-9b3dcf05dcbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021be9fd-60') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '38c58340-898f-5374-b1f3-2b6be79dddee', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap021be9fd-60, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap021be9fd-60, col_values=(('qos', UUID('b0400cc1-4b6d-4f10-a902-143d5709b63b')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap021be9fd-60, col_values=(('external_ids', {'iface-id': '021be9fd-6020-4990-803f-08001190c668', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4d:ba:d2', 'vm-uuid': 'ec8965b7-0f68-4445-bc29-a0584570de8e'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:58 user nova-compute[74242]: INFO os_vif [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4d:ba:d2,bridge_name='br-int',has_traffic_filtering=True,id=021be9fd-6020-4990-803f-08001190c668,network=Network(29396b47-375a-4974-a6cb-9b3dcf05dcbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021be9fd-60')
Oct 20 02:02:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Acquiring lock "d87147b4-29ec-4e82-8525-b795647422bd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "d87147b4-29ec-4e82-8525-b795647422bd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG nova.compute.manager [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] No BDM found with device name sda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] No VIF found with MAC fa:16:3e:4d:ba:d2, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:02:58 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Using config drive
Oct 20 02:02:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:02:58 user nova-compute[74242]: INFO nova.compute.claims [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Claim successful on node user
Oct 20 02:02:58 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Creating config drive at /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk.config
Oct 20 02:02:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpke43u3lx {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpke43u3lx" returned: 0 in 0.056s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.582s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG nova.compute.manager [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG nova.compute.manager [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:02:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:02:59 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:02:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG nova.policy [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '346f4f728e8b4b9c8f77cbeb588be8b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '29ef800f86ac45a4be04b234f72b43b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:02:59 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Creating image(s)
Oct 20 02:02:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Acquiring lock "/opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "/opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "/opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-e6144c17-b454-47cd-b633-a62a9b9acce0 req-e3043de3-3211-4ce5-978d-3b0317983327 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Received event network-changed-021be9fd-6020-4990-803f-08001190c668 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-e6144c17-b454-47cd-b633-a62a9b9acce0 req-e3043de3-3211-4ce5-978d-3b0317983327 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Refreshing instance network info cache due to event network-changed-021be9fd-6020-4990-803f-08001190c668. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e6144c17-b454-47cd-b633-a62a9b9acce0 req-e3043de3-3211-4ce5-978d-3b0317983327 service nova] Acquiring lock "refresh_cache-ec8965b7-0f68-4445-bc29-a0584570de8e" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e6144c17-b454-47cd-b633-a62a9b9acce0 req-e3043de3-3211-4ce5-978d-3b0317983327 service nova] Acquired lock "refresh_cache-ec8965b7-0f68-4445-bc29-a0584570de8e" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG nova.network.neutron [req-e6144c17-b454-47cd-b633-a62a9b9acce0 req-e3043de3-3211-4ce5-978d-3b0317983327 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Refreshing network info cache for port 021be9fd-6020-4990-803f-08001190c668 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.231s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.238s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:02:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk 1073741824" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.425s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-331098cc-3d29-4f5d-87d7-99499444afb2 req-06c36942-c277-4f75-aaa4-c4313f0c50ea service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Received event network-vif-plugged-4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-331098cc-3d29-4f5d-87d7-99499444afb2 req-06c36942-c277-4f75-aaa4-c4313f0c50ea service nova] Acquiring lock "0636ce59-3cfb-4959-bb28-bce8f4c30043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-331098cc-3d29-4f5d-87d7-99499444afb2 req-06c36942-c277-4f75-aaa4-c4313f0c50ea service nova] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-331098cc-3d29-4f5d-87d7-99499444afb2 req-06c36942-c277-4f75-aaa4-c4313f0c50ea service nova] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-331098cc-3d29-4f5d-87d7-99499444afb2 req-06c36942-c277-4f75-aaa4-c4313f0c50ea service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] No waiting events found dispatching network-vif-plugged-4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:03:00 user nova-compute[74242]: WARNING nova.compute.manager [req-331098cc-3d29-4f5d-87d7-99499444afb2 req-06c36942-c277-4f75-aaa4-c4313f0c50ea service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Received unexpected event network-vif-plugged-4e64f25c-d50c-4c69-950d-1bccc487367c for instance with vm_state active and task_state None.
Oct 20 02:03:00 user nova-compute[74242]: DEBUG nova.network.neutron [req-e6144c17-b454-47cd-b633-a62a9b9acce0 req-e3043de3-3211-4ce5-978d-3b0317983327 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Updated VIF entry in instance network info cache for port 021be9fd-6020-4990-803f-08001190c668. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG nova.network.neutron [req-e6144c17-b454-47cd-b633-a62a9b9acce0 req-e3043de3-3211-4ce5-978d-3b0317983327 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Updating instance_info_cache with network_info: [{"id": "021be9fd-6020-4990-803f-08001190c668", "address": "fa:16:3e:4d:ba:d2", "network": {"id": "29396b47-375a-4974-a6cb-9b3dcf05dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1285119154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34d590ebe2f34743899f05f0ca0f53b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021be9fd-60", "ovs_interfaceid": "021be9fd-6020-4990-803f-08001190c668", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e6144c17-b454-47cd-b633-a62a9b9acce0 req-e3043de3-3211-4ce5-978d-3b0317983327 service nova] Releasing lock "refresh_cache-ec8965b7-0f68-4445-bc29-a0584570de8e" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG nova.network.neutron [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Successfully created port: 0c67b16f-3a40-471a-a468-c1f15e5160af {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Cannot resize image /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Ensure instance console log exists: /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.network.neutron [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Successfully updated port: 0c67b16f-3a40-471a-a468-c1f15e5160af {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Acquiring lock "refresh_cache-d87147b4-29ec-4e82-8525-b795647422bd" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Acquired lock "refresh_cache-d87147b4-29ec-4e82-8525-b795647422bd" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.network.neutron [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.network.neutron [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-25fd7b23-1b3a-4c81-b313-81ee189513f8 req-6f9bacc8-76cf-4776-bbfa-99bb5681d068 service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Received event network-changed-0c67b16f-3a40-471a-a468-c1f15e5160af {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-25fd7b23-1b3a-4c81-b313-81ee189513f8 req-6f9bacc8-76cf-4776-bbfa-99bb5681d068 service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Refreshing instance network info cache due to event network-changed-0c67b16f-3a40-471a-a468-c1f15e5160af. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-25fd7b23-1b3a-4c81-b313-81ee189513f8 req-6f9bacc8-76cf-4776-bbfa-99bb5681d068 service nova] Acquiring lock "refresh_cache-d87147b4-29ec-4e82-8525-b795647422bd" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.network.neutron [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Updating instance_info_cache with network_info: [{"id": "0c67b16f-3a40-471a-a468-c1f15e5160af", "address": "fa:16:3e:78:da:eb", "network": {"id": "d271dbb4-e918-4562-b162-0ba34f9ed9e2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1682652744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef800f86ac45a4be04b234f72b43b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67b16f-3a", "ovs_interfaceid": "0c67b16f-3a40-471a-a468-c1f15e5160af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Releasing lock "refresh_cache-d87147b4-29ec-4e82-8525-b795647422bd" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.compute.manager [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Instance network_info: |[{"id": "0c67b16f-3a40-471a-a468-c1f15e5160af", "address": "fa:16:3e:78:da:eb", "network": {"id": "d271dbb4-e918-4562-b162-0ba34f9ed9e2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1682652744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef800f86ac45a4be04b234f72b43b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67b16f-3a", "ovs_interfaceid": "0c67b16f-3a40-471a-a468-c1f15e5160af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-25fd7b23-1b3a-4c81-b313-81ee189513f8 req-6f9bacc8-76cf-4776-bbfa-99bb5681d068 service nova] Acquired lock "refresh_cache-d87147b4-29ec-4e82-8525-b795647422bd" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.network.neutron [req-25fd7b23-1b3a-4c81-b313-81ee189513f8 req-6f9bacc8-76cf-4776-bbfa-99bb5681d068 service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Refreshing network info cache for port 0c67b16f-3a40-471a-a468-c1f15e5160af {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Start _get_guest_xml network_info=[{"id": "0c67b16f-3a40-471a-a468-c1f15e5160af", "address": "fa:16:3e:78:da:eb", "network": {"id": "d271dbb4-e918-4562-b162-0ba34f9ed9e2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1682652744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef800f86ac45a4be04b234f72b43b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67b16f-3a", "ovs_interfaceid": "0c67b16f-3a40-471a-a468-c1f15e5160af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:03:01 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:03:01 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1800132474',display_name='tempest-VolumesAssistedSnapshotsTest-server-1800132474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1800132474',id=6,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRSyvm6N4dfNXEya1XkAc/iDMXoU0QMvnsIZXB19o8PTOm5vO8scq7fHInaXUbdEoQxIkF3ADD6pZ2RoJLZ2njfQ7emcmzHMV2XRO+23gTwdhwPr0OzFQR+/t+AasLtMg==',key_name='tempest-keypair-384468491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29ef800f86ac45a4be04b234f72b43b0',ramdisk_id='',reservation_id='r-29lszntt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1664071548',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1664071548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='346f4f728e8b4b9c8f77cbeb588be8b8',uuid=d87147b4-29ec-4e82-8525-b795647422bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c67b16f-3a40-471a-a468-c1f15e5160af", "address": "fa:16:3e:78:da:eb", "network": {"id": "d271dbb4-e918-4562-b162-0ba34f9ed9e2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1682652744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef800f86ac45a4be04b234f72b43b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67b16f-3a", "ovs_interfaceid": "0c67b16f-3a40-471a-a468-c1f15e5160af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Converting VIF {"id": "0c67b16f-3a40-471a-a468-c1f15e5160af", "address": "fa:16:3e:78:da:eb", "network": {"id": "d271dbb4-e918-4562-b162-0ba34f9ed9e2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1682652744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef800f86ac45a4be04b234f72b43b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67b16f-3a", "ovs_interfaceid": "0c67b16f-3a40-471a-a468-c1f15e5160af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:da:eb,bridge_name='br-int',has_traffic_filtering=True,id=0c67b16f-3a40-471a-a468-c1f15e5160af,network=Network(d271dbb4-e918-4562-b162-0ba34f9ed9e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c67b16f-3a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.objects.instance [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lazy-loading 'pci_devices' on Instance uuid d87147b4-29ec-4e82-8525-b795647422bd {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:03:01 user nova-compute[74242]:   <uuid>d87147b4-29ec-4e82-8525-b795647422bd</uuid>
Oct 20 02:03:01 user nova-compute[74242]:   <name>instance-00000006</name>
Oct 20 02:03:01 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:03:01 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:03:01 user nova-compute[74242]:   <metadata>
Oct 20 02:03:01 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:03:01 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:03:01 user nova-compute[74242]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1800132474</nova:name>
Oct 20 02:03:01 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:03:01</nova:creationTime>
Oct 20 02:03:01 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:03:01 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:03:01 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:03:01 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:03:01 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:03:01 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:03:01 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:03:01 user nova-compute[74242]:       <nova:owner>
Oct 20 02:03:01 user nova-compute[74242]:         <nova:user uuid="346f4f728e8b4b9c8f77cbeb588be8b8">tempest-VolumesAssistedSnapshotsTest-1664071548-project-member</nova:user>
Oct 20 02:03:01 user nova-compute[74242]:         <nova:project uuid="29ef800f86ac45a4be04b234f72b43b0">tempest-VolumesAssistedSnapshotsTest-1664071548</nova:project>
Oct 20 02:03:01 user nova-compute[74242]:       </nova:owner>
Oct 20 02:03:01 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:03:01 user nova-compute[74242]:       <nova:ports>
Oct 20 02:03:01 user nova-compute[74242]:         <nova:port uuid="0c67b16f-3a40-471a-a468-c1f15e5160af">
Oct 20 02:03:01 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 02:03:01 user nova-compute[74242]:         </nova:port>
Oct 20 02:03:01 user nova-compute[74242]:       </nova:ports>
Oct 20 02:03:01 user nova-compute[74242]:     </nova:instance>
Oct 20 02:03:01 user nova-compute[74242]:   </metadata>
Oct 20 02:03:01 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:03:01 user nova-compute[74242]:     <system>
Oct 20 02:03:01 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:03:01 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:03:01 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:03:01 user nova-compute[74242]:       <entry name="serial">d87147b4-29ec-4e82-8525-b795647422bd</entry>
Oct 20 02:03:01 user nova-compute[74242]:       <entry name="uuid">d87147b4-29ec-4e82-8525-b795647422bd</entry>
Oct 20 02:03:01 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:03:01 user nova-compute[74242]:     </system>
Oct 20 02:03:01 user nova-compute[74242]:   </sysinfo>
Oct 20 02:03:01 user nova-compute[74242]:   <os>
Oct 20 02:03:01 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:03:01 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:03:01 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:03:01 user nova-compute[74242]:   </os>
Oct 20 02:03:01 user nova-compute[74242]:   <features>
Oct 20 02:03:01 user nova-compute[74242]:     <acpi/>
Oct 20 02:03:01 user nova-compute[74242]:     <apic/>
Oct 20 02:03:01 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:03:01 user nova-compute[74242]:   </features>
Oct 20 02:03:01 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:03:01 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:03:01 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:03:01 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:03:01 user nova-compute[74242]:   </clock>
Oct 20 02:03:01 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:03:01 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:03:01 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:03:01 user nova-compute[74242]:   </cpu>
Oct 20 02:03:01 user nova-compute[74242]:   <devices>
Oct 20 02:03:01 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:03:01 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:03:01 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk"/>
Oct 20 02:03:01 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:03:01 user nova-compute[74242]:     </disk>
Oct 20 02:03:01 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:03:01 user nova-compute[74242]:       <mac address="fa:16:3e:78:da:eb"/>
Oct 20 02:03:01 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:03:01 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:03:01 user nova-compute[74242]:       <target dev="tap0c67b16f-3a"/>
Oct 20 02:03:01 user nova-compute[74242]:     </interface>
Oct 20 02:03:01 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:03:01 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/console.log" append="off"/>
Oct 20 02:03:01 user nova-compute[74242]:     </serial>
Oct 20 02:03:01 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:03:01 user nova-compute[74242]:     <video>
Oct 20 02:03:01 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:03:01 user nova-compute[74242]:     </video>
Oct 20 02:03:01 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:03:01 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:03:01 user nova-compute[74242]:     </rng>
Oct 20 02:03:01 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:03:01 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:03:01 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:03:01 user nova-compute[74242]:     </memballoon>
Oct 20 02:03:01 user nova-compute[74242]:   </devices>
Oct 20 02:03:01 user nova-compute[74242]: </domain>
Oct 20 02:03:01 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1800132474',display_name='tempest-VolumesAssistedSnapshotsTest-server-1800132474',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1800132474',id=6,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRSyvm6N4dfNXEya1XkAc/iDMXoU0QMvnsIZXB19o8PTOm5vO8scq7fHInaXUbdEoQxIkF3ADD6pZ2RoJLZ2njfQ7emcmzHMV2XRO+23gTwdhwPr0OzFQR+/t+AasLtMg==',key_name='tempest-keypair-384468491',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='29ef800f86ac45a4be04b234f72b43b0',ramdisk_id='',reservation_id='r-29lszntt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1664071548',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1664071548-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:02:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='346f4f728e8b4b9c8f77cbeb588be8b8',uuid=d87147b4-29ec-4e82-8525-b795647422bd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0c67b16f-3a40-471a-a468-c1f15e5160af", "address": "fa:16:3e:78:da:eb", "network": {"id": "d271dbb4-e918-4562-b162-0ba34f9ed9e2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1682652744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef800f86ac45a4be04b234f72b43b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67b16f-3a", "ovs_interfaceid": "0c67b16f-3a40-471a-a468-c1f15e5160af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Converting VIF {"id": "0c67b16f-3a40-471a-a468-c1f15e5160af", "address": "fa:16:3e:78:da:eb", "network": {"id": "d271dbb4-e918-4562-b162-0ba34f9ed9e2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1682652744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef800f86ac45a4be04b234f72b43b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67b16f-3a", "ovs_interfaceid": "0c67b16f-3a40-471a-a468-c1f15e5160af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:da:eb,bridge_name='br-int',has_traffic_filtering=True,id=0c67b16f-3a40-471a-a468-c1f15e5160af,network=Network(d271dbb4-e918-4562-b162-0ba34f9ed9e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c67b16f-3a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG os_vif [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:da:eb,bridge_name='br-int',has_traffic_filtering=True,id=0c67b16f-3a40-471a-a468-c1f15e5160af,network=Network(d271dbb4-e918-4562-b162-0ba34f9ed9e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c67b16f-3a') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab795d36-c581-578c-bbbe-742383762f0e', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0c67b16f-3a, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0c67b16f-3a, col_values=(('qos', UUID('41e18b94-a58a-4fc9-aaa0-bd0df9cd9cf3')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0c67b16f-3a, col_values=(('external_ids', {'iface-id': '0c67b16f-3a40-471a-a468-c1f15e5160af', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:da:eb', 'vm-uuid': 'd87147b4-29ec-4e82-8525-b795647422bd'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:01 user nova-compute[74242]: INFO os_vif [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:da:eb,bridge_name='br-int',has_traffic_filtering=True,id=0c67b16f-3a40-471a-a468-c1f15e5160af,network=Network(d271dbb4-e918-4562-b162-0ba34f9ed9e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c67b16f-3a')
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:03:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] No VIF found with MAC fa:16:3e:78:da:eb, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:03:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-1745de85-1c82-4671-9e02-d42f07ef6465 req-7a51dc27-9903-430e-85cf-c2e5dbf74360 service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Received event network-vif-plugged-4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:03:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1745de85-1c82-4671-9e02-d42f07ef6465 req-7a51dc27-9903-430e-85cf-c2e5dbf74360 service nova] Acquiring lock "0636ce59-3cfb-4959-bb28-bce8f4c30043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1745de85-1c82-4671-9e02-d42f07ef6465 req-7a51dc27-9903-430e-85cf-c2e5dbf74360 service nova] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1745de85-1c82-4671-9e02-d42f07ef6465 req-7a51dc27-9903-430e-85cf-c2e5dbf74360 service nova] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-1745de85-1c82-4671-9e02-d42f07ef6465 req-7a51dc27-9903-430e-85cf-c2e5dbf74360 service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] No waiting events found dispatching network-vif-plugged-4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:03:02 user nova-compute[74242]: WARNING nova.compute.manager [req-1745de85-1c82-4671-9e02-d42f07ef6465 req-7a51dc27-9903-430e-85cf-c2e5dbf74360 service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Received unexpected event network-vif-plugged-4e64f25c-d50c-4c69-950d-1bccc487367c for instance with vm_state active and task_state None.
Oct 20 02:03:02 user nova-compute[74242]: DEBUG nova.network.neutron [req-25fd7b23-1b3a-4c81-b313-81ee189513f8 req-6f9bacc8-76cf-4776-bbfa-99bb5681d068 service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Updated VIF entry in instance network info cache for port 0c67b16f-3a40-471a-a468-c1f15e5160af. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:03:02 user nova-compute[74242]: DEBUG nova.network.neutron [req-25fd7b23-1b3a-4c81-b313-81ee189513f8 req-6f9bacc8-76cf-4776-bbfa-99bb5681d068 service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Updating instance_info_cache with network_info: [{"id": "0c67b16f-3a40-471a-a468-c1f15e5160af", "address": "fa:16:3e:78:da:eb", "network": {"id": "d271dbb4-e918-4562-b162-0ba34f9ed9e2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1682652744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef800f86ac45a4be04b234f72b43b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67b16f-3a", "ovs_interfaceid": "0c67b16f-3a40-471a-a468-c1f15e5160af", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:03:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-25fd7b23-1b3a-4c81-b313-81ee189513f8 req-6f9bacc8-76cf-4776-bbfa-99bb5681d068 service nova] Releasing lock "refresh_cache-d87147b4-29ec-4e82-8525-b795647422bd" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:03:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:03:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:03:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Instance spawned successfully.
Oct 20 02:03:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:03:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:03 user nova-compute[74242]: INFO nova.compute.manager [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Took 8.21 seconds to spawn the instance on the hypervisor.
Oct 20 02:03:03 user nova-compute[74242]: DEBUG nova.compute.manager [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:03:03 user nova-compute[74242]: INFO nova.compute.manager [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Took 9.14 seconds to build instance.
Oct 20 02:03:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13bb6727-f3bf-4baa-8765-09e450abf685 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.273s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:03 user nova-compute[74242]: DEBUG nova.compute.manager [req-ee43de4a-011d-4fec-af81-18dc85881a45 req-c8e8b5c0-c53f-40d5-8db9-de83a0af974c service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Received event network-vif-plugged-021be9fd-6020-4990-803f-08001190c668 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:03:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ee43de4a-011d-4fec-af81-18dc85881a45 req-c8e8b5c0-c53f-40d5-8db9-de83a0af974c service nova] Acquiring lock "ec8965b7-0f68-4445-bc29-a0584570de8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ee43de4a-011d-4fec-af81-18dc85881a45 req-c8e8b5c0-c53f-40d5-8db9-de83a0af974c service nova] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ee43de4a-011d-4fec-af81-18dc85881a45 req-c8e8b5c0-c53f-40d5-8db9-de83a0af974c service nova] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:03 user nova-compute[74242]: DEBUG nova.compute.manager [req-ee43de4a-011d-4fec-af81-18dc85881a45 req-c8e8b5c0-c53f-40d5-8db9-de83a0af974c service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] No waiting events found dispatching network-vif-plugged-021be9fd-6020-4990-803f-08001190c668 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:03:03 user nova-compute[74242]: WARNING nova.compute.manager [req-ee43de4a-011d-4fec-af81-18dc85881a45 req-c8e8b5c0-c53f-40d5-8db9-de83a0af974c service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Received unexpected event network-vif-plugged-021be9fd-6020-4990-803f-08001190c668 for instance with vm_state active and task_state None.
Oct 20 02:03:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG nova.compute.manager [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:03:05 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Instance spawned successfully.
Oct 20 02:03:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:05 user nova-compute[74242]: INFO nova.compute.manager [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Took 6.46 seconds to spawn the instance on the hypervisor.
Oct 20 02:03:05 user nova-compute[74242]: DEBUG nova.compute.manager [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-1d0223e9-2d35-4d4b-85e7-1f100277463e req-569da43f-6c73-48eb-88c0-1808dbc72d42 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Received event network-vif-plugged-021be9fd-6020-4990-803f-08001190c668 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1d0223e9-2d35-4d4b-85e7-1f100277463e req-569da43f-6c73-48eb-88c0-1808dbc72d42 service nova] Acquiring lock "ec8965b7-0f68-4445-bc29-a0584570de8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1d0223e9-2d35-4d4b-85e7-1f100277463e req-569da43f-6c73-48eb-88c0-1808dbc72d42 service nova] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1d0223e9-2d35-4d4b-85e7-1f100277463e req-569da43f-6c73-48eb-88c0-1808dbc72d42 service nova] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-1d0223e9-2d35-4d4b-85e7-1f100277463e req-569da43f-6c73-48eb-88c0-1808dbc72d42 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] No waiting events found dispatching network-vif-plugged-021be9fd-6020-4990-803f-08001190c668 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:03:05 user nova-compute[74242]: WARNING nova.compute.manager [req-1d0223e9-2d35-4d4b-85e7-1f100277463e req-569da43f-6c73-48eb-88c0-1808dbc72d42 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Received unexpected event network-vif-plugged-021be9fd-6020-4990-803f-08001190c668 for instance with vm_state active and task_state None.
Oct 20 02:03:05 user nova-compute[74242]: INFO nova.compute.manager [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Took 7.61 seconds to build instance.
Oct 20 02:03:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-54ee8d35-9ca0-4712-89e4-3573bde6545b tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "d87147b4-29ec-4e82-8525-b795647422bd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.746s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-8356ca60-8369-44eb-8529-220bd7264c49 req-c20dcc82-ab71-4c6a-bad3-8f2c01b9188e service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Received event network-vif-plugged-0c67b16f-3a40-471a-a468-c1f15e5160af {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8356ca60-8369-44eb-8529-220bd7264c49 req-c20dcc82-ab71-4c6a-bad3-8f2c01b9188e service nova] Acquiring lock "d87147b4-29ec-4e82-8525-b795647422bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8356ca60-8369-44eb-8529-220bd7264c49 req-c20dcc82-ab71-4c6a-bad3-8f2c01b9188e service nova] Lock "d87147b4-29ec-4e82-8525-b795647422bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8356ca60-8369-44eb-8529-220bd7264c49 req-c20dcc82-ab71-4c6a-bad3-8f2c01b9188e service nova] Lock "d87147b4-29ec-4e82-8525-b795647422bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-8356ca60-8369-44eb-8529-220bd7264c49 req-c20dcc82-ab71-4c6a-bad3-8f2c01b9188e service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] No waiting events found dispatching network-vif-plugged-0c67b16f-3a40-471a-a468-c1f15e5160af {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:03:05 user nova-compute[74242]: WARNING nova.compute.manager [req-8356ca60-8369-44eb-8529-220bd7264c49 req-c20dcc82-ab71-4c6a-bad3-8f2c01b9188e service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Received unexpected event network-vif-plugged-0c67b16f-3a40-471a-a468-c1f15e5160af for instance with vm_state active and task_state None.
Oct 20 02:03:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-9a0d8a0f-00e0-4c26-8be0-1b9891bacec0 req-7718c437-2c0b-415c-8875-9134a509b5dc service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Received event network-vif-plugged-0c67b16f-3a40-471a-a468-c1f15e5160af {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:03:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9a0d8a0f-00e0-4c26-8be0-1b9891bacec0 req-7718c437-2c0b-415c-8875-9134a509b5dc service nova] Acquiring lock "d87147b4-29ec-4e82-8525-b795647422bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9a0d8a0f-00e0-4c26-8be0-1b9891bacec0 req-7718c437-2c0b-415c-8875-9134a509b5dc service nova] Lock "d87147b4-29ec-4e82-8525-b795647422bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9a0d8a0f-00e0-4c26-8be0-1b9891bacec0 req-7718c437-2c0b-415c-8875-9134a509b5dc service nova] Lock "d87147b4-29ec-4e82-8525-b795647422bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-9a0d8a0f-00e0-4c26-8be0-1b9891bacec0 req-7718c437-2c0b-415c-8875-9134a509b5dc service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] No waiting events found dispatching network-vif-plugged-0c67b16f-3a40-471a-a468-c1f15e5160af {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:03:08 user nova-compute[74242]: WARNING nova.compute.manager [req-9a0d8a0f-00e0-4c26-8be0-1b9891bacec0 req-7718c437-2c0b-415c-8875-9134a509b5dc service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Received unexpected event network-vif-plugged-0c67b16f-3a40-471a-a468-c1f15e5160af for instance with vm_state active and task_state None.
Oct 20 02:03:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:03:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:03:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:03:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-af9f3d52-79f0-4ce0-9b14-3373b30c2b26" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:03:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-af9f3d52-79f0-4ce0-9b14-3373b30c2b26" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:03:20 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:03:20 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid af9f3d52-79f0-4ce0-9b14-3373b30c2b26 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:03:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:21 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Updating instance_info_cache with network_info: [{"id": "b98a0d98-dfbf-4307-a04b-23d585652343", "address": "fa:16:3e:83:01:9b", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a0d98-df", "ovs_interfaceid": "b98a0d98-dfbf-4307-a04b-23d585652343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:03:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-af9f3d52-79f0-4ce0-9b14-3373b30c2b26" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:03:21 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:03:21 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:03:21 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 02:03:21 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] There are 0 instances to clean {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 02:03:21 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:03:21 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74242) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 02:03:21 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:03:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:23 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:03:23 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:03:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:24 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:03:24 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:03:24 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:03:24 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:03:25 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:03:25 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:03:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:25 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:03:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:28 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:03:28 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:03:28 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7821MB free_disk=25.49154281616211GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:03:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:28 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance af9f3d52-79f0-4ce0-9b14-3373b30c2b26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:03:28 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:03:28 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance b07619e3-0e20-4514-ba34-0340d72cfb54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:03:28 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:03:28 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance ec8965b7-0f68-4445-bc29-a0584570de8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:03:28 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d87147b4-29ec-4e82-8525-b795647422bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:03:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:28 user nova-compute[74242]: INFO nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 has allocations against this compute host but is not found in the database.
Oct 20 02:03:28 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:03:28 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:03:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:03:29 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:03:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:29 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:03:29 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:03:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.822s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.056s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:03:29 user nova-compute[74242]: INFO nova.compute.claims [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Claim successful on node user
Oct 20 02:03:29 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Refreshing inventories for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 02:03:29 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Updating ProviderTree inventory for provider 07b40460-b6ac-48c1-8447-e1778d50b26e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 02:03:29 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Updating inventory in ProviderTree for provider 07b40460-b6ac-48c1-8447-e1778d50b26e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 02:03:29 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Refreshing aggregate associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, aggregates: None {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 02:03:29 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Refreshing trait associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.828s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG nova.network.neutron [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:03:30 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:03:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG nova.policy [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e81797a2a7a744fa8298b767cf469631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a8e047fa564263971543d6342579b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:03:30 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Creating image(s)
Oct 20 02:03:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.004s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.216s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk 1073741824" returned: 0 in 0.061s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Successfully created port: 7575478b-29e4-493e-a04f-0e3747a5c64a {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Cannot resize image /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Ensure instance console log exists: /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Successfully updated port: 7575478b-29e4-493e-a04f-0e3747a5c64a {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquired lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG nova.compute.manager [req-de6554e3-22fb-49b4-8d80-1a3e7d16ad13 req-71096ef6-d8ad-4fcc-b46f-944e02b9d4f8 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received event network-changed-7575478b-29e4-493e-a04f-0e3747a5c64a {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG nova.compute.manager [req-de6554e3-22fb-49b4-8d80-1a3e7d16ad13 req-71096ef6-d8ad-4fcc-b46f-944e02b9d4f8 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Refreshing instance network info cache due to event network-changed-7575478b-29e4-493e-a04f-0e3747a5c64a. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-de6554e3-22fb-49b4-8d80-1a3e7d16ad13 req-71096ef6-d8ad-4fcc-b46f-944e02b9d4f8 service nova] Acquiring lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:03:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.network.neutron [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Updating instance_info_cache with network_info: [{"id": "7575478b-29e4-493e-a04f-0e3747a5c64a", "address": "fa:16:3e:86:90:03", "network": {"id": "bba69f21-fd72-478c-8f16-a8fcd9b41e96", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1592153998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7575478b-29", "ovs_interfaceid": "7575478b-29e4-493e-a04f-0e3747a5c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Releasing lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.compute.manager [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Instance network_info: |[{"id": "7575478b-29e4-493e-a04f-0e3747a5c64a", "address": "fa:16:3e:86:90:03", "network": {"id": "bba69f21-fd72-478c-8f16-a8fcd9b41e96", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1592153998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7575478b-29", "ovs_interfaceid": "7575478b-29e4-493e-a04f-0e3747a5c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-de6554e3-22fb-49b4-8d80-1a3e7d16ad13 req-71096ef6-d8ad-4fcc-b46f-944e02b9d4f8 service nova] Acquired lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-de6554e3-22fb-49b4-8d80-1a3e7d16ad13 req-71096ef6-d8ad-4fcc-b46f-944e02b9d4f8 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Refreshing network info cache for port 7575478b-29e4-493e-a04f-0e3747a5c64a {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Start _get_guest_xml network_info=[{"id": "7575478b-29e4-493e-a04f-0e3747a5c64a", "address": "fa:16:3e:86:90:03", "network": {"id": "bba69f21-fd72-478c-8f16-a8fcd9b41e96", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1592153998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7575478b-29", "ovs_interfaceid": "7575478b-29e4-493e-a04f-0e3747a5c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:03:32 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:03:32 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1179443261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1179443261',id=7,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpogir2lL5fxgT+aGdQt1FD0OBJl3IivuczQXbzwg0f71VsW0nMR64AVx2F5qXSCYftEKlBnA8CPoiaBKJjZl9XM4BiISexAmTWuqad0JPqRMC1MStDpdYS3HjZNGmZWg==',key_name='tempest-keypair-808065593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28a8e047fa564263971543d6342579b1',ramdisk_id='',reservation_id='r-91z09vmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-789715889',owner_user_name='tempest-TaggedAttachmentsTest-789715889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81797a2a7a744fa8298b767cf469631',uuid=e22cb246-155d-48f5-9eee-bd543c0bbaf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7575478b-29e4-493e-a04f-0e3747a5c64a", "address": "fa:16:3e:86:90:03", "network": {"id": "bba69f21-fd72-478c-8f16-a8fcd9b41e96", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1592153998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7575478b-29", "ovs_interfaceid": "7575478b-29e4-493e-a04f-0e3747a5c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Converting VIF {"id": "7575478b-29e4-493e-a04f-0e3747a5c64a", "address": "fa:16:3e:86:90:03", "network": {"id": "bba69f21-fd72-478c-8f16-a8fcd9b41e96", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1592153998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7575478b-29", "ovs_interfaceid": "7575478b-29e4-493e-a04f-0e3747a5c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:90:03,bridge_name='br-int',has_traffic_filtering=True,id=7575478b-29e4-493e-a04f-0e3747a5c64a,network=Network(bba69f21-fd72-478c-8f16-a8fcd9b41e96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7575478b-29') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.objects.instance [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lazy-loading 'pci_devices' on Instance uuid e22cb246-155d-48f5-9eee-bd543c0bbaf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:03:32 user nova-compute[74242]:   <uuid>e22cb246-155d-48f5-9eee-bd543c0bbaf1</uuid>
Oct 20 02:03:32 user nova-compute[74242]:   <name>instance-00000007</name>
Oct 20 02:03:32 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:03:32 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:03:32 user nova-compute[74242]:   <metadata>
Oct 20 02:03:32 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:03:32 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:03:32 user nova-compute[74242]:       <nova:name>tempest-device-tagging-server-1179443261</nova:name>
Oct 20 02:03:32 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:03:32</nova:creationTime>
Oct 20 02:03:32 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:03:32 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:03:32 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:03:32 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:03:32 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:03:32 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:03:32 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:03:32 user nova-compute[74242]:       <nova:owner>
Oct 20 02:03:32 user nova-compute[74242]:         <nova:user uuid="e81797a2a7a744fa8298b767cf469631">tempest-TaggedAttachmentsTest-789715889-project-member</nova:user>
Oct 20 02:03:32 user nova-compute[74242]:         <nova:project uuid="28a8e047fa564263971543d6342579b1">tempest-TaggedAttachmentsTest-789715889</nova:project>
Oct 20 02:03:32 user nova-compute[74242]:       </nova:owner>
Oct 20 02:03:32 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:03:32 user nova-compute[74242]:       <nova:ports>
Oct 20 02:03:32 user nova-compute[74242]:         <nova:port uuid="7575478b-29e4-493e-a04f-0e3747a5c64a">
Oct 20 02:03:32 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 02:03:32 user nova-compute[74242]:         </nova:port>
Oct 20 02:03:32 user nova-compute[74242]:       </nova:ports>
Oct 20 02:03:32 user nova-compute[74242]:     </nova:instance>
Oct 20 02:03:32 user nova-compute[74242]:   </metadata>
Oct 20 02:03:32 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:03:32 user nova-compute[74242]:     <system>
Oct 20 02:03:32 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:03:32 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:03:32 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:03:32 user nova-compute[74242]:       <entry name="serial">e22cb246-155d-48f5-9eee-bd543c0bbaf1</entry>
Oct 20 02:03:32 user nova-compute[74242]:       <entry name="uuid">e22cb246-155d-48f5-9eee-bd543c0bbaf1</entry>
Oct 20 02:03:32 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:03:32 user nova-compute[74242]:     </system>
Oct 20 02:03:32 user nova-compute[74242]:   </sysinfo>
Oct 20 02:03:32 user nova-compute[74242]:   <os>
Oct 20 02:03:32 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:03:32 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:03:32 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:03:32 user nova-compute[74242]:   </os>
Oct 20 02:03:32 user nova-compute[74242]:   <features>
Oct 20 02:03:32 user nova-compute[74242]:     <acpi/>
Oct 20 02:03:32 user nova-compute[74242]:     <apic/>
Oct 20 02:03:32 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:03:32 user nova-compute[74242]:   </features>
Oct 20 02:03:32 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:03:32 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:03:32 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:03:32 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:03:32 user nova-compute[74242]:   </clock>
Oct 20 02:03:32 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:03:32 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:03:32 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:03:32 user nova-compute[74242]:   </cpu>
Oct 20 02:03:32 user nova-compute[74242]:   <devices>
Oct 20 02:03:32 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:03:32 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:03:32 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk"/>
Oct 20 02:03:32 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:03:32 user nova-compute[74242]:     </disk>
Oct 20 02:03:32 user nova-compute[74242]:     <disk type="file" device="cdrom">
Oct 20 02:03:32 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 02:03:32 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk.config"/>
Oct 20 02:03:32 user nova-compute[74242]:       <target dev="hda" bus="ide"/>
Oct 20 02:03:32 user nova-compute[74242]:     </disk>
Oct 20 02:03:32 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:03:32 user nova-compute[74242]:       <mac address="fa:16:3e:86:90:03"/>
Oct 20 02:03:32 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:03:32 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:03:32 user nova-compute[74242]:       <target dev="tap7575478b-29"/>
Oct 20 02:03:32 user nova-compute[74242]:     </interface>
Oct 20 02:03:32 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:03:32 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/console.log" append="off"/>
Oct 20 02:03:32 user nova-compute[74242]:     </serial>
Oct 20 02:03:32 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:03:32 user nova-compute[74242]:     <video>
Oct 20 02:03:32 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:03:32 user nova-compute[74242]:     </video>
Oct 20 02:03:32 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:03:32 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:03:32 user nova-compute[74242]:     </rng>
Oct 20 02:03:32 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:03:32 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:03:32 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:03:32 user nova-compute[74242]:     </memballoon>
Oct 20 02:03:32 user nova-compute[74242]:   </devices>
Oct 20 02:03:32 user nova-compute[74242]: </domain>
Oct 20 02:03:32 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1179443261',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1179443261',id=7,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpogir2lL5fxgT+aGdQt1FD0OBJl3IivuczQXbzwg0f71VsW0nMR64AVx2F5qXSCYftEKlBnA8CPoiaBKJjZl9XM4BiISexAmTWuqad0JPqRMC1MStDpdYS3HjZNGmZWg==',key_name='tempest-keypair-808065593',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28a8e047fa564263971543d6342579b1',ramdisk_id='',reservation_id='r-91z09vmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-789715889',owner_user_name='tempest-TaggedAttachmentsTest-789715889-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:03:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81797a2a7a744fa8298b767cf469631',uuid=e22cb246-155d-48f5-9eee-bd543c0bbaf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7575478b-29e4-493e-a04f-0e3747a5c64a", "address": "fa:16:3e:86:90:03", "network": {"id": "bba69f21-fd72-478c-8f16-a8fcd9b41e96", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1592153998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7575478b-29", "ovs_interfaceid": "7575478b-29e4-493e-a04f-0e3747a5c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Converting VIF {"id": "7575478b-29e4-493e-a04f-0e3747a5c64a", "address": "fa:16:3e:86:90:03", "network": {"id": "bba69f21-fd72-478c-8f16-a8fcd9b41e96", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1592153998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7575478b-29", "ovs_interfaceid": "7575478b-29e4-493e-a04f-0e3747a5c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:86:90:03,bridge_name='br-int',has_traffic_filtering=True,id=7575478b-29e4-493e-a04f-0e3747a5c64a,network=Network(bba69f21-fd72-478c-8f16-a8fcd9b41e96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7575478b-29') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG os_vif [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:90:03,bridge_name='br-int',has_traffic_filtering=True,id=7575478b-29e4-493e-a04f-0e3747a5c64a,network=Network(bba69f21-fd72-478c-8f16-a8fcd9b41e96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7575478b-29') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '55cd60c3-c24d-5b2d-8fe3-d33bfc0e1d7c', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7575478b-29, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7575478b-29, col_values=(('qos', UUID('5677534d-628a-45b2-9c0c-167cde3e98d9')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7575478b-29, col_values=(('external_ids', {'iface-id': '7575478b-29e4-493e-a04f-0e3747a5c64a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:86:90:03', 'vm-uuid': 'e22cb246-155d-48f5-9eee-bd543c0bbaf1'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:32 user nova-compute[74242]: INFO os_vif [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:86:90:03,bridge_name='br-int',has_traffic_filtering=True,id=7575478b-29e4-493e-a04f-0e3747a5c64a,network=Network(bba69f21-fd72-478c-8f16-a8fcd9b41e96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7575478b-29')
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] No BDM found with device name hda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] No VIF found with MAC fa:16:3e:86:90:03, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:03:32 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Using config drive
Oct 20 02:03:32 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Creating config drive at /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk.config
Oct 20 02:03:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqcpj3q5o {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpqcpj3q5o" returned: 0 in 0.063s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-de6554e3-22fb-49b4-8d80-1a3e7d16ad13 req-71096ef6-d8ad-4fcc-b46f-944e02b9d4f8 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Updated VIF entry in instance network info cache for port 7575478b-29e4-493e-a04f-0e3747a5c64a. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-de6554e3-22fb-49b4-8d80-1a3e7d16ad13 req-71096ef6-d8ad-4fcc-b46f-944e02b9d4f8 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Updating instance_info_cache with network_info: [{"id": "7575478b-29e4-493e-a04f-0e3747a5c64a", "address": "fa:16:3e:86:90:03", "network": {"id": "bba69f21-fd72-478c-8f16-a8fcd9b41e96", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1592153998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7575478b-29", "ovs_interfaceid": "7575478b-29e4-493e-a04f-0e3747a5c64a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:03:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-de6554e3-22fb-49b4-8d80-1a3e7d16ad13 req-71096ef6-d8ad-4fcc-b46f-944e02b9d4f8 service nova] Releasing lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:03:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Acquiring lock "d0231be7-4850-48ce-8757-fade8f3e4e25" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:03:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:03:35 user nova-compute[74242]: INFO nova.compute.claims [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Claim successful on node user
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:03:36 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Instance spawned successfully.
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:03:36 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.policy [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bdc01d186a974e0386d40868e3819caf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a463d28cea7941299b13a42f39f7d885', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:03:36 user nova-compute[74242]: INFO nova.compute.manager [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Took 6.04 seconds to spawn the instance on the hypervisor.
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:03:36 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Creating image(s)
Oct 20 02:03:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Acquiring lock "/opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "/opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "/opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:36 user nova-compute[74242]: INFO nova.compute.manager [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Took 7.29 seconds to build instance.
Oct 20 02:03:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-79e46791-77ba-4a78-a9ca-2108d4327ead tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.404s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.165s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk 1073741824" returned: 0 in 0.068s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Successfully created port: 3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Cannot resize image /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Ensure instance console log exists: /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Successfully updated port: 3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Acquiring lock "refresh_cache-d0231be7-4850-48ce-8757-fade8f3e4e25" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Acquired lock "refresh_cache-d0231be7-4850-48ce-8757-fade8f3e4e25" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-96b8d9f7-bbad-41b6-b16f-e1cc7dd7e060 req-2c75528e-e003-410d-a690-0d73ed487e9c service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received event network-changed-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-96b8d9f7-bbad-41b6-b16f-e1cc7dd7e060 req-2c75528e-e003-410d-a690-0d73ed487e9c service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Refreshing instance network info cache due to event network-changed-3ce48996-f63a-4331-8ac0-09af8a20548f. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-96b8d9f7-bbad-41b6-b16f-e1cc7dd7e060 req-2c75528e-e003-410d-a690-0d73ed487e9c service nova] Acquiring lock "refresh_cache-d0231be7-4850-48ce-8757-fade8f3e4e25" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Updating instance_info_cache with network_info: [{"id": "3ce48996-f63a-4331-8ac0-09af8a20548f", "address": "fa:16:3e:3d:b4:a8", "network": {"id": "9e9db320-57f7-473a-8b95-a0d46ad78525", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1430458944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a463d28cea7941299b13a42f39f7d885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce48996-f6", "ovs_interfaceid": "3ce48996-f63a-4331-8ac0-09af8a20548f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Releasing lock "refresh_cache-d0231be7-4850-48ce-8757-fade8f3e4e25" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Instance network_info: |[{"id": "3ce48996-f63a-4331-8ac0-09af8a20548f", "address": "fa:16:3e:3d:b4:a8", "network": {"id": "9e9db320-57f7-473a-8b95-a0d46ad78525", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1430458944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a463d28cea7941299b13a42f39f7d885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce48996-f6", "ovs_interfaceid": "3ce48996-f63a-4331-8ac0-09af8a20548f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-96b8d9f7-bbad-41b6-b16f-e1cc7dd7e060 req-2c75528e-e003-410d-a690-0d73ed487e9c service nova] Acquired lock "refresh_cache-d0231be7-4850-48ce-8757-fade8f3e4e25" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.network.neutron [req-96b8d9f7-bbad-41b6-b16f-e1cc7dd7e060 req-2c75528e-e003-410d-a690-0d73ed487e9c service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Refreshing network info cache for port 3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Start _get_guest_xml network_info=[{"id": "3ce48996-f63a-4331-8ac0-09af8a20548f", "address": "fa:16:3e:3d:b4:a8", "network": {"id": "9e9db320-57f7-473a-8b95-a0d46ad78525", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1430458944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a463d28cea7941299b13a42f39f7d885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce48996-f6", "ovs_interfaceid": "3ce48996-f63a-4331-8ac0-09af8a20548f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:03:37 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:03:37 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1136647226',display_name='tempest-VolumesActionsTest-instance-1136647226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1136647226',id=8,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a463d28cea7941299b13a42f39f7d885',ramdisk_id='',reservation_id='r-37fqw5b8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1808425642',owner_user_name='tempest-VolumesActionsTest-1808425642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:03:36Z,user_data=None,user_id='bdc01d186a974e0386d40868e3819caf',uuid=d0231be7-4850-48ce-8757-fade8f3e4e25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce48996-f63a-4331-8ac0-09af8a20548f", "address": "fa:16:3e:3d:b4:a8", "network": {"id": "9e9db320-57f7-473a-8b95-a0d46ad78525", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1430458944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a463d28cea7941299b13a42f39f7d885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce48996-f6", "ovs_interfaceid": "3ce48996-f63a-4331-8ac0-09af8a20548f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Converting VIF {"id": "3ce48996-f63a-4331-8ac0-09af8a20548f", "address": "fa:16:3e:3d:b4:a8", "network": {"id": "9e9db320-57f7-473a-8b95-a0d46ad78525", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1430458944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a463d28cea7941299b13a42f39f7d885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce48996-f6", "ovs_interfaceid": "3ce48996-f63a-4331-8ac0-09af8a20548f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:b4:a8,bridge_name='br-int',has_traffic_filtering=True,id=3ce48996-f63a-4331-8ac0-09af8a20548f,network=Network(9e9db320-57f7-473a-8b95-a0d46ad78525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce48996-f6') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.objects.instance [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lazy-loading 'pci_devices' on Instance uuid d0231be7-4850-48ce-8757-fade8f3e4e25 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:03:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:03:37 user nova-compute[74242]:   <uuid>d0231be7-4850-48ce-8757-fade8f3e4e25</uuid>
Oct 20 02:03:37 user nova-compute[74242]:   <name>instance-00000008</name>
Oct 20 02:03:37 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:03:37 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:03:37 user nova-compute[74242]:   <metadata>
Oct 20 02:03:37 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:03:37 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:03:37 user nova-compute[74242]:       <nova:name>tempest-VolumesActionsTest-instance-1136647226</nova:name>
Oct 20 02:03:37 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:03:37</nova:creationTime>
Oct 20 02:03:37 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:03:37 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:03:37 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:03:37 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:03:37 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:03:37 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:03:37 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:03:37 user nova-compute[74242]:       <nova:owner>
Oct 20 02:03:37 user nova-compute[74242]:         <nova:user uuid="bdc01d186a974e0386d40868e3819caf">tempest-VolumesActionsTest-1808425642-project-member</nova:user>
Oct 20 02:03:37 user nova-compute[74242]:         <nova:project uuid="a463d28cea7941299b13a42f39f7d885">tempest-VolumesActionsTest-1808425642</nova:project>
Oct 20 02:03:37 user nova-compute[74242]:       </nova:owner>
Oct 20 02:03:37 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:03:37 user nova-compute[74242]:       <nova:ports>
Oct 20 02:03:37 user nova-compute[74242]:         <nova:port uuid="3ce48996-f63a-4331-8ac0-09af8a20548f">
Oct 20 02:03:37 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 02:03:37 user nova-compute[74242]:         </nova:port>
Oct 20 02:03:37 user nova-compute[74242]:       </nova:ports>
Oct 20 02:03:37 user nova-compute[74242]:     </nova:instance>
Oct 20 02:03:37 user nova-compute[74242]:   </metadata>
Oct 20 02:03:37 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:03:37 user nova-compute[74242]:     <system>
Oct 20 02:03:37 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:03:37 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:03:37 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:03:37 user nova-compute[74242]:       <entry name="serial">d0231be7-4850-48ce-8757-fade8f3e4e25</entry>
Oct 20 02:03:37 user nova-compute[74242]:       <entry name="uuid">d0231be7-4850-48ce-8757-fade8f3e4e25</entry>
Oct 20 02:03:37 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:03:37 user nova-compute[74242]:     </system>
Oct 20 02:03:37 user nova-compute[74242]:   </sysinfo>
Oct 20 02:03:37 user nova-compute[74242]:   <os>
Oct 20 02:03:37 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:03:37 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:03:37 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:03:37 user nova-compute[74242]:   </os>
Oct 20 02:03:37 user nova-compute[74242]:   <features>
Oct 20 02:03:37 user nova-compute[74242]:     <acpi/>
Oct 20 02:03:37 user nova-compute[74242]:     <apic/>
Oct 20 02:03:37 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:03:37 user nova-compute[74242]:   </features>
Oct 20 02:03:37 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:03:37 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:03:37 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:03:37 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:03:37 user nova-compute[74242]:   </clock>
Oct 20 02:03:37 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:03:37 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:03:37 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:03:37 user nova-compute[74242]:   </cpu>
Oct 20 02:03:37 user nova-compute[74242]:   <devices>
Oct 20 02:03:37 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:03:37 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:03:37 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk"/>
Oct 20 02:03:37 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:03:37 user nova-compute[74242]:     </disk>
Oct 20 02:03:37 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:03:37 user nova-compute[74242]:       <mac address="fa:16:3e:3d:b4:a8"/>
Oct 20 02:03:37 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:03:37 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:03:37 user nova-compute[74242]:       <target dev="tap3ce48996-f6"/>
Oct 20 02:03:37 user nova-compute[74242]:     </interface>
Oct 20 02:03:37 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:03:37 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/console.log" append="off"/>
Oct 20 02:03:37 user nova-compute[74242]:     </serial>
Oct 20 02:03:37 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:03:37 user nova-compute[74242]:     <video>
Oct 20 02:03:37 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:03:37 user nova-compute[74242]:     </video>
Oct 20 02:03:37 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:03:37 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:03:37 user nova-compute[74242]:     </rng>
Oct 20 02:03:37 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:03:37 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:03:37 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:03:37 user nova-compute[74242]:     </memballoon>
Oct 20 02:03:37 user nova-compute[74242]:   </devices>
Oct 20 02:03:37 user nova-compute[74242]: </domain>
Oct 20 02:03:37 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1136647226',display_name='tempest-VolumesActionsTest-instance-1136647226',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1136647226',id=8,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a463d28cea7941299b13a42f39f7d885',ramdisk_id='',reservation_id='r-37fqw5b8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1808425642',owner_user_name='tempest-VolumesActionsTest-1808425642-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:03:36Z,user_data=None,user_id='bdc01d186a974e0386d40868e3819caf',uuid=d0231be7-4850-48ce-8757-fade8f3e4e25,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ce48996-f63a-4331-8ac0-09af8a20548f", "address": "fa:16:3e:3d:b4:a8", "network": {"id": "9e9db320-57f7-473a-8b95-a0d46ad78525", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1430458944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a463d28cea7941299b13a42f39f7d885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce48996-f6", "ovs_interfaceid": "3ce48996-f63a-4331-8ac0-09af8a20548f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Converting VIF {"id": "3ce48996-f63a-4331-8ac0-09af8a20548f", "address": "fa:16:3e:3d:b4:a8", "network": {"id": "9e9db320-57f7-473a-8b95-a0d46ad78525", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1430458944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a463d28cea7941299b13a42f39f7d885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce48996-f6", "ovs_interfaceid": "3ce48996-f63a-4331-8ac0-09af8a20548f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:b4:a8,bridge_name='br-int',has_traffic_filtering=True,id=3ce48996-f63a-4331-8ac0-09af8a20548f,network=Network(9e9db320-57f7-473a-8b95-a0d46ad78525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce48996-f6') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG os_vif [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:b4:a8,bridge_name='br-int',has_traffic_filtering=True,id=3ce48996-f63a-4331-8ac0-09af8a20548f,network=Network(9e9db320-57f7-473a-8b95-a0d46ad78525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce48996-f6') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db745bb1-b509-56d1-9357-48ad17626d3f', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ce48996-f6, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ce48996-f6, col_values=(('qos', UUID('2065c27c-a67d-43a9-ba4d-dafeb562d687')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ce48996-f6, col_values=(('external_ids', {'iface-id': '3ce48996-f63a-4331-8ac0-09af8a20548f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:b4:a8', 'vm-uuid': 'd0231be7-4850-48ce-8757-fade8f3e4e25'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:38 user nova-compute[74242]: INFO os_vif [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:b4:a8,bridge_name='br-int',has_traffic_filtering=True,id=3ce48996-f63a-4331-8ac0-09af8a20548f,network=Network(9e9db320-57f7-473a-8b95-a0d46ad78525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce48996-f6')
Oct 20 02:03:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] No VIF found with MAC fa:16:3e:3d:b4:a8, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG nova.network.neutron [req-96b8d9f7-bbad-41b6-b16f-e1cc7dd7e060 req-2c75528e-e003-410d-a690-0d73ed487e9c service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Updated VIF entry in instance network info cache for port 3ce48996-f63a-4331-8ac0-09af8a20548f. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG nova.network.neutron [req-96b8d9f7-bbad-41b6-b16f-e1cc7dd7e060 req-2c75528e-e003-410d-a690-0d73ed487e9c service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Updating instance_info_cache with network_info: [{"id": "3ce48996-f63a-4331-8ac0-09af8a20548f", "address": "fa:16:3e:3d:b4:a8", "network": {"id": "9e9db320-57f7-473a-8b95-a0d46ad78525", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1430458944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a463d28cea7941299b13a42f39f7d885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce48996-f6", "ovs_interfaceid": "3ce48996-f63a-4331-8ac0-09af8a20548f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-96b8d9f7-bbad-41b6-b16f-e1cc7dd7e060 req-2c75528e-e003-410d-a690-0d73ed487e9c service nova] Releasing lock "refresh_cache-d0231be7-4850-48ce-8757-fade8f3e4e25" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:03:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-839efeae-bc9d-42a0-b04c-ce1c36d72338 req-d84d12e8-a53a-43c4-87a5-fd74b6f01222 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received event network-vif-plugged-7575478b-29e4-493e-a04f-0e3747a5c64a {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:03:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-839efeae-bc9d-42a0-b04c-ce1c36d72338 req-d84d12e8-a53a-43c4-87a5-fd74b6f01222 service nova] Acquiring lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-839efeae-bc9d-42a0-b04c-ce1c36d72338 req-d84d12e8-a53a-43c4-87a5-fd74b6f01222 service nova] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-839efeae-bc9d-42a0-b04c-ce1c36d72338 req-d84d12e8-a53a-43c4-87a5-fd74b6f01222 service nova] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-839efeae-bc9d-42a0-b04c-ce1c36d72338 req-d84d12e8-a53a-43c4-87a5-fd74b6f01222 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] No waiting events found dispatching network-vif-plugged-7575478b-29e4-493e-a04f-0e3747a5c64a {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:03:39 user nova-compute[74242]: WARNING nova.compute.manager [req-839efeae-bc9d-42a0-b04c-ce1c36d72338 req-d84d12e8-a53a-43c4-87a5-fd74b6f01222 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received unexpected event network-vif-plugged-7575478b-29e4-493e-a04f-0e3747a5c64a for instance with vm_state active and task_state None.
Oct 20 02:03:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received event network-vif-plugged-7575478b-29e4-493e-a04f-0e3747a5c64a {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] Acquiring lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] No waiting events found dispatching network-vif-plugged-7575478b-29e4-493e-a04f-0e3747a5c64a {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:03:41 user nova-compute[74242]: WARNING nova.compute.manager [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received unexpected event network-vif-plugged-7575478b-29e4-493e-a04f-0e3747a5c64a for instance with vm_state active and task_state None.
Oct 20 02:03:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received event network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] Acquiring lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] No waiting events found dispatching network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:03:41 user nova-compute[74242]: WARNING nova.compute.manager [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received unexpected event network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f for instance with vm_state building and task_state spawning.
Oct 20 02:03:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received event network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] Acquiring lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] No waiting events found dispatching network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:03:41 user nova-compute[74242]: WARNING nova.compute.manager [req-cc097463-207b-4ee9-b176-e8217d57b7df req-69613b6d-bb47-48a4-92dc-536ba1470cae service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received unexpected event network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f for instance with vm_state building and task_state spawning.
Oct 20 02:03:41 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:03:41 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Instance spawned successfully.
Oct 20 02:03:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:03:42 user nova-compute[74242]: INFO nova.compute.manager [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Took 5.60 seconds to spawn the instance on the hypervisor.
Oct 20 02:03:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:03:42 user nova-compute[74242]: INFO nova.compute.manager [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Took 6.27 seconds to build instance.
Oct 20 02:03:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e52ab6f8-debc-41b2-a2e8-1cbb09d7a65f tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.372s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:03:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:03:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "9a0fc135-ab9b-4b81-950d-84da9e99a422" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "9a0fc135-ab9b-4b81-950d-84da9e99a422" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG nova.compute.manager [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:04:17 user nova-compute[74242]: INFO nova.compute.claims [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Claim successful on node user
Oct 20 02:04:17 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG nova.compute.manager [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.336s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:04:17 user nova-compute[74242]: INFO nova.compute.claims [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Claim successful on node user
Oct 20 02:04:17 user nova-compute[74242]: DEBUG nova.compute.manager [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:04:17 user nova-compute[74242]: DEBUG nova.network.neutron [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:04:17 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:04:17 user nova-compute[74242]: DEBUG nova.compute.manager [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG nova.policy [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fee6d4bd2fe04600a6962eeca70b0645', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a8561fb233b4571a47c188a1d9555dc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG nova.compute.manager [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:04:18 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Creating image(s)
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "/opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "/opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "/opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.206s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.552s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:04:18 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:04:18 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG nova.policy [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '67ba274f41b04cbaa4cbfd77948bb7e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '647e5ec77b024268af7209c8a0b73380', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.216s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG nova.network.neutron [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Successfully created port: 982faaf3-9f52-4af8-b2f7-18ecde4b280c {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:04:18 user nova-compute[74242]: INFO nova.virt.block_device [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Booting with volume 6e79478c-34db-431c-86df-ffa42a493f68 at /dev/vda
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk 1073741824" returned: 0 in 0.083s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.303s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG os_brick.utils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:04:18 user nova-compute[74242]: INFO oslo.privsep.daemon [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp153kv7xu/privsep.sock']
Oct 20 02:04:18 user sudo[85315]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp153kv7xu/privsep.sock
Oct 20 02:04:18 user sudo[85315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:18 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Cannot resize image /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Ensure instance console log exists: /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Successfully created port: 5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.network.neutron [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Successfully updated port: 982faaf3-9f52-4af8-b2f7-18ecde4b280c {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "refresh_cache-9a0fc135-ab9b-4b81-950d-84da9e99a422" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquired lock "refresh_cache-9a0fc135-ab9b-4b81-950d-84da9e99a422" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.network.neutron [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.compute.manager [req-1d4de7b9-b565-427b-aee1-604505e615cc req-2bda0ffa-cf59-460b-857c-308a7a182ccf service nova] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Received event network-changed-982faaf3-9f52-4af8-b2f7-18ecde4b280c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.compute.manager [req-1d4de7b9-b565-427b-aee1-604505e615cc req-2bda0ffa-cf59-460b-857c-308a7a182ccf service nova] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Refreshing instance network info cache due to event network-changed-982faaf3-9f52-4af8-b2f7-18ecde4b280c. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1d4de7b9-b565-427b-aee1-604505e615cc req-2bda0ffa-cf59-460b-857c-308a7a182ccf service nova] Acquiring lock "refresh_cache-9a0fc135-ab9b-4b81-950d-84da9e99a422" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.network.neutron [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.network.neutron [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Updating instance_info_cache with network_info: [{"id": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "address": "fa:16:3e:55:56:49", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982faaf3-9f", "ovs_interfaceid": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Releasing lock "refresh_cache-9a0fc135-ab9b-4b81-950d-84da9e99a422" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.compute.manager [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Instance network_info: |[{"id": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "address": "fa:16:3e:55:56:49", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982faaf3-9f", "ovs_interfaceid": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1d4de7b9-b565-427b-aee1-604505e615cc req-2bda0ffa-cf59-460b-857c-308a7a182ccf service nova] Acquired lock "refresh_cache-9a0fc135-ab9b-4b81-950d-84da9e99a422" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.network.neutron [req-1d4de7b9-b565-427b-aee1-604505e615cc req-2bda0ffa-cf59-460b-857c-308a7a182ccf service nova] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Refreshing network info cache for port 982faaf3-9f52-4af8-b2f7-18ecde4b280c {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Start _get_guest_xml network_info=[{"id": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "address": "fa:16:3e:55:56:49", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982faaf3-9f", "ovs_interfaceid": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Successfully updated port: 5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:04:19 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:04:19 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "refresh_cache-5cea10bc-ac5a-48b0-b6b7-7db8f520339d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquired lock "refresh_cache-5cea10bc-ac5a-48b0-b6b7-7db8f520339d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:04:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-351421422',display_name='tempest-ServersNegativeTestJSON-server-351421422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-351421422',id=9,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a8561fb233b4571a47c188a1d9555dc',ramdisk_id='',reservation_id='r-mp6ehozx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-873263142',owner_user_name='tempest-ServersNegativeTestJSON-873263142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:04:18Z,user_data=None,user_id='fee6d4bd2fe04600a6962eeca70b0645',uuid=9a0fc135-ab9b-4b81-950d-84da9e99a422,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "address": "fa:16:3e:55:56:49", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982faaf3-9f", "ovs_interfaceid": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Converting VIF {"id": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "address": "fa:16:3e:55:56:49", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982faaf3-9f", "ovs_interfaceid": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:56:49,bridge_name='br-int',has_traffic_filtering=True,id=982faaf3-9f52-4af8-b2f7-18ecde4b280c,network=Network(1b405f0d-8443-4073-9a46-631015e6ac57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982faaf3-9f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.objects.instance [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a0fc135-ab9b-4b81-950d-84da9e99a422 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.compute.manager [req-29babfee-c5eb-49bc-aeae-2873c87e702a req-afa8dbfe-2099-44af-86e7-db4cfa2f1c9f service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received event network-changed-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.compute.manager [req-29babfee-c5eb-49bc-aeae-2873c87e702a req-afa8dbfe-2099-44af-86e7-db4cfa2f1c9f service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Refreshing instance network info cache due to event network-changed-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-29babfee-c5eb-49bc-aeae-2873c87e702a req-afa8dbfe-2099-44af-86e7-db4cfa2f1c9f service nova] Acquiring lock "refresh_cache-5cea10bc-ac5a-48b0-b6b7-7db8f520339d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:04:19 user nova-compute[74242]:   <uuid>9a0fc135-ab9b-4b81-950d-84da9e99a422</uuid>
Oct 20 02:04:19 user nova-compute[74242]:   <name>instance-00000009</name>
Oct 20 02:04:19 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:04:19 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:04:19 user nova-compute[74242]:   <metadata>
Oct 20 02:04:19 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:04:19 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:04:19 user nova-compute[74242]:       <nova:name>tempest-ServersNegativeTestJSON-server-351421422</nova:name>
Oct 20 02:04:19 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:04:19</nova:creationTime>
Oct 20 02:04:19 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:04:19 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:04:19 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:04:19 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:04:19 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:04:19 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:04:19 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:04:19 user nova-compute[74242]:       <nova:owner>
Oct 20 02:04:19 user nova-compute[74242]:         <nova:user uuid="fee6d4bd2fe04600a6962eeca70b0645">tempest-ServersNegativeTestJSON-873263142-project-member</nova:user>
Oct 20 02:04:19 user nova-compute[74242]:         <nova:project uuid="5a8561fb233b4571a47c188a1d9555dc">tempest-ServersNegativeTestJSON-873263142</nova:project>
Oct 20 02:04:19 user nova-compute[74242]:       </nova:owner>
Oct 20 02:04:19 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:04:19 user nova-compute[74242]:       <nova:ports>
Oct 20 02:04:19 user nova-compute[74242]:         <nova:port uuid="982faaf3-9f52-4af8-b2f7-18ecde4b280c">
Oct 20 02:04:19 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 02:04:19 user nova-compute[74242]:         </nova:port>
Oct 20 02:04:19 user nova-compute[74242]:       </nova:ports>
Oct 20 02:04:19 user nova-compute[74242]:     </nova:instance>
Oct 20 02:04:19 user nova-compute[74242]:   </metadata>
Oct 20 02:04:19 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:04:19 user nova-compute[74242]:     <system>
Oct 20 02:04:19 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:04:19 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:04:19 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:04:19 user nova-compute[74242]:       <entry name="serial">9a0fc135-ab9b-4b81-950d-84da9e99a422</entry>
Oct 20 02:04:19 user nova-compute[74242]:       <entry name="uuid">9a0fc135-ab9b-4b81-950d-84da9e99a422</entry>
Oct 20 02:04:19 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:04:19 user nova-compute[74242]:     </system>
Oct 20 02:04:19 user nova-compute[74242]:   </sysinfo>
Oct 20 02:04:19 user nova-compute[74242]:   <os>
Oct 20 02:04:19 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:04:19 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:04:19 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:04:19 user nova-compute[74242]:   </os>
Oct 20 02:04:19 user nova-compute[74242]:   <features>
Oct 20 02:04:19 user nova-compute[74242]:     <acpi/>
Oct 20 02:04:19 user nova-compute[74242]:     <apic/>
Oct 20 02:04:19 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:04:19 user nova-compute[74242]:   </features>
Oct 20 02:04:19 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:04:19 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:04:19 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:04:19 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:04:19 user nova-compute[74242]:   </clock>
Oct 20 02:04:19 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:04:19 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:04:19 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:04:19 user nova-compute[74242]:   </cpu>
Oct 20 02:04:19 user nova-compute[74242]:   <devices>
Oct 20 02:04:19 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:04:19 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:04:19 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk"/>
Oct 20 02:04:19 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:04:19 user nova-compute[74242]:     </disk>
Oct 20 02:04:19 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:04:19 user nova-compute[74242]:       <mac address="fa:16:3e:55:56:49"/>
Oct 20 02:04:19 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:04:19 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:04:19 user nova-compute[74242]:       <target dev="tap982faaf3-9f"/>
Oct 20 02:04:19 user nova-compute[74242]:     </interface>
Oct 20 02:04:19 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:04:19 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/console.log" append="off"/>
Oct 20 02:04:19 user nova-compute[74242]:     </serial>
Oct 20 02:04:19 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:04:19 user nova-compute[74242]:     <video>
Oct 20 02:04:19 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:04:19 user nova-compute[74242]:     </video>
Oct 20 02:04:19 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:04:19 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:04:19 user nova-compute[74242]:     </rng>
Oct 20 02:04:19 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:04:19 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:04:19 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:04:19 user nova-compute[74242]:     </memballoon>
Oct 20 02:04:19 user nova-compute[74242]:   </devices>
Oct 20 02:04:19 user nova-compute[74242]: </domain>
Oct 20 02:04:19 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:04:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-351421422',display_name='tempest-ServersNegativeTestJSON-server-351421422',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-351421422',id=9,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5a8561fb233b4571a47c188a1d9555dc',ramdisk_id='',reservation_id='r-mp6ehozx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-873263142',owner_user_name='tempest-ServersNegativeTestJSON-873263142-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:04:18Z,user_data=None,user_id='fee6d4bd2fe04600a6962eeca70b0645',uuid=9a0fc135-ab9b-4b81-950d-84da9e99a422,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "address": "fa:16:3e:55:56:49", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982faaf3-9f", "ovs_interfaceid": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Converting VIF {"id": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "address": "fa:16:3e:55:56:49", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982faaf3-9f", "ovs_interfaceid": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:56:49,bridge_name='br-int',has_traffic_filtering=True,id=982faaf3-9f52-4af8-b2f7-18ecde4b280c,network=Network(1b405f0d-8443-4073-9a46-631015e6ac57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982faaf3-9f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG os_vif [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:56:49,bridge_name='br-int',has_traffic_filtering=True,id=982faaf3-9f52-4af8-b2f7-18ecde4b280c,network=Network(1b405f0d-8443-4073-9a46-631015e6ac57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982faaf3-9f') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '62fd6573-a1d1-554a-98cf-939964805f8b', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap982faaf3-9f, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap982faaf3-9f, col_values=(('qos', UUID('71458b2f-772a-44ff-a74c-1c95d6811410')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap982faaf3-9f, col_values=(('external_ids', {'iface-id': '982faaf3-9f52-4af8-b2f7-18ecde4b280c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:56:49', 'vm-uuid': '9a0fc135-ab9b-4b81-950d-84da9e99a422'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:20 user nova-compute[74242]: INFO os_vif [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:56:49,bridge_name='br-int',has_traffic_filtering=True,id=982faaf3-9f52-4af8-b2f7-18ecde4b280c,network=Network(1b405f0d-8443-4073-9a46-631015e6ac57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982faaf3-9f')
Oct 20 02:04:20 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] No VIF found with MAC fa:16:3e:55:56:49, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Updating instance_info_cache with network_info: [{"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Releasing lock "refresh_cache-5cea10bc-ac5a-48b0-b6b7-7db8f520339d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Instance network_info: |[{"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-29babfee-c5eb-49bc-aeae-2873c87e702a req-afa8dbfe-2099-44af-86e7-db4cfa2f1c9f service nova] Acquired lock "refresh_cache-5cea10bc-ac5a-48b0-b6b7-7db8f520339d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG nova.network.neutron [req-29babfee-c5eb-49bc-aeae-2873c87e702a req-afa8dbfe-2099-44af-86e7-db4cfa2f1c9f service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Refreshing network info cache for port 5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:04:20 user sudo[85315]: pam_unix(sudo:session): session closed for user root
Oct 20 02:04:20 user nova-compute[74242]: INFO oslo.privsep.daemon [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Spawned new privsep daemon via rootwrap
Oct 20 02:04:20 user nova-compute[74242]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 20 02:04:20 user nova-compute[74242]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 20 02:04:20 user nova-compute[74242]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 20 02:04:20 user nova-compute[74242]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85329
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eb0625-5b16-4c96-90ea-a3f485ab3c45]: (2,) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG nova.network.neutron [req-1d4de7b9-b565-427b-aee1-604505e615cc req-2bda0ffa-cf59-460b-857c-308a7a182ccf service nova] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Updated VIF entry in instance network info cache for port 982faaf3-9f52-4af8-b2f7-18ecde4b280c. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG nova.network.neutron [req-1d4de7b9-b565-427b-aee1-604505e615cc req-2bda0ffa-cf59-460b-857c-308a7a182ccf service nova] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Updating instance_info_cache with network_info: [{"id": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "address": "fa:16:3e:55:56:49", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982faaf3-9f", "ovs_interfaceid": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1d4de7b9-b565-427b-aee1-604505e615cc req-2bda0ffa-cf59-460b-857c-308a7a182ccf service nova] Releasing lock "refresh_cache-9a0fc135-ab9b-4b81-950d-84da9e99a422" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a8a37d-f033-465c-83fe-005c5cf827fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:20 user nova-compute[74242]: WARNING os_brick.initiator.connectors.nvmeof [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd3db2c-495e-43ee-a2a5-098a4ab7c3c5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f4f494-cc58-4c49-bd08-022019efc91b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c976b6a-fac5-4fdb-b66e-01d7fc62a156]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:04:20 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[673e76ab-7798-465a-aeb7-c251603639c1]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG os_brick.utils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] <== get_connector_properties: return (2189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Updating existing volume attachment record: 5e6c82fb-d42c-4e65-bec3-3fbd6b720acf {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG nova.network.neutron [req-29babfee-c5eb-49bc-aeae-2873c87e702a req-afa8dbfe-2099-44af-86e7-db4cfa2f1c9f service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Updated VIF entry in instance network info cache for port 5fe0eca0-44d0-43d0-acc4-b34fa7126eaf. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG nova.network.neutron [req-29babfee-c5eb-49bc-aeae-2873c87e702a req-afa8dbfe-2099-44af-86e7-db4cfa2f1c9f service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Updating instance_info_cache with network_info: [{"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:04:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-29babfee-c5eb-49bc-aeae-2873c87e702a req-afa8dbfe-2099-44af-86e7-db4cfa2f1c9f service nova] Releasing lock "refresh_cache-5cea10bc-ac5a-48b0-b6b7-7db8f520339d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:04:21 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updating instance_info_cache with network_info: [{"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:04:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:04:21 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:04:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:22 user nova-compute[74242]: DEBUG nova.compute.manager [req-72f6e382-15e6-4569-b935-d1210a1aa607 req-18801f8d-a4a8-41ca-9033-6bf0ff94197f service nova] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Received event network-vif-plugged-982faaf3-9f52-4af8-b2f7-18ecde4b280c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-72f6e382-15e6-4569-b935-d1210a1aa607 req-18801f8d-a4a8-41ca-9033-6bf0ff94197f service nova] Acquiring lock "9a0fc135-ab9b-4b81-950d-84da9e99a422-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-72f6e382-15e6-4569-b935-d1210a1aa607 req-18801f8d-a4a8-41ca-9033-6bf0ff94197f service nova] Lock "9a0fc135-ab9b-4b81-950d-84da9e99a422-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-72f6e382-15e6-4569-b935-d1210a1aa607 req-18801f8d-a4a8-41ca-9033-6bf0ff94197f service nova] Lock "9a0fc135-ab9b-4b81-950d-84da9e99a422-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:22 user nova-compute[74242]: DEBUG nova.compute.manager [req-72f6e382-15e6-4569-b935-d1210a1aa607 req-18801f8d-a4a8-41ca-9033-6bf0ff94197f service nova] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] No waiting events found dispatching network-vif-plugged-982faaf3-9f52-4af8-b2f7-18ecde4b280c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:04:22 user nova-compute[74242]: WARNING nova.compute.manager [req-72f6e382-15e6-4569-b935-d1210a1aa607 req-18801f8d-a4a8-41ca-9033-6bf0ff94197f service nova] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Received unexpected event network-vif-plugged-982faaf3-9f52-4af8-b2f7-18ecde4b280c for instance with vm_state building and task_state spawning.
Oct 20 02:04:22 user nova-compute[74242]: DEBUG nova.compute.manager [req-b16fbdba-4aec-4b33-8197-cabefcb9eafe req-00575c04-ee20-40db-9d13-e42f12062369 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-changed-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:22 user nova-compute[74242]: DEBUG nova.compute.manager [req-b16fbdba-4aec-4b33-8197-cabefcb9eafe req-00575c04-ee20-40db-9d13-e42f12062369 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Refreshing instance network info cache due to event network-changed-daaa523c-866b-4afd-9e64-cd87cb820350. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:04:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b16fbdba-4aec-4b33-8197-cabefcb9eafe req-00575c04-ee20-40db-9d13-e42f12062369 service nova] Acquiring lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:04:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b16fbdba-4aec-4b33-8197-cabefcb9eafe req-00575c04-ee20-40db-9d13-e42f12062369 service nova] Acquired lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:04:22 user nova-compute[74242]: DEBUG nova.network.neutron [req-b16fbdba-4aec-4b33-8197-cabefcb9eafe req-00575c04-ee20-40db-9d13-e42f12062369 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Refreshing network info cache for port daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:04:22 user nova-compute[74242]: DEBUG nova.network.neutron [req-b16fbdba-4aec-4b33-8197-cabefcb9eafe req-00575c04-ee20-40db-9d13-e42f12062369 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updated VIF entry in instance network info cache for port daaa523c-866b-4afd-9e64-cd87cb820350. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:04:22 user nova-compute[74242]: DEBUG nova.network.neutron [req-b16fbdba-4aec-4b33-8197-cabefcb9eafe req-00575c04-ee20-40db-9d13-e42f12062369 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updating instance_info_cache with network_info: [{"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:04:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b16fbdba-4aec-4b33-8197-cabefcb9eafe req-00575c04-ee20-40db-9d13-e42f12062369 service nova] Releasing lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:04:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:24 user nova-compute[74242]: DEBUG nova.compute.manager [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:04:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:04:24 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Instance spawned successfully.
Oct 20 02:04:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:04:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-7e118147-5651-463c-8b05-de575da8ba38 req-bc3bac09-e017-46a6-855b-0d2a6dc5ec12 service nova] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Received event network-vif-plugged-982faaf3-9f52-4af8-b2f7-18ecde4b280c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7e118147-5651-463c-8b05-de575da8ba38 req-bc3bac09-e017-46a6-855b-0d2a6dc5ec12 service nova] Acquiring lock "9a0fc135-ab9b-4b81-950d-84da9e99a422-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7e118147-5651-463c-8b05-de575da8ba38 req-bc3bac09-e017-46a6-855b-0d2a6dc5ec12 service nova] Lock "9a0fc135-ab9b-4b81-950d-84da9e99a422-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7e118147-5651-463c-8b05-de575da8ba38 req-bc3bac09-e017-46a6-855b-0d2a6dc5ec12 service nova] Lock "9a0fc135-ab9b-4b81-950d-84da9e99a422-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-7e118147-5651-463c-8b05-de575da8ba38 req-bc3bac09-e017-46a6-855b-0d2a6dc5ec12 service nova] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] No waiting events found dispatching network-vif-plugged-982faaf3-9f52-4af8-b2f7-18ecde4b280c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:04:24 user nova-compute[74242]: WARNING nova.compute.manager [req-7e118147-5651-463c-8b05-de575da8ba38 req-bc3bac09-e017-46a6-855b-0d2a6dc5ec12 service nova] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Received unexpected event network-vif-plugged-982faaf3-9f52-4af8-b2f7-18ecde4b280c for instance with vm_state building and task_state spawning.
Oct 20 02:04:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:04:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:04:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:04:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:04:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:04:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:04:24 user nova-compute[74242]: INFO nova.compute.manager [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Took 6.15 seconds to spawn the instance on the hypervisor.
Oct 20 02:04:24 user nova-compute[74242]: DEBUG nova.compute.manager [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:04:24 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:04:24 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:04:24 user nova-compute[74242]: INFO nova.compute.manager [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Took 7.01 seconds to build instance.
Oct 20 02:04:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-785b082f-6d41-405d-b762-6bcf2c4ff390 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "9a0fc135-ab9b-4b81-950d-84da9e99a422" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.141s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:25 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:04:25 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:04:25 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:04:25 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:04:25 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:04:26 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:04:26 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:04:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:26 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:04:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Acquiring lock "b07619e3-0e20-4514-ba34-0340d72cfb54" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:28 user nova-compute[74242]: DEBUG nova.objects.instance [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lazy-loading 'flavor' on Instance uuid b07619e3-0e20-4514-ba34-0340d72cfb54 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:04:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.136s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Acquiring lock "b07619e3-0e20-4514-ba34-0340d72cfb54" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:29 user nova-compute[74242]: INFO nova.compute.manager [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Attaching volume 241a65d3-a325-4a17-96bc-0ea29d5c0345 to /dev/vdb
Oct 20 02:04:29 user nova-compute[74242]: DEBUG os_brick.utils [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f17a96-a463-4f89-9e71-83003fa49a5a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a676d376-4aac-4d6a-b61c-89263f436cc3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e87e0a1-652a-4324-a6d4-961db011acf1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c6db7ac-f36a-4ac8-9cff-d0d1a012da91]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:04:29 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bfd1b11-6a30-47fb-81a6-0957a6f437bd]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG os_brick.utils [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Updating existing volume attachment record: 6422b9ac-5bb8-48ab-a292-a199f11f6fdb {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:30 user nova-compute[74242]: INFO nova.compute.manager [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Shelving
Oct 20 02:04:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-617ea70c-b3e2-4ba9-9468-28fd48e0fbc3 req-f87aea1c-a5a0-4644-afce-79ebab569f6d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-vif-unplugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-617ea70c-b3e2-4ba9-9468-28fd48e0fbc3 req-f87aea1c-a5a0-4644-afce-79ebab569f6d service nova] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-617ea70c-b3e2-4ba9-9468-28fd48e0fbc3 req-f87aea1c-a5a0-4644-afce-79ebab569f6d service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-617ea70c-b3e2-4ba9-9468-28fd48e0fbc3 req-f87aea1c-a5a0-4644-afce-79ebab569f6d service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-617ea70c-b3e2-4ba9-9468-28fd48e0fbc3 req-f87aea1c-a5a0-4644-afce-79ebab569f6d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] No waiting events found dispatching network-vif-unplugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:04:30 user nova-compute[74242]: WARNING nova.compute.manager [req-617ea70c-b3e2-4ba9-9468-28fd48e0fbc3 req-f87aea1c-a5a0-4644-afce-79ebab569f6d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received unexpected event network-vif-unplugged-daaa523c-866b-4afd-9e64-cd87cb820350 for instance with vm_state active and task_state shelving.
Oct 20 02:04:31 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Instance destroyed successfully.
Oct 20 02:04:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.compute.manager [req-4a4a79f8-853a-4a08-a931-79ef705e9d83 req-8c0469b9-4fc3-4148-abd7-2fc6fc1a2e3d service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Received event network-changed-4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.compute.manager [req-4a4a79f8-853a-4a08-a931-79ef705e9d83 req-8c0469b9-4fc3-4148-abd7-2fc6fc1a2e3d service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Refreshing instance network info cache due to event network-changed-4e64f25c-d50c-4c69-950d-1bccc487367c. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4a4a79f8-853a-4a08-a931-79ef705e9d83 req-8c0469b9-4fc3-4148-abd7-2fc6fc1a2e3d service nova] Acquiring lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4a4a79f8-853a-4a08-a931-79ef705e9d83 req-8c0469b9-4fc3-4148-abd7-2fc6fc1a2e3d service nova] Acquired lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.network.neutron [req-4a4a79f8-853a-4a08-a931-79ef705e9d83 req-8c0469b9-4fc3-4148-abd7-2fc6fc1a2e3d service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Refreshing network info cache for port 4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:04:31 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:04:31 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7518MB free_disk=25.438880920410156GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:31 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Beginning cold snapshot process
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance af9f3d52-79f0-4ce0-9b14-3373b30c2b26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance b07619e3-0e20-4514-ba34-0340d72cfb54 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance ec8965b7-0f68-4445-bc29-a0584570de8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d87147b4-29ec-4e82-8525-b795647422bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d0231be7-4850-48ce-8757-fade8f3e4e25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 9a0fc135-ab9b-4b81-950d-84da9e99a422 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 5cea10bc-ac5a-48b0-b6b7-7db8f520339d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:04:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk /opt/stack/data/nova/instances/snapshots/tmpg44tv3dd/aa145a84d16743f58f2b4adff05d11db {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:32 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:04:32 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:04:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-4a4a79f8-853a-4a08-a931-79ef705e9d83 req-8c0469b9-4fc3-4148-abd7-2fc6fc1a2e3d service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updated VIF entry in instance network info cache for port 4e64f25c-d50c-4c69-950d-1bccc487367c. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:04:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-4a4a79f8-853a-4a08-a931-79ef705e9d83 req-8c0469b9-4fc3-4148-abd7-2fc6fc1a2e3d service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updating instance_info_cache with network_info: [{"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:04:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4a4a79f8-853a-4a08-a931-79ef705e9d83 req-8c0469b9-4fc3-4148-abd7-2fc6fc1a2e3d service nova] Releasing lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:04:32 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:04:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.709s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk /opt/stack/data/nova/instances/snapshots/tmpg44tv3dd/aa145a84d16743f58f2b4adff05d11db" returned: 0 in 0.721s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:32 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Snapshot extracted, beginning image upload
Oct 20 02:04:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-4a047dc1-766d-45e9-b8e3-e257e7f9e77e req-95a4af24-dbcc-4ce1-a970-8e76b32588fc service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4a047dc1-766d-45e9-b8e3-e257e7f9e77e req-95a4af24-dbcc-4ce1-a970-8e76b32588fc service nova] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4a047dc1-766d-45e9-b8e3-e257e7f9e77e req-95a4af24-dbcc-4ce1-a970-8e76b32588fc service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4a047dc1-766d-45e9-b8e3-e257e7f9e77e req-95a4af24-dbcc-4ce1-a970-8e76b32588fc service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-4a047dc1-766d-45e9-b8e3-e257e7f9e77e req-95a4af24-dbcc-4ce1-a970-8e76b32588fc service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] No waiting events found dispatching network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:04:32 user nova-compute[74242]: WARNING nova.compute.manager [req-4a047dc1-766d-45e9-b8e3-e257e7f9e77e req-95a4af24-dbcc-4ce1-a970-8e76b32588fc service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received unexpected event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 02:04:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:35 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:04:36 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Snapshot image upload complete
Oct 20 02:04:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:04:36 user nova-compute[74242]: INFO nova.compute.manager [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Shelve offloading
Oct 20 02:04:36 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Instance destroyed successfully.
Oct 20 02:04:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:04:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:04:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquired lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:04:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:04:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updating instance_info_cache with network_info: [{"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:04:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Releasing lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:04:37 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Instance destroyed successfully.
Oct 20 02:04:37 user nova-compute[74242]: DEBUG nova.objects.instance [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'resources' on Instance uuid 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-566546331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-566546331',id=2,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLO87wbKYFm5G333AGmDldzgoH1ghPEuADrWLYYKcEP5y09FucUxX6mOkAqUfawuywqPj6azEOJhzxEJ7NSj3401RT/fEXGW0wPMsz7zTIUQkpJLtSnWyr1NkameoGYCrA==',key_name='tempest-keypair-869078676',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:02:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a7a2695b5ad341e0afd133522f680bf9',ramdisk_id='',reservation_id='r-0l3toedx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-750275147',owner_user_name='tempest-AttachVolumeShelveTestJSON-750275147-project-member',shelved_at='2023-10-20T02:04:36.096598',shelved_host='user',shelved_image_id='1c6c8df7-4a35-476d-86a1-7cd5b38e82fc'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:04:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d6645596e24f24a216d2b4e7809073',uuid=90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converting VIF {"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=daaa523c-866b-4afd-9e64-cd87cb820350,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaaa523c-86') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG os_vif [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=daaa523c-866b-4afd-9e64-cd87cb820350,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaaa523c-86') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaaa523c-86, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97c198ba-097b-4ed8-a1ef-e73811c09d75) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-59a903b1-401d-46f5-8821-225449654d63 req-487b33cf-efc4-4136-91c7-5a8d16039a4d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-changed-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-59a903b1-401d-46f5-8821-225449654d63 req-487b33cf-efc4-4136-91c7-5a8d16039a4d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Refreshing instance network info cache due to event network-changed-daaa523c-866b-4afd-9e64-cd87cb820350. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-59a903b1-401d-46f5-8821-225449654d63 req-487b33cf-efc4-4136-91c7-5a8d16039a4d service nova] Acquiring lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-59a903b1-401d-46f5-8821-225449654d63 req-487b33cf-efc4-4136-91c7-5a8d16039a4d service nova] Acquired lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG nova.network.neutron [req-59a903b1-401d-46f5-8821-225449654d63 req-487b33cf-efc4-4136-91c7-5a8d16039a4d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Refreshing network info cache for port daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:04:37 user nova-compute[74242]: INFO os_vif [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=daaa523c-866b-4afd-9e64-cd87cb820350,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaaa523c-86')
Oct 20 02:04:37 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Deleting instance files /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36_del
Oct 20 02:04:37 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Deletion of /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36_del complete
Oct 20 02:04:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74242) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 20 02:04:37 user nova-compute[74242]: INFO nova.virt.libvirt.host [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] UEFI support detected
Oct 20 02:04:37 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Deleted allocations for instance 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36
Oct 20 02:04:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG nova.objects.instance [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'numa_topology' on Instance uuid 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG nova.objects.base [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Object Instance<90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36> lazy-loaded attributes: resources,numa_topology {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG nova.network.neutron [req-59a903b1-401d-46f5-8821-225449654d63 req-487b33cf-efc4-4136-91c7-5a8d16039a4d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updated VIF entry in instance network info cache for port daaa523c-866b-4afd-9e64-cd87cb820350. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG nova.network.neutron [req-59a903b1-401d-46f5-8821-225449654d63 req-487b33cf-efc4-4136-91c7-5a8d16039a4d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updating instance_info_cache with network_info: [{"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapdaaa523c-86", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-59a903b1-401d-46f5-8821-225449654d63 req-487b33cf-efc4-4136-91c7-5a8d16039a4d service nova] Releasing lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:04:37 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:04:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.407s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a13c0a7a-6a18-457c-9544-39ee426c8ad4 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.932s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:40 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:04:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:04:40 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Creating image(s)
Oct 20 02:04:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:04:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Ensure instance console log exists: /opt/stack/data/nova/instances/5cea10bc-ac5a-48b0-b6b7-7db8f520339d/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:04:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Start _get_guest_xml network_info=[{"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '5e6c82fb-d42c-4e65-bec3-3fbd6b720acf', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkyiaYHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5cea10bc-ac5a-48b0-b6b7-7db8f520339d', 'attached_at': '', 'detached_at': '', 'volume_id': '6e79478c-34db-431c-86df-ffa42a493f68', 'serial': '6e79478c-34db-431c-86df-ffa42a493f68'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:04:41 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:04:41 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connector [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Factory for ISCSI on None {{(pid=74242) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkyiaYHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:04:41 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:04:41 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:04:41 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fccf60-a327-4464-b7ef-924da21bf112]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:04:41 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6bd061-96a2-42eb-a864-4ed3a1180299]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68] added
Oct 20 02:04:41 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[30665c66-b19c-429b-badb-474e3c64a8ab]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cea5678-c187-4ef0-a216-484e35f8d535]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bkyiaYHc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bkyiaYHc" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6110b152-85c1-4e4a-a27d-9c8b185b093a]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bkyiaYHc'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a7a4157-0d1c-42d6-9c6d-67b9bd2bb509]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c90ec66-bdd5-4c4d-8005-dc4cd6ba9c4e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 02:04:41 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 02:04:41 user nova-compute[74242]:  {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:04:41 user nova-compute[74242]: WARNING os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 02:04:41 user nova-compute[74242]: 
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92a5bad-801d-4341-ac69-7b69ca3bf850]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260]
Oct 20 02:04:41 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260] successful.
Oct 20 02:04:41 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3550965b-080d-413c-a6aa-9bb29e979073]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1069128d-7fbc-4b32-b9c2-8e0db9f22315]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:04:41 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:04:41 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.247s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9f588e-033b-40a9-ae65-ab3200176e46]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:04:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkyiaYHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.279s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '26238343835356461', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238343835356461', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:04:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1398678858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1398678858',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByq2xkP/vLfwqbivLj0KOupEkRC+NVhYdkJQ+o9Ygk0jtRSmlqIS+Xl5BP30YNRKfmP8HR4R+7hEidAzKb1ATRlMuwuTOJ2xjm20F8owUQAX54yM4FHVtvIf38i+rcUgw==',key_name='tempest-keypair-522194978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='647e5ec77b024268af7209c8a0b73380',ramdisk_id='',reservation_id='r-sntnqamj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-320668090',owner_user_name='tempest-ServerActionsV293TestJSON-320668090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67ba274f41b04cbaa4cbfd77948bb7e6',uuid=5cea10bc-ac5a-48b0-b6b7-7db8f520339d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Converting VIF {"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=5fe0eca0-44d0-43d0-acc4-b34fa7126eaf,network=Network(ba22ead9-82b0-4d2e-82d8-851d65f25ab1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe0eca0-44') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG nova.objects.instance [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lazy-loading 'pci_devices' on Instance uuid 5cea10bc-ac5a-48b0-b6b7-7db8f520339d {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:04:42 user nova-compute[74242]:   <uuid>5cea10bc-ac5a-48b0-b6b7-7db8f520339d</uuid>
Oct 20 02:04:42 user nova-compute[74242]:   <name>instance-0000000a</name>
Oct 20 02:04:42 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:04:42 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:04:42 user nova-compute[74242]:   <metadata>
Oct 20 02:04:42 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:04:42 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:04:42 user nova-compute[74242]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1398678858</nova:name>
Oct 20 02:04:42 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:04:41</nova:creationTime>
Oct 20 02:04:42 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:04:42 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:04:42 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:04:42 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:04:42 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:04:42 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:04:42 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:04:42 user nova-compute[74242]:       <nova:owner>
Oct 20 02:04:42 user nova-compute[74242]:         <nova:user uuid="67ba274f41b04cbaa4cbfd77948bb7e6">tempest-ServerActionsV293TestJSON-320668090-project-member</nova:user>
Oct 20 02:04:42 user nova-compute[74242]:         <nova:project uuid="647e5ec77b024268af7209c8a0b73380">tempest-ServerActionsV293TestJSON-320668090</nova:project>
Oct 20 02:04:42 user nova-compute[74242]:       </nova:owner>
Oct 20 02:04:42 user nova-compute[74242]:       <nova:ports>
Oct 20 02:04:42 user nova-compute[74242]:         <nova:port uuid="5fe0eca0-44d0-43d0-acc4-b34fa7126eaf">
Oct 20 02:04:42 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 02:04:42 user nova-compute[74242]:         </nova:port>
Oct 20 02:04:42 user nova-compute[74242]:       </nova:ports>
Oct 20 02:04:42 user nova-compute[74242]:     </nova:instance>
Oct 20 02:04:42 user nova-compute[74242]:   </metadata>
Oct 20 02:04:42 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:04:42 user nova-compute[74242]:     <system>
Oct 20 02:04:42 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:04:42 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:04:42 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:04:42 user nova-compute[74242]:       <entry name="serial">5cea10bc-ac5a-48b0-b6b7-7db8f520339d</entry>
Oct 20 02:04:42 user nova-compute[74242]:       <entry name="uuid">5cea10bc-ac5a-48b0-b6b7-7db8f520339d</entry>
Oct 20 02:04:42 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:04:42 user nova-compute[74242]:     </system>
Oct 20 02:04:42 user nova-compute[74242]:   </sysinfo>
Oct 20 02:04:42 user nova-compute[74242]:   <os>
Oct 20 02:04:42 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:04:42 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:04:42 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:04:42 user nova-compute[74242]:   </os>
Oct 20 02:04:42 user nova-compute[74242]:   <features>
Oct 20 02:04:42 user nova-compute[74242]:     <acpi/>
Oct 20 02:04:42 user nova-compute[74242]:     <apic/>
Oct 20 02:04:42 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:04:42 user nova-compute[74242]:   </features>
Oct 20 02:04:42 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:04:42 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:04:42 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:04:42 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:04:42 user nova-compute[74242]:   </clock>
Oct 20 02:04:42 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:04:42 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:04:42 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:04:42 user nova-compute[74242]:   </cpu>
Oct 20 02:04:42 user nova-compute[74242]:   <devices>
Oct 20 02:04:42 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:04:42 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:04:42 user nova-compute[74242]:       <source dev="/dev/sdb"/>
Oct 20 02:04:42 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:04:42 user nova-compute[74242]:       <serial>6e79478c-34db-431c-86df-ffa42a493f68</serial>
Oct 20 02:04:42 user nova-compute[74242]:     </disk>
Oct 20 02:04:42 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:04:42 user nova-compute[74242]:       <mac address="fa:16:3e:ac:50:3a"/>
Oct 20 02:04:42 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:04:42 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:04:42 user nova-compute[74242]:       <target dev="tap5fe0eca0-44"/>
Oct 20 02:04:42 user nova-compute[74242]:     </interface>
Oct 20 02:04:42 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:04:42 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/5cea10bc-ac5a-48b0-b6b7-7db8f520339d/console.log" append="off"/>
Oct 20 02:04:42 user nova-compute[74242]:     </serial>
Oct 20 02:04:42 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:04:42 user nova-compute[74242]:     <video>
Oct 20 02:04:42 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:04:42 user nova-compute[74242]:     </video>
Oct 20 02:04:42 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:04:42 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:04:42 user nova-compute[74242]:     </rng>
Oct 20 02:04:42 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:04:42 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:04:42 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:04:42 user nova-compute[74242]:     </memballoon>
Oct 20 02:04:42 user nova-compute[74242]:   </devices>
Oct 20 02:04:42 user nova-compute[74242]: </domain>
Oct 20 02:04:42 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:04:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1398678858',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1398678858',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByq2xkP/vLfwqbivLj0KOupEkRC+NVhYdkJQ+o9Ygk0jtRSmlqIS+Xl5BP30YNRKfmP8HR4R+7hEidAzKb1ATRlMuwuTOJ2xjm20F8owUQAX54yM4FHVtvIf38i+rcUgw==',key_name='tempest-keypair-522194978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='647e5ec77b024268af7209c8a0b73380',ramdisk_id='',reservation_id='r-sntnqamj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-320668090',owner_user_name='tempest-ServerActionsV293TestJSON-320668090-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:04:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67ba274f41b04cbaa4cbfd77948bb7e6',uuid=5cea10bc-ac5a-48b0-b6b7-7db8f520339d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Converting VIF {"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=5fe0eca0-44d0-43d0-acc4-b34fa7126eaf,network=Network(ba22ead9-82b0-4d2e-82d8-851d65f25ab1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe0eca0-44') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG os_vif [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=5fe0eca0-44d0-43d0-acc4-b34fa7126eaf,network=Network(ba22ead9-82b0-4d2e-82d8-851d65f25ab1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe0eca0-44') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d05f2b9-f783-59ec-bff5-83c9c83bad4d', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fe0eca0-44, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5fe0eca0-44, col_values=(('qos', UUID('d2ef1968-57d0-46c1-b061-3c1372012472')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5fe0eca0-44, col_values=(('external_ids', {'iface-id': '5fe0eca0-44d0-43d0-acc4-b34fa7126eaf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:50:3a', 'vm-uuid': '5cea10bc-ac5a-48b0-b6b7-7db8f520339d'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:42 user nova-compute[74242]: INFO os_vif [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=5fe0eca0-44d0-43d0-acc4-b34fa7126eaf,network=Network(ba22ead9-82b0-4d2e-82d8-851d65f25ab1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe0eca0-44')
Oct 20 02:04:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:04:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] No VIF found with MAC fa:16:3e:ac:50:3a, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:04:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-2deecd96-ae41-457a-8725-861414de9edc req-507f940a-9b0b-4731-969d-af118220ebd2 service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received event network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2deecd96-ae41-457a-8725-861414de9edc req-507f940a-9b0b-4731-969d-af118220ebd2 service nova] Acquiring lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2deecd96-ae41-457a-8725-861414de9edc req-507f940a-9b0b-4731-969d-af118220ebd2 service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2deecd96-ae41-457a-8725-861414de9edc req-507f940a-9b0b-4731-969d-af118220ebd2 service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-2deecd96-ae41-457a-8725-861414de9edc req-507f940a-9b0b-4731-969d-af118220ebd2 service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] No waiting events found dispatching network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:04:44 user nova-compute[74242]: WARNING nova.compute.manager [req-2deecd96-ae41-457a-8725-861414de9edc req-507f940a-9b0b-4731-969d-af118220ebd2 service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received unexpected event network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf for instance with vm_state building and task_state spawning.
Oct 20 02:04:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-a05fd390-e550-4ab5-bd1e-358bcec56156 req-bed9e92d-a939-4683-99ed-6493e1d83530 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Received event network-changed-021be9fd-6020-4990-803f-08001190c668 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-a05fd390-e550-4ab5-bd1e-358bcec56156 req-bed9e92d-a939-4683-99ed-6493e1d83530 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Refreshing instance network info cache due to event network-changed-021be9fd-6020-4990-803f-08001190c668. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:04:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a05fd390-e550-4ab5-bd1e-358bcec56156 req-bed9e92d-a939-4683-99ed-6493e1d83530 service nova] Acquiring lock "refresh_cache-ec8965b7-0f68-4445-bc29-a0584570de8e" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:04:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a05fd390-e550-4ab5-bd1e-358bcec56156 req-bed9e92d-a939-4683-99ed-6493e1d83530 service nova] Acquired lock "refresh_cache-ec8965b7-0f68-4445-bc29-a0584570de8e" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:04:44 user nova-compute[74242]: DEBUG nova.network.neutron [req-a05fd390-e550-4ab5-bd1e-358bcec56156 req-bed9e92d-a939-4683-99ed-6493e1d83530 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Refreshing network info cache for port 021be9fd-6020-4990-803f-08001190c668 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:04:45 user nova-compute[74242]: DEBUG nova.network.neutron [req-a05fd390-e550-4ab5-bd1e-358bcec56156 req-bed9e92d-a939-4683-99ed-6493e1d83530 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Updated VIF entry in instance network info cache for port 021be9fd-6020-4990-803f-08001190c668. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:04:45 user nova-compute[74242]: DEBUG nova.network.neutron [req-a05fd390-e550-4ab5-bd1e-358bcec56156 req-bed9e92d-a939-4683-99ed-6493e1d83530 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Updating instance_info_cache with network_info: [{"id": "021be9fd-6020-4990-803f-08001190c668", "address": "fa:16:3e:4d:ba:d2", "network": {"id": "29396b47-375a-4974-a6cb-9b3dcf05dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1285119154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34d590ebe2f34743899f05f0ca0f53b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021be9fd-60", "ovs_interfaceid": "021be9fd-6020-4990-803f-08001190c668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:04:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a05fd390-e550-4ab5-bd1e-358bcec56156 req-bed9e92d-a939-4683-99ed-6493e1d83530 service nova] Releasing lock "refresh_cache-ec8965b7-0f68-4445-bc29-a0584570de8e" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:04:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-36c13016-1b9d-42ad-8e33-5715ac12d29c req-ebcbda2c-f8ee-496e-a8ad-e1960efa9f51 service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received event network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-36c13016-1b9d-42ad-8e33-5715ac12d29c req-ebcbda2c-f8ee-496e-a8ad-e1960efa9f51 service nova] Acquiring lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-36c13016-1b9d-42ad-8e33-5715ac12d29c req-ebcbda2c-f8ee-496e-a8ad-e1960efa9f51 service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-36c13016-1b9d-42ad-8e33-5715ac12d29c req-ebcbda2c-f8ee-496e-a8ad-e1960efa9f51 service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-36c13016-1b9d-42ad-8e33-5715ac12d29c req-ebcbda2c-f8ee-496e-a8ad-e1960efa9f51 service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] No waiting events found dispatching network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:04:46 user nova-compute[74242]: WARNING nova.compute.manager [req-36c13016-1b9d-42ad-8e33-5715ac12d29c req-ebcbda2c-f8ee-496e-a8ad-e1960efa9f51 service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received unexpected event network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf for instance with vm_state building and task_state spawning.
Oct 20 02:04:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:04:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:04:46 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Instance spawned successfully.
Oct 20 02:04:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:04:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:04:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:04:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:04:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:04:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:04:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:04:46 user nova-compute[74242]: INFO nova.compute.manager [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Took 5.39 seconds to spawn the instance on the hypervisor.
Oct 20 02:04:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:04:46 user nova-compute[74242]: INFO nova.compute.manager [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Took 29.09 seconds to build instance.
Oct 20 02:04:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9666a63b-c329-4809-94a6-34be4ada8d12 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 29.204s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChjGnQuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:04:48 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:04:48 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:04:48 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c97f5b6-2360-40ba-a81c-57b5921eda68]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:04:48 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e39e4388-d090-4c9f-a0dc-34262ca8d39f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345] added
Oct 20 02:04:48 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[15947d3a-2285-4512-bc35-2e5d64c2c65b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e99e03-8466-4e11-b5fe-6443cfb23c72]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChjGnQuT {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ChjGnQuT" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[01e2648b-b099-44c2-88cf-0b488048dc67]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ChjGnQuT'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f8ecf0-002c-431a-a72c-a2246db26475]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7006d0-aad1-4ca9-83c5-e3fcecc92ff5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:04:48 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:04:48 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[76052dae-726e-45e5-b09b-73862658bc51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345, portal: 172.16.0.220,3260]
Oct 20 02:04:48 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345, portal: 172.16.0.220,3260] successful.
Oct 20 02:04:48 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7cb293e-7115-4a29-8c4f-99774e4451cc]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[deeace36-464d-45b2-806d-fc05d824c556]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:04:48 user nova-compute[74242]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 (non-flash)
Oct 20 02:04:48 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:04:48 user nova-compute[74242]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 (non-flash)
Oct 20 02:04:48 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.317s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6030c208-c66e-4d2f-b04c-7dfee8fa7b9d]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-0a3e9285-9c5d-4c5f-aa5d-28850e527688 req-d219ccb0-4458-4371-b8f4-abee7c0d27ed service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Received event network-changed-0c67b16f-3a40-471a-a468-c1f15e5160af {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-0a3e9285-9c5d-4c5f-aa5d-28850e527688 req-d219ccb0-4458-4371-b8f4-abee7c0d27ed service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Refreshing instance network info cache due to event network-changed-0c67b16f-3a40-471a-a468-c1f15e5160af. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0a3e9285-9c5d-4c5f-aa5d-28850e527688 req-d219ccb0-4458-4371-b8f4-abee7c0d27ed service nova] Acquiring lock "refresh_cache-d87147b4-29ec-4e82-8525-b795647422bd" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0a3e9285-9c5d-4c5f-aa5d-28850e527688 req-d219ccb0-4458-4371-b8f4-abee7c0d27ed service nova] Acquired lock "refresh_cache-d87147b4-29ec-4e82-8525-b795647422bd" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG nova.network.neutron [req-0a3e9285-9c5d-4c5f-aa5d-28850e527688 req-d219ccb0-4458-4371-b8f4-abee7c0d27ed service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Refreshing network info cache for port 0c67b16f-3a40-471a-a468-c1f15e5160af {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:04:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Acquiring lock "d87147b4-29ec-4e82-8525-b795647422bd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Lock "d87147b4-29ec-4e82-8525-b795647422bd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG nova.objects.instance [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Lazy-loading 'flavor' on Instance uuid d87147b4-29ec-4e82-8525-b795647422bd {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Lock "d87147b4-29ec-4e82-8525-b795647422bd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG nova.network.neutron [req-0a3e9285-9c5d-4c5f-aa5d-28850e527688 req-d219ccb0-4458-4371-b8f4-abee7c0d27ed service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Updated VIF entry in instance network info cache for port 0c67b16f-3a40-471a-a468-c1f15e5160af. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG nova.network.neutron [req-0a3e9285-9c5d-4c5f-aa5d-28850e527688 req-d219ccb0-4458-4371-b8f4-abee7c0d27ed service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Updating instance_info_cache with network_info: [{"id": "0c67b16f-3a40-471a-a468-c1f15e5160af", "address": "fa:16:3e:78:da:eb", "network": {"id": "d271dbb4-e918-4562-b162-0ba34f9ed9e2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1682652744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef800f86ac45a4be04b234f72b43b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67b16f-3a", "ovs_interfaceid": "0c67b16f-3a40-471a-a468-c1f15e5160af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0a3e9285-9c5d-4c5f-aa5d-28850e527688 req-d219ccb0-4458-4371-b8f4-abee7c0d27ed service nova] Releasing lock "refresh_cache-d87147b4-29ec-4e82-8525-b795647422bd" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Acquiring lock "d87147b4-29ec-4e82-8525-b795647422bd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Lock "d87147b4-29ec-4e82-8525-b795647422bd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:49 user nova-compute[74242]: INFO nova.compute.manager [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Attaching volume 524e6cc6-d717-4a9b-8523-affb6e026ca3 to /dev/vdb
Oct 20 02:04:49 user nova-compute[74242]: DEBUG os_brick.utils [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0164297-9db6-4478-9610-be3b1303f92f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[321e924c-93d1-40ac-8752-7ee2e170a99f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddd0a79-b606-4d4e-8188-d75ec01f6349]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde70a03-3893-43c8-bb3d-ede722b6a3b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:04:49 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:04:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9689084f-ee60-47e0-b9c6-800c7d781038]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG os_brick.utils [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Updating existing volume attachment record: ec04e1b8-e8fc-4e12-8619-52d0da819f9d {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChjGnQuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '26563333662353737', 'path': '/dev/sdc'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26563333662353737', 'path': '/dev/sdc'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG nova.objects.instance [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lazy-loading 'flavor' on Instance uuid b07619e3-0e20-4514-ba34-0340d72cfb54 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:04:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:04:49 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:04:49 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:04:49 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:04:49 user nova-compute[74242]:   <serial>241a65d3-a325-4a17-96bc-0ea29d5c0345</serial>
Oct 20 02:04:49 user nova-compute[74242]: </disk>
Oct 20 02:04:49 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:04:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:04:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:04:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] No VIF found with MAC fa:16:3e:d1:6f:54, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:04:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7435f841-cf7f-4350-b4c8-0b257f5b6d46 tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.455s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "ec8965b7-0f68-4445-bc29-a0584570de8e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:50 user nova-compute[74242]: DEBUG nova.objects.instance [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lazy-loading 'flavor' on Instance uuid ec8965b7-0f68-4445-bc29-a0584570de8e {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.162s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "ec8965b7-0f68-4445-bc29-a0584570de8e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:51 user nova-compute[74242]: INFO nova.compute.manager [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Attaching volume 33fee36a-f75c-4b20-a0c8-a3098c28254d to /dev/sdc
Oct 20 02:04:51 user nova-compute[74242]: DEBUG os_brick.utils [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b544a7d5-f8d0-40db-8ced-d19cfacf4c53]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc8768a-1e03-49df-a1f3-354daa2f1c02]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e691068c-2735-4b77-9dc0-f70c9702f5ca]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[956dd82a-09d4-41dc-b2e6-babb6094ea43]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:04:51 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e63713-d1f5-4c24-a20c-ac23d414b756]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG os_brick.utils [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Updating existing volume attachment record: b42a8af4-9599-4f6d-9903-ec7479e374a2 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Acquiring lock "b07619e3-0e20-4514-ba34-0340d72cfb54" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Acquiring lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:51 user nova-compute[74242]: INFO nova.compute.manager [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Terminating instance
Oct 20 02:04:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-4705b8da-c9a2-462e-965a-a034e5bda36b req-0794f264-a413-489b-9651-288a16772cae service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received event network-vif-unplugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4705b8da-c9a2-462e-965a-a034e5bda36b req-0794f264-a413-489b-9651-288a16772cae service nova] Acquiring lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4705b8da-c9a2-462e-965a-a034e5bda36b req-0794f264-a413-489b-9651-288a16772cae service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4705b8da-c9a2-462e-965a-a034e5bda36b req-0794f264-a413-489b-9651-288a16772cae service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-4705b8da-c9a2-462e-965a-a034e5bda36b req-0794f264-a413-489b-9651-288a16772cae service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] No waiting events found dispatching network-vif-unplugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-4705b8da-c9a2-462e-965a-a034e5bda36b req-0794f264-a413-489b-9651-288a16772cae service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received event network-vif-unplugged-08118957-0151-44ee-af21-90f8606ec13b for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:52 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Instance destroyed successfully.
Oct 20 02:04:52 user nova-compute[74242]: DEBUG nova.objects.instance [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lazy-loading 'resources' on Instance uuid b07619e3-0e20-4514-ba34-0340d72cfb54 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:02:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1977573758',display_name='tempest-DeleteServersTestJSON-server-1977573758',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1977573758',id=3,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:02:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c21e1a86f7164259a0ebf3d7a0972e2c',ramdisk_id='',reservation_id='r-2qoqsixx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-374068335',owner_user_name='tempest-DeleteServersTestJSON-374068335-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:02:45Z,user_data=None,user_id='20389ce0a8a945a081f4edaceff1952b',uuid=b07619e3-0e20-4514-ba34-0340d72cfb54,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08118957-0151-44ee-af21-90f8606ec13b", "address": "fa:16:3e:d1:6f:54", "network": {"id": "688318e2-607f-48b5-b4f9-a504a17dc4f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1513569583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c21e1a86f7164259a0ebf3d7a0972e2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08118957-01", "ovs_interfaceid": "08118957-0151-44ee-af21-90f8606ec13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Converting VIF {"id": "08118957-0151-44ee-af21-90f8606ec13b", "address": "fa:16:3e:d1:6f:54", "network": {"id": "688318e2-607f-48b5-b4f9-a504a17dc4f8", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-1513569583-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c21e1a86f7164259a0ebf3d7a0972e2c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08118957-01", "ovs_interfaceid": "08118957-0151-44ee-af21-90f8606ec13b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:6f:54,bridge_name='br-int',has_traffic_filtering=True,id=08118957-0151-44ee-af21-90f8606ec13b,network=Network(688318e2-607f-48b5-b4f9-a504a17dc4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08118957-01') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_vif [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:6f:54,bridge_name='br-int',has_traffic_filtering=True,id=08118957-0151-44ee-af21-90f8606ec13b,network=Network(688318e2-607f-48b5-b4f9-a504a17dc4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08118957-01') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08118957-01, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d13c0c3c-fabc-4099-85c5-77c1185ca6fb) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:52 user nova-compute[74242]: INFO os_vif [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:6f:54,bridge_name='br-int',has_traffic_filtering=True,id=08118957-0151-44ee-af21-90f8606ec13b,network=Network(688318e2-607f-48b5-b4f9-a504a17dc4f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08118957-01')
Oct 20 02:04:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ChjGnQuT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:04:52 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6279775d-1842-4ea7-85d8-0301b5fb6d01]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:04:52 user nova-compute[74242]: No targets found.
Oct 20 02:04:52 user nova-compute[74242]: iSNS:
Oct 20 02:04:52 user nova-compute[74242]: No targets found.
Oct 20 02:04:52 user nova-compute[74242]: STATIC:
Oct 20 02:04:52 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345
Oct 20 02:04:52 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:04:52 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:04:52 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68
Oct 20 02:04:52 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:04:52 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:04:52 user nova-compute[74242]: FIRMWARE:
Oct 20 02:04:52 user nova-compute[74242]: No targets found.
Oct 20 02:04:52 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:04:52 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:04:52 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bf1307-c7ee-4184-a213-32bbec1d1941]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc208cb-5b83-4ab6-8f23-63120b74a732]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:04:52 user nova-compute[74242]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 (non-flash)
Oct 20 02:04:52 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:04:52 user nova-compute[74242]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 (non-flash)
Oct 20 02:04:52 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d018a680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345'): ({'sdc'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Removing single pathed devices sdc {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c122d392-828e-4fb4-824b-3dcfa3c89e02]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b495d6d0-1dc8-4452-a469-106a4e22e68a]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Flushing IO for device /dev/sdc {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb43a78-9b20-4744-be3d-0e7d78d9629b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a91bb4-8c9f-45dd-9485-d72efc22a587]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ff0020-bead-4815-9e23-db8f45463d87]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[423185ca-580f-476a-a263-e0f6387b990c]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345, portal: 172.16.0.220,3260]
Oct 20 02:04:53 user nova-compute[74242]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345, portal: 172.16.0.220,3260] successful.
Oct 20 02:04:53 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:241a65d3-a325-4a17-96bc-0ea29d5c0345 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5ee9a4-ebeb-4221-879a-8012bdd75187]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] <== disconnect_volume: return (379ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:04:53 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Deleting instance files /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54_del
Oct 20 02:04:53 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Deletion of /opt/stack/data/nova/instances/b07619e3-0e20-4514-ba34-0340d72cfb54_del complete
Oct 20 02:04:53 user nova-compute[74242]: INFO nova.compute.manager [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Took 1.37 seconds to destroy the instance on the hypervisor.
Oct 20 02:04:53 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:53 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:04:53 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Took 0.77 seconds to deallocate network for instance.
Oct 20 02:04:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received event network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] Acquiring lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] No waiting events found dispatching network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:04:54 user nova-compute[74242]: WARNING nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received unexpected event network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b for instance with vm_state active and task_state deleting.
Oct 20 02:04:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received event network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] Acquiring lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] No waiting events found dispatching network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:04:54 user nova-compute[74242]: WARNING nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received unexpected event network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b for instance with vm_state active and task_state deleting.
Oct 20 02:04:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received event network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] Acquiring lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] No waiting events found dispatching network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:04:54 user nova-compute[74242]: WARNING nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received unexpected event network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b for instance with vm_state active and task_state deleting.
Oct 20 02:04:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received event network-vif-unplugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] Acquiring lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] No waiting events found dispatching network-vif-unplugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received event network-vif-unplugged-08118957-0151-44ee-af21-90f8606ec13b for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received event network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] Acquiring lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] No waiting events found dispatching network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:04:54 user nova-compute[74242]: WARNING nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received unexpected event network-vif-plugged-08118957-0151-44ee-af21-90f8606ec13b for instance with vm_state active and task_state deleting.
Oct 20 02:04:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-4c9f5299-8a52-4820-8df8-b0bd26c055a8 req-e0baa758-018f-4dfb-bc96-a6565fb2c85b service nova] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Received event network-vif-deleted-08118957-0151-44ee-af21-90f8606ec13b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:54 user nova-compute[74242]: INFO nova.compute.manager [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] [instance: b07619e3-0e20-4514-ba34-0340d72cfb54] Took 1.01 seconds to detach 1 volumes for instance.
Oct 20 02:04:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:55 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:04:55 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:04:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:55 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Deleted allocations for instance b07619e3-0e20-4514-ba34-0340d72cfb54
Oct 20 02:04:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-12412809-db9f-467a-86df-cc38d185093a tempest-DeleteServersTestJSON-374068335 tempest-DeleteServersTestJSON-374068335-project-member] Lock "b07619e3-0e20-4514-ba34-0340d72cfb54" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.798s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "1e23c60d-f373-431e-952e-600b9b5d6ea2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "1e23c60d-f373-431e-952e-600b9b5d6ea2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:04:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:04:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:04:56 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:04:56 user nova-compute[74242]: INFO nova.compute.claims [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Claim successful on node user
Oct 20 02:04:57 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:04:57 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:04:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:04:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:04:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:04:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:04:57 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:04:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:04:57 user nova-compute[74242]: INFO nova.virt.block_device [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Booting with volume snapshot 9e7a88ec-ba10-46cc-a8ed-d0ad977af2a3 at /dev/vda
Oct 20 02:04:57 user nova-compute[74242]: DEBUG nova.policy [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00ea297f598040fbb338b9ab2e1a1d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e137c75824d7429585ddd2245f86a6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:04:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Successfully created port: 0f970626-ca00-4d2c-a588-4d5c703fdad4 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:04:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Successfully updated port: 0f970626-ca00-4d2c-a588-4d5c703fdad4 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:04:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "refresh_cache-1e23c60d-f373-431e-952e-600b9b5d6ea2" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:04:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquired lock "refresh_cache-1e23c60d-f373-431e-952e-600b9b5d6ea2" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:04:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:04:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-839d4692-d978-446e-841e-6189e32def94 req-8de2c07f-238c-4135-9957-ac95fcc3b205 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Received event network-changed-0f970626-ca00-4d2c-a588-4d5c703fdad4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:04:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-839d4692-d978-446e-841e-6189e32def94 req-8de2c07f-238c-4135-9957-ac95fcc3b205 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Refreshing instance network info cache due to event network-changed-0f970626-ca00-4d2c-a588-4d5c703fdad4. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:04:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-839d4692-d978-446e-841e-6189e32def94 req-8de2c07f-238c-4135-9957-ac95fcc3b205 service nova] Acquiring lock "refresh_cache-1e23c60d-f373-431e-952e-600b9b5d6ea2" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:04:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:04:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Updating instance_info_cache with network_info: [{"id": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "address": "fa:16:3e:26:60:91", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f970626-ca", "ovs_interfaceid": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:04:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:04:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Releasing lock "refresh_cache-1e23c60d-f373-431e-952e-600b9b5d6ea2" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:04:58 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Instance network_info: |[{"id": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "address": "fa:16:3e:26:60:91", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f970626-ca", "ovs_interfaceid": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:04:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-839d4692-d978-446e-841e-6189e32def94 req-8de2c07f-238c-4135-9957-ac95fcc3b205 service nova] Acquired lock "refresh_cache-1e23c60d-f373-431e-952e-600b9b5d6ea2" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:04:58 user nova-compute[74242]: DEBUG nova.network.neutron [req-839d4692-d978-446e-841e-6189e32def94 req-8de2c07f-238c-4135-9957-ac95fcc3b205 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Refreshing network info cache for port 0f970626-ca00-4d2c-a588-4d5c703fdad4 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:04:59 user nova-compute[74242]: DEBUG nova.network.neutron [req-839d4692-d978-446e-841e-6189e32def94 req-8de2c07f-238c-4135-9957-ac95fcc3b205 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Updated VIF entry in instance network info cache for port 0f970626-ca00-4d2c-a588-4d5c703fdad4. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:04:59 user nova-compute[74242]: DEBUG nova.network.neutron [req-839d4692-d978-446e-841e-6189e32def94 req-8de2c07f-238c-4135-9957-ac95fcc3b205 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Updating instance_info_cache with network_info: [{"id": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "address": "fa:16:3e:26:60:91", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f970626-ca", "ovs_interfaceid": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:04:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-839d4692-d978-446e-841e-6189e32def94 req-8de2c07f-238c-4135-9957-ac95fcc3b205 service nova] Releasing lock "refresh_cache-1e23c60d-f373-431e-952e-600b9b5d6ea2" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:05:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG os_brick.utils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd06690-8c8b-4b3b-93ff-5f43387cd854]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.056s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a591066d-a2c3-4788-8ed8-76fbfa9a0b50]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4786e9-8c93-48db-bdae-7952d5e85a0f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a29986-ce54-4d43-bef2-be768405a6a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:05:03 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:05:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[72d4b1a5-e816-41c7-9f5e-9f0f5d912427]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG os_brick.utils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== get_connector_properties: return (254ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Updating existing volume attachment record: f77080b7-090c-40f6-a4ea-604bf3c02c6c {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:05:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVCElZQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:05:07 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:05:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:05:07 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:05:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:05:07 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2b9d08-22b6-405d-9d18-40f57c135f3f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:05:07 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1602eccf-5b5f-4009-84e7-92ef4e01405a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3] added
Oct 20 02:05:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0fddc2-1db0-4858-8522-5ec43f826ab2]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3638c634-799c-4f19-b0fc-2cb8c80ef835]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVCElZQt {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RVCElZQt" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc9ca48-6171-4d1a-a0ef-b9a2f512c825]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RVCElZQt'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d1814f-01e4-459d-8b8d-80483f6e7835]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f080b699-f0e5-4cc3-af1c-516ae669667c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:08 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:08 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89c1f83-c081-4e88-95ac-815a72b5474d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3, portal: 172.16.0.220,3260]
Oct 20 02:05:08 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3, portal: 172.16.0.220,3260] successful.
Oct 20 02:05:08 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[80915842-427c-4eea-a17e-df30759b9ca1]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea64108f-31c3-4f69-a9ef-6e1057f47dd6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:08 user nova-compute[74242]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)
Oct 20 02:05:08 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:08 user nova-compute[74242]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)
Oct 20 02:05:08 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f446260-64a8-40d1-b1e3-ca7bcfd9be8e]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVCElZQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:05:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:05:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '23164313830343631', 'path': '/dev/sdc'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:05:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23164313830343631', 'path': '/dev/sdc'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:05:09 user nova-compute[74242]: DEBUG nova.objects.instance [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Lazy-loading 'flavor' on Instance uuid d87147b4-29ec-4e82-8525-b795647422bd {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:05:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] attach device xml: <disk type="block" device="disk">
Oct 20 02:05:09 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:05:09 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:05:09 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:05:09 user nova-compute[74242]:   <serial>524e6cc6-d717-4a9b-8523-affb6e026ca3</serial>
Oct 20 02:05:09 user nova-compute[74242]: </disk>
Oct 20 02:05:09 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:05:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:05:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:05:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] No VIF found with MAC fa:16:3e:78:da:eb, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:05:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7f72321f-93de-4e31-9dd7-21f675017ef9 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Lock "d87147b4-29ec-4e82-8525-b795647422bd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.352s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f7f8f4a-5b73-4118-8f50-664c7d224e1d tempest-VolumesAssistedSnapshotsTest-191166634 tempest-VolumesAssistedSnapshotsTest-191166634-project] [instance: d87147b4-29ec-4e82-8525-b795647422bd] volume_snapshot_create: create_info: {'snapshot_id': '8da691e9-b758-4e89-b488-fe3df571a5d8', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74242) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f7f8f4a-5b73-4118-8f50-664c7d224e1d tempest-VolumesAssistedSnapshotsTest-191166634 tempest-VolumesAssistedSnapshotsTest-191166634-project] [instance: d87147b4-29ec-4e82-8525-b795647422bd] snap xml: <domainsnapshot>
Oct 20 02:05:10 user nova-compute[74242]:   <disks>
Oct 20 02:05:10 user nova-compute[74242]:     <disk name="/dev/sdc" snapshot="external" type="file">
Oct 20 02:05:10 user nova-compute[74242]:       <source file="/dev/new_file"/>
Oct 20 02:05:10 user nova-compute[74242]:     </disk>
Oct 20 02:05:10 user nova-compute[74242]:     <disk name="vda" snapshot="no"/>
Oct 20 02:05:10 user nova-compute[74242]:   </disks>
Oct 20 02:05:10 user nova-compute[74242]: </domainsnapshot>
Oct 20 02:05:10 user nova-compute[74242]:  {{(pid=74242) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1f7f8f4a-5b73-4118-8f50-664c7d224e1d tempest-VolumesAssistedSnapshotsTest-191166634 tempest-VolumesAssistedSnapshotsTest-191166634-project] Lazy-loading 'system_metadata' on Instance uuid d87147b4-29ec-4e82-8525-b795647422bd {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:05:10 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1f7f8f4a-5b73-4118-8f50-664c7d224e1d tempest-VolumesAssistedSnapshotsTest-191166634 tempest-VolumesAssistedSnapshotsTest-191166634-project] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [None req-1f7f8f4a-5b73-4118-8f50-664c7d224e1d tempest-VolumesAssistedSnapshotsTest-191166634 tempest-VolumesAssistedSnapshotsTest-191166634-project] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd] Traceback (most recent call last):
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     rv = execute(f, *args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     six.reraise(c, e, tb)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     raise value
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     rv = meth(*args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd] 
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [None req-1f7f8f4a-5b73-4118-8f50-664c7d224e1d tempest-VolumesAssistedSnapshotsTest-191166634 tempest-VolumesAssistedSnapshotsTest-191166634-project] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd] Traceback (most recent call last):
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     self._volume_snapshot_create(context, instance, guest,
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     rv = execute(f, *args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     six.reraise(c, e, tb)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     raise value
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     rv = meth(*args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd] 
Oct 20 02:05:10 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-6af67943-b9bd-4ba6-856d-3d829b27cbd1 tempest-VolumesAssistedSnapshotsTest-191166634 tempest-VolumesAssistedSnapshotsTest-191166634-project] [instance: d87147b4-29ec-4e82-8525-b795647422bd] volume_snapshot_delete: delete_info: {'volume_id': '524e6cc6-d717-4a9b-8523-affb6e026ca3'} {{(pid=74242) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [None req-6af67943-b9bd-4ba6-856d-3d829b27cbd1 tempest-VolumesAssistedSnapshotsTest-191166634 tempest-VolumesAssistedSnapshotsTest-191166634-project] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd] Traceback (most recent call last):
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd]     if delete_info['type'] != 'qcow2':
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd] KeyError: 'type'
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [instance: d87147b4-29ec-4e82-8525-b795647422bd] 
Oct 20 02:05:10 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNYITKEq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:05:10 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:05:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:05:10 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:05:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:05:10 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [None req-1f7f8f4a-5b73-4118-8f50-664c7d224e1d tempest-VolumesAssistedSnapshotsTest-191166634 tempest-VolumesAssistedSnapshotsTest-191166634-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 8da691e9-b758-4e89-b488-fe3df571a5d8 could not be found.
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     raise value
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver 
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver 
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 8da691e9-b758-4e89-b488-fe3df571a5d8 could not be found. (HTTP 404) (Request-ID: req-561eb349-cfcd-423b-8c77-9f8fd31b0143)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver 
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver 
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 8da691e9-b758-4e89-b488-fe3df571a5d8 could not be found.
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver 
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2fc908-d507-457f-ad26-d9b79f9c68f9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver [None req-6af67943-b9bd-4ba6-856d-3d829b27cbd1 tempest-VolumesAssistedSnapshotsTest-191166634 tempest-VolumesAssistedSnapshotsTest-191166634-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver 
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver 
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-d7467ed9-dcd8-475c-990c-2968e4dda464)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver 
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver 
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 20 02:05:10 user nova-compute[74242]: ERROR nova.virt.libvirt.driver 
Oct 20 02:05:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:05:10 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server [None req-1f7f8f4a-5b73-4118-8f50-664c7d224e1d tempest-VolumesAssistedSnapshotsTest-191166634 tempest-VolumesAssistedSnapshotsTest-191166634-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     raise value
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server 
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server [None req-6af67943-b9bd-4ba6-856d-3d829b27cbd1 tempest-VolumesAssistedSnapshotsTest-191166634 tempest-VolumesAssistedSnapshotsTest-191166634-project] Exception during message handling: KeyError: 'type'
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 20 02:05:10 user nova-compute[74242]: ERROR oslo_messaging.rpc.server 
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1ba1fa-0c8d-441b-9660-b4988d4c0ea1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d] added
Oct 20 02:05:10 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca6ba28-f281-4eb4-935e-390c10e7c387]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dc1ef84-f22f-4efa-95e1-2d3427aa97c9]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sNYITKEq {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sNYITKEq" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff89ebfe-9fab-42ea-8781-57190ea997cd]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sNYITKEq'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e35c32e-1a1d-465c-b600-22d5d78ae64c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab4032cb-4c35-4a96-89b0-fcf7c9ecd2eb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:10 user nova-compute[74242]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)
Oct 20 02:05:10 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:10 user nova-compute[74242]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)
Oct 20 02:05:10 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Acquiring lock "d87147b4-29ec-4e82-8525-b795647422bd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Lock "d87147b4-29ec-4e82-8525-b795647422bd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --login" returned: 0 in 0.096s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7dccc4-f7a8-4e61-9863-1ad7ddf06a9d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d, portal: 172.16.0.220,3260]
Oct 20 02:05:10 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d, portal: 172.16.0.220,3260] successful.
Oct 20 02:05:10 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:11 user nova-compute[74242]: INFO nova.compute.manager [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Detaching volume 524e6cc6-d717-4a9b-8523-affb6e026ca3
Oct 20 02:05:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b3c33ea-b6db-4a69-b7a0-ad43f7ba3086]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d404c87-d187-49e2-b866-3a6b6a28c0e6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:11 user nova-compute[74242]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)
Oct 20 02:05:11 user nova-compute[74242]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d (non-flash)
Oct 20 02:05:11 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:11 user nova-compute[74242]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)
Oct 20 02:05:11 user nova-compute[74242]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d (non-flash)
Oct 20 02:05:11 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f5453e-ee8e-4f8a-8697-3b4f796f3f2b]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:05:11 user nova-compute[74242]: INFO nova.virt.block_device [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Attempting to driver detach volume 524e6cc6-d717-4a9b-8523-affb6e026ca3 from mountpoint /dev/vdb
Oct 20 02:05:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Attempting to detach device vdb from instance d87147b4-29ec-4e82-8525-b795647422bd from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 02:05:11 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:05:11 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:05:11 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:05:11 user nova-compute[74242]:   <serial>524e6cc6-d717-4a9b-8523-affb6e026ca3</serial>
Oct 20 02:05:11 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:05:11 user nova-compute[74242]: </disk>
Oct 20 02:05:11 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:05:11 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Successfully detached device vdb from instance d87147b4-29ec-4e82-8525-b795647422bd from the persistent domain config.
Oct 20 02:05:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d87147b4-29ec-4e82-8525-b795647422bd from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] detach device xml: <disk type="block" device="disk">
Oct 20 02:05:11 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:05:11 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:05:11 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:05:11 user nova-compute[74242]:   <serial>524e6cc6-d717-4a9b-8523-affb6e026ca3</serial>
Oct 20 02:05:11 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:05:11 user nova-compute[74242]: </disk>
Oct 20 02:05:11 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:05:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d87147b4-29ec-4e82-8525-b795647422bd {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:05:12 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:05:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNYITKEq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:05:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.443s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:05:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] <== connect_volume: return (1444ms) {'type': 'block', 'scsi_wwn': '26663393635343136', 'path': '/dev/sdd'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:05:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26663393635343136', 'path': '/dev/sdd'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:05:12 user nova-compute[74242]: DEBUG nova.objects.instance [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lazy-loading 'flavor' on Instance uuid ec8965b7-0f68-4445-bc29-a0584570de8e {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:05:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:05:12 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:05:12 user nova-compute[74242]:   <source dev="/dev/sdd"/>
Oct 20 02:05:12 user nova-compute[74242]:   <target dev="sdc" bus="scsi"/>
Oct 20 02:05:12 user nova-compute[74242]:   <serial>33fee36a-f75c-4b20-a0c8-a3098c28254d</serial>
Oct 20 02:05:12 user nova-compute[74242]:   <address type="drive" controller="0" unit="2"/>
Oct 20 02:05:12 user nova-compute[74242]: </disk>
Oct 20 02:05:12 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:05:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] No BDM found with device name sda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:05:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:05:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:05:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] No VIF found with MAC fa:16:3e:4d:ba:d2, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:05:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a8c46e44-42a2-4cd4-b3f3-bb58499bdbc6 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.530s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "ec8965b7-0f68-4445-bc29-a0584570de8e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:13 user nova-compute[74242]: INFO nova.compute.manager [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Detaching volume 33fee36a-f75c-4b20-a0c8-a3098c28254d
Oct 20 02:05:13 user nova-compute[74242]: INFO nova.virt.block_device [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Attempting to driver detach volume 33fee36a-f75c-4b20-a0c8-a3098c28254d from mountpoint /dev/sdc
Oct 20 02:05:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Attempting to detach device sdc from instance ec8965b7-0f68-4445-bc29-a0584570de8e from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:05:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:05:13 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:05:13 user nova-compute[74242]:   <source dev="/dev/sdd"/>
Oct 20 02:05:13 user nova-compute[74242]:   <target dev="sdc" bus="scsi"/>
Oct 20 02:05:13 user nova-compute[74242]:   <serial>33fee36a-f75c-4b20-a0c8-a3098c28254d</serial>
Oct 20 02:05:13 user nova-compute[74242]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 02:05:13 user nova-compute[74242]: </disk>
Oct 20 02:05:13 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:05:13 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Successfully detached device sdc from instance ec8965b7-0f68-4445-bc29-a0584570de8e from the persistent domain config.
Oct 20 02:05:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance ec8965b7-0f68-4445-bc29-a0584570de8e from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:05:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:05:13 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:05:13 user nova-compute[74242]:   <source dev="/dev/sdd"/>
Oct 20 02:05:13 user nova-compute[74242]:   <target dev="sdc" bus="scsi"/>
Oct 20 02:05:13 user nova-compute[74242]:   <serial>33fee36a-f75c-4b20-a0c8-a3098c28254d</serial>
Oct 20 02:05:13 user nova-compute[74242]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 20 02:05:13 user nova-compute[74242]: </disk>
Oct 20 02:05:13 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:05:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:14 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance ec8965b7-0f68-4445-bc29-a0584570de8e {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:05:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:17 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:05:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:05:17 user nova-compute[74242]: INFO nova.compute.claims [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Claim successful on node user
Oct 20 02:05:18 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.428s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:05:18 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:05:18 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:05:18 user nova-compute[74242]: INFO nova.virt.block_device [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Booting with volume 90ae876e-4e5a-4a4a-8bb0-e98910d1c67e at /dev/vda
Oct 20 02:05:18 user nova-compute[74242]: DEBUG nova.policy [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1691c4936b8d40a4a316785d7b19f2d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '934523cf034040e2bc013e8469759699', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG os_brick.utils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b77a39-8e0a-4dd3-8e85-e07339c4faf8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b2d94d-8d24-482c-8f70-4abaf2b88359]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[673f32bf-ff9a-42ee-8983-25072a57a5e1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f305f863-2943-407b-8941-34951d4479c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:05:18 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:05:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f9a803-7546-4692-b883-d385712156e8]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG os_brick.utils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:05:18 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updating existing volume attachment record: 598cde26-32f3-4fdd-9fbd-e84e36c82bbc {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:05:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:19 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Successfully created port: c809bd71-9a30-4d1c-9884-b2881cd21f70 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:05:20 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Successfully created port: 67449c80-5905-4656-9c55-45460e214374 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:05:21 user nova-compute[74242]: DEBUG nova.compute.manager [req-fb1e3d12-987e-4d8c-9c8d-200fc43acc1b req-0d483a17-13b4-4f00-90f2-53a95c9388ae service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received event network-changed-7575478b-29e4-493e-a04f-0e3747a5c64a {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:21 user nova-compute[74242]: DEBUG nova.compute.manager [req-fb1e3d12-987e-4d8c-9c8d-200fc43acc1b req-0d483a17-13b4-4f00-90f2-53a95c9388ae service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Refreshing instance network info cache due to event network-changed-7575478b-29e4-493e-a04f-0e3747a5c64a. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:05:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fb1e3d12-987e-4d8c-9c8d-200fc43acc1b req-0d483a17-13b4-4f00-90f2-53a95c9388ae service nova] Acquiring lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:05:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fb1e3d12-987e-4d8c-9c8d-200fc43acc1b req-0d483a17-13b4-4f00-90f2-53a95c9388ae service nova] Acquired lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:05:21 user nova-compute[74242]: DEBUG nova.network.neutron [req-fb1e3d12-987e-4d8c-9c8d-200fc43acc1b req-0d483a17-13b4-4f00-90f2-53a95c9388ae service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Refreshing network info cache for port 7575478b-29e4-493e-a04f-0e3747a5c64a {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:05:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "interface-e22cb246-155d-48f5-9eee-bd543c0bbaf1-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "interface-e22cb246-155d-48f5-9eee-bd543c0bbaf1-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:21 user nova-compute[74242]: DEBUG nova.objects.instance [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lazy-loading 'flavor' on Instance uuid e22cb246-155d-48f5-9eee-bd543c0bbaf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:05:21 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Successfully created port: ebac74b9-c5ad-48b8-8b0a-370831dbd710 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:05:21 user nova-compute[74242]: DEBUG nova.network.neutron [req-fb1e3d12-987e-4d8c-9c8d-200fc43acc1b req-0d483a17-13b4-4f00-90f2-53a95c9388ae service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Updated VIF entry in instance network info cache for port 7575478b-29e4-493e-a04f-0e3747a5c64a. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:05:21 user nova-compute[74242]: DEBUG nova.network.neutron [req-fb1e3d12-987e-4d8c-9c8d-200fc43acc1b req-0d483a17-13b4-4f00-90f2-53a95c9388ae service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Updating instance_info_cache with network_info: [{"id": "7575478b-29e4-493e-a04f-0e3747a5c64a", "address": "fa:16:3e:86:90:03", "network": {"id": "bba69f21-fd72-478c-8f16-a8fcd9b41e96", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1592153998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7575478b-29", "ovs_interfaceid": "7575478b-29e4-493e-a04f-0e3747a5c64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:05:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fb1e3d12-987e-4d8c-9c8d-200fc43acc1b req-0d483a17-13b4-4f00-90f2-53a95c9388ae service nova] Releasing lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.objects.instance [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lazy-loading 'pci_requests' on Instance uuid e22cb246-155d-48f5-9eee-bd543c0bbaf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.objects.base [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Object Instance<e22cb246-155d-48f5-9eee-bd543c0bbaf1> lazy-loaded attributes: flavor,pci_requests {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.network.neutron [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:05:22 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Creating image(s)
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Ensure instance console log exists: /opt/stack/data/nova/instances/1e23c60d-f373-431e-952e-600b9b5d6ea2/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Start _get_guest_xml network_info=[{"id": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "address": "fa:16:3e:26:60:91", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f970626-ca", "ovs_interfaceid": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'f77080b7-090c-40f6-a4ea-604bf3c02c6c', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVvcwhTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1e23c60d-f373-431e-952e-600b9b5d6ea2', 'attached_at': '', 'detached_at': '', 'volume_id': '52b084a0-3032-4c29-846e-066ece9918c7', 'serial': '52b084a0-3032-4c29-846e-066ece9918c7'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:05:22 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:05:22 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVvcwhTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:05:22 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:05:22 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:05:22 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4feb57d4-d89d-421c-b623-675dccab9608]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:05:22 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1bb656-4d05-47d5-b11f-0f1b4a12240d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7] added
Oct 20 02:05:22 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.policy [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e81797a2a7a744fa8298b767cf469631', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28a8e047fa564263971543d6342579b1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f63ff2-a54b-443b-b342-e2b24e2371d0]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ec53206-c152-458e-a186-692dfde33959]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UVvcwhTn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v UVvcwhTn" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f660e53d-e627-424d-b0cf-094e61b43a9c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'UVvcwhTn'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[edeb2ba5-7a9c-4021-bc64-9c7aefd0ca69]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dce871-db50-4aed-94bd-aada3e835e0e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:22 user nova-compute[74242]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)
Oct 20 02:05:22 user nova-compute[74242]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d (non-flash)
Oct 20 02:05:22 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:22 user nova-compute[74242]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)
Oct 20 02:05:22 user nova-compute[74242]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d (non-flash)
Oct 20 02:05:22 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[daca5f6c-624d-48e3-9fd1-7aa7ab6c4d6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7, portal: 172.16.0.220,3260]
Oct 20 02:05:22 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7, portal: 172.16.0.220,3260] successful.
Oct 20 02:05:22 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd8c15e-6f47-4ad1-b122-60eb7bbafe83]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8374008d-3ab4-44e9-a207-5d366fcf1a26]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:22 user nova-compute[74242]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)
Oct 20 02:05:22 user nova-compute[74242]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d (non-flash)
Oct 20 02:05:22 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:05:22 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:22 user nova-compute[74242]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)
Oct 20 02:05:22 user nova-compute[74242]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d (non-flash)
Oct 20 02:05:22 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:05:22 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a067fcd-b38c-4083-bb68-a37dd6330fd2]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVvcwhTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updating instance_info_cache with network_info: [{"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:05:22 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Successfully created port: f5e47a50-c8fb-46e8-9f8b-54470f96061e {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG nova.network.neutron [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Successfully created port: b71ba39e-3a76-4e07-971a-383990d2d6a3 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23634313930376530', 'path': '/dev/sde'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634313930376530', 'path': '/dev/sde'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:04:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1650234974',display_name='tempest-TestVolumeBootPattern-server-1650234974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1650234974',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-bfi8uxz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:04:57Z,user_data=None,user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=1e23c60d-f373-431e-952e-600b9b5d6ea2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "address": "fa:16:3e:26:60:91", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f970626-ca", "ovs_interfaceid": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "address": "fa:16:3e:26:60:91", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f970626-ca", "ovs_interfaceid": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:60:91,bridge_name='br-int',has_traffic_filtering=True,id=0f970626-ca00-4d2c-a588-4d5c703fdad4,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f970626-ca') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG nova.objects.instance [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lazy-loading 'pci_devices' on Instance uuid 1e23c60d-f373-431e-952e-600b9b5d6ea2 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:05:23 user nova-compute[74242]:   <uuid>1e23c60d-f373-431e-952e-600b9b5d6ea2</uuid>
Oct 20 02:05:23 user nova-compute[74242]:   <name>instance-0000000b</name>
Oct 20 02:05:23 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:05:23 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:05:23 user nova-compute[74242]:   <metadata>
Oct 20 02:05:23 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:05:23 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:05:23 user nova-compute[74242]:       <nova:name>tempest-TestVolumeBootPattern-server-1650234974</nova:name>
Oct 20 02:05:23 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:05:22</nova:creationTime>
Oct 20 02:05:23 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:05:23 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:05:23 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:05:23 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:05:23 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:05:23 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:05:23 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:05:23 user nova-compute[74242]:       <nova:owner>
Oct 20 02:05:23 user nova-compute[74242]:         <nova:user uuid="00ea297f598040fbb338b9ab2e1a1d3a">tempest-TestVolumeBootPattern-882774340-project-member</nova:user>
Oct 20 02:05:23 user nova-compute[74242]:         <nova:project uuid="e137c75824d7429585ddd2245f86a6d0">tempest-TestVolumeBootPattern-882774340</nova:project>
Oct 20 02:05:23 user nova-compute[74242]:       </nova:owner>
Oct 20 02:05:23 user nova-compute[74242]:       <nova:ports>
Oct 20 02:05:23 user nova-compute[74242]:         <nova:port uuid="0f970626-ca00-4d2c-a588-4d5c703fdad4">
Oct 20 02:05:23 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 02:05:23 user nova-compute[74242]:         </nova:port>
Oct 20 02:05:23 user nova-compute[74242]:       </nova:ports>
Oct 20 02:05:23 user nova-compute[74242]:     </nova:instance>
Oct 20 02:05:23 user nova-compute[74242]:   </metadata>
Oct 20 02:05:23 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:05:23 user nova-compute[74242]:     <system>
Oct 20 02:05:23 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:05:23 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:05:23 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:05:23 user nova-compute[74242]:       <entry name="serial">1e23c60d-f373-431e-952e-600b9b5d6ea2</entry>
Oct 20 02:05:23 user nova-compute[74242]:       <entry name="uuid">1e23c60d-f373-431e-952e-600b9b5d6ea2</entry>
Oct 20 02:05:23 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:05:23 user nova-compute[74242]:     </system>
Oct 20 02:05:23 user nova-compute[74242]:   </sysinfo>
Oct 20 02:05:23 user nova-compute[74242]:   <os>
Oct 20 02:05:23 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:05:23 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:05:23 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:05:23 user nova-compute[74242]:   </os>
Oct 20 02:05:23 user nova-compute[74242]:   <features>
Oct 20 02:05:23 user nova-compute[74242]:     <acpi/>
Oct 20 02:05:23 user nova-compute[74242]:     <apic/>
Oct 20 02:05:23 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:05:23 user nova-compute[74242]:   </features>
Oct 20 02:05:23 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:05:23 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:05:23 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:05:23 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:05:23 user nova-compute[74242]:   </clock>
Oct 20 02:05:23 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:05:23 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:05:23 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:05:23 user nova-compute[74242]:   </cpu>
Oct 20 02:05:23 user nova-compute[74242]:   <devices>
Oct 20 02:05:23 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:05:23 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:05:23 user nova-compute[74242]:       <source dev="/dev/sde"/>
Oct 20 02:05:23 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:05:23 user nova-compute[74242]:       <serial>52b084a0-3032-4c29-846e-066ece9918c7</serial>
Oct 20 02:05:23 user nova-compute[74242]:     </disk>
Oct 20 02:05:23 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:05:23 user nova-compute[74242]:       <mac address="fa:16:3e:26:60:91"/>
Oct 20 02:05:23 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:05:23 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:05:23 user nova-compute[74242]:       <target dev="tap0f970626-ca"/>
Oct 20 02:05:23 user nova-compute[74242]:     </interface>
Oct 20 02:05:23 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:05:23 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/1e23c60d-f373-431e-952e-600b9b5d6ea2/console.log" append="off"/>
Oct 20 02:05:23 user nova-compute[74242]:     </serial>
Oct 20 02:05:23 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:05:23 user nova-compute[74242]:     <video>
Oct 20 02:05:23 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:05:23 user nova-compute[74242]:     </video>
Oct 20 02:05:23 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:05:23 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:05:23 user nova-compute[74242]:     </rng>
Oct 20 02:05:23 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:05:23 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:05:23 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:05:23 user nova-compute[74242]:     </memballoon>
Oct 20 02:05:23 user nova-compute[74242]:   </devices>
Oct 20 02:05:23 user nova-compute[74242]: </domain>
Oct 20 02:05:23 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:04:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1650234974',display_name='tempest-TestVolumeBootPattern-server-1650234974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1650234974',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-bfi8uxz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:04:57Z,user_data=None,user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=1e23c60d-f373-431e-952e-600b9b5d6ea2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "address": "fa:16:3e:26:60:91", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f970626-ca", "ovs_interfaceid": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "address": "fa:16:3e:26:60:91", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f970626-ca", "ovs_interfaceid": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:60:91,bridge_name='br-int',has_traffic_filtering=True,id=0f970626-ca00-4d2c-a588-4d5c703fdad4,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f970626-ca') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG os_vif [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:60:91,bridge_name='br-int',has_traffic_filtering=True,id=0f970626-ca00-4d2c-a588-4d5c703fdad4,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f970626-ca') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f619021a-595f-59b6-a862-53dd0dd7a315', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f970626-ca, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f970626-ca, col_values=(('qos', UUID('8e71952a-2fbe-4b40-9e55-21d12db86175')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f970626-ca, col_values=(('external_ids', {'iface-id': '0f970626-ca00-4d2c-a588-4d5c703fdad4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:60:91', 'vm-uuid': '1e23c60d-f373-431e-952e-600b9b5d6ea2'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:05:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:23 user nova-compute[74242]: INFO os_vif [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:60:91,bridge_name='br-int',has_traffic_filtering=True,id=0f970626-ca00-4d2c-a588-4d5c703fdad4,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f970626-ca')
Oct 20 02:05:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:05:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] No VIF found with MAC fa:16:3e:26:60:91, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:05:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:24 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Successfully created port: d45e11fc-f0b3-4bd3-92d3-9508adbcd839 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:05:24 user nova-compute[74242]: DEBUG nova.network.neutron [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Successfully updated port: b71ba39e-3a76-4e07-971a-383990d2d6a3 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:05:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:05:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquired lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:05:24 user nova-compute[74242]: DEBUG nova.network.neutron [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:05:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-22b66b53-763c-4e42-b435-020d8b573313 req-1c2b5a73-47f0-4bed-975a-0ce7a54f9001 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received event network-changed-b71ba39e-3a76-4e07-971a-383990d2d6a3 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-22b66b53-763c-4e42-b435-020d8b573313 req-1c2b5a73-47f0-4bed-975a-0ce7a54f9001 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Refreshing instance network info cache due to event network-changed-b71ba39e-3a76-4e07-971a-383990d2d6a3. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:05:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-22b66b53-763c-4e42-b435-020d8b573313 req-1c2b5a73-47f0-4bed-975a-0ce7a54f9001 service nova] Acquiring lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:05:25 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:05:25 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:05:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:25 user nova-compute[74242]: DEBUG nova.compute.manager [req-2ece9fb7-aeac-4807-994a-e11d026b1aa6 req-872ab23f-c887-4c01-9842-1c8645bb3762 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Received event network-vif-plugged-0f970626-ca00-4d2c-a588-4d5c703fdad4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2ece9fb7-aeac-4807-994a-e11d026b1aa6 req-872ab23f-c887-4c01-9842-1c8645bb3762 service nova] Acquiring lock "1e23c60d-f373-431e-952e-600b9b5d6ea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2ece9fb7-aeac-4807-994a-e11d026b1aa6 req-872ab23f-c887-4c01-9842-1c8645bb3762 service nova] Lock "1e23c60d-f373-431e-952e-600b9b5d6ea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2ece9fb7-aeac-4807-994a-e11d026b1aa6 req-872ab23f-c887-4c01-9842-1c8645bb3762 service nova] Lock "1e23c60d-f373-431e-952e-600b9b5d6ea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:25 user nova-compute[74242]: DEBUG nova.compute.manager [req-2ece9fb7-aeac-4807-994a-e11d026b1aa6 req-872ab23f-c887-4c01-9842-1c8645bb3762 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] No waiting events found dispatching network-vif-plugged-0f970626-ca00-4d2c-a588-4d5c703fdad4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:05:25 user nova-compute[74242]: WARNING nova.compute.manager [req-2ece9fb7-aeac-4807-994a-e11d026b1aa6 req-872ab23f-c887-4c01-9842-1c8645bb3762 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Received unexpected event network-vif-plugged-0f970626-ca00-4d2c-a588-4d5c703fdad4 for instance with vm_state building and task_state spawning.
Oct 20 02:05:25 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Successfully updated port: c809bd71-9a30-4d1c-9884-b2881cd21f70 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.network.neutron [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Updating instance_info_cache with network_info: [{"id": "7575478b-29e4-493e-a04f-0e3747a5c64a", "address": "fa:16:3e:86:90:03", "network": {"id": "bba69f21-fd72-478c-8f16-a8fcd9b41e96", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1592153998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7575478b-29", "ovs_interfaceid": "7575478b-29e4-493e-a04f-0e3747a5c64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "address": "fa:16:3e:87:07:58", "network": {"id": "b33a8d23-714f-435e-8194-0add90523af5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1175840430", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71ba39e-3a", "ovs_interfaceid": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Releasing lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-22b66b53-763c-4e42-b435-020d8b573313 req-1c2b5a73-47f0-4bed-975a-0ce7a54f9001 service nova] Acquired lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.network.neutron [req-22b66b53-763c-4e42-b435-020d8b573313 req-1c2b5a73-47f0-4bed-975a-0ce7a54f9001 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Refreshing network info cache for port b71ba39e-3a76-4e07-971a-383990d2d6a3 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1179443261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1179443261',id=7,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpogir2lL5fxgT+aGdQt1FD0OBJl3IivuczQXbzwg0f71VsW0nMR64AVx2F5qXSCYftEKlBnA8CPoiaBKJjZl9XM4BiISexAmTWuqad0JPqRMC1MStDpdYS3HjZNGmZWg==',key_name='tempest-keypair-808065593',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='28a8e047fa564263971543d6342579b1',ramdisk_id='',reservation_id='r-91z09vmf',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-789715889',owner_user_name='tempest-TaggedAttachmentsTest-789715889-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81797a2a7a744fa8298b767cf469631',uuid=e22cb246-155d-48f5-9eee-bd543c0bbaf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "address": "fa:16:3e:87:07:58", "network": {"id": "b33a8d23-714f-435e-8194-0add90523af5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1175840430", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71ba39e-3a", "ovs_interfaceid": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Converting VIF {"id": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "address": "fa:16:3e:87:07:58", "network": {"id": "b33a8d23-714f-435e-8194-0add90523af5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1175840430", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71ba39e-3a", "ovs_interfaceid": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:58,bridge_name='br-int',has_traffic_filtering=True,id=b71ba39e-3a76-4e07-971a-383990d2d6a3,network=Network(b33a8d23-714f-435e-8194-0add90523af5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71ba39e-3a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG os_vif [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:58,bridge_name='br-int',has_traffic_filtering=True,id=b71ba39e-3a76-4e07-971a-383990d2d6a3,network=Network(b33a8d23-714f-435e-8194-0add90523af5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71ba39e-3a') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4c3ffaf0-f4b2-5ee2-8a63-af41dd241e9b', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb71ba39e-3a, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb71ba39e-3a, col_values=(('qos', UUID('4cc8a3f5-5bb7-4154-861a-2157916b5488')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb71ba39e-3a, col_values=(('external_ids', {'iface-id': 'b71ba39e-3a76-4e07-971a-383990d2d6a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:07:58', 'vm-uuid': 'e22cb246-155d-48f5-9eee-bd543c0bbaf1'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:26 user nova-compute[74242]: INFO os_vif [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:58,bridge_name='br-int',has_traffic_filtering=True,id=b71ba39e-3a76-4e07-971a-383990d2d6a3,network=Network(b33a8d23-714f-435e-8194-0add90523af5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71ba39e-3a')
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1179443261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1179443261',id=7,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpogir2lL5fxgT+aGdQt1FD0OBJl3IivuczQXbzwg0f71VsW0nMR64AVx2F5qXSCYftEKlBnA8CPoiaBKJjZl9XM4BiISexAmTWuqad0JPqRMC1MStDpdYS3HjZNGmZWg==',key_name='tempest-keypair-808065593',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='28a8e047fa564263971543d6342579b1',ramdisk_id='',reservation_id='r-91z09vmf',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-789715889',owner_user_name='tempest-TaggedAttachmentsTest-789715889-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81797a2a7a744fa8298b767cf469631',uuid=e22cb246-155d-48f5-9eee-bd543c0bbaf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "address": "fa:16:3e:87:07:58", "network": {"id": "b33a8d23-714f-435e-8194-0add90523af5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1175840430", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71ba39e-3a", "ovs_interfaceid": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Converting VIF {"id": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "address": "fa:16:3e:87:07:58", "network": {"id": "b33a8d23-714f-435e-8194-0add90523af5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1175840430", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71ba39e-3a", "ovs_interfaceid": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:58,bridge_name='br-int',has_traffic_filtering=True,id=b71ba39e-3a76-4e07-971a-383990d2d6a3,network=Network(b33a8d23-714f-435e-8194-0add90523af5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71ba39e-3a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] attach device xml: <interface type="ethernet">
Oct 20 02:05:26 user nova-compute[74242]:   <mac address="fa:16:3e:87:07:58"/>
Oct 20 02:05:26 user nova-compute[74242]:   <model type="virtio"/>
Oct 20 02:05:26 user nova-compute[74242]:   <mtu size="1442"/>
Oct 20 02:05:26 user nova-compute[74242]:   <target dev="tapb71ba39e-3a"/>
Oct 20 02:05:26 user nova-compute[74242]: </interface>
Oct 20 02:05:26 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-96a110a4-2854-4152-8003-c861b4066482 req-f0b5af12-e736-4599-8354-d95a2fcf3249 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received event network-vif-plugged-b71ba39e-3a76-4e07-971a-383990d2d6a3 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-96a110a4-2854-4152-8003-c861b4066482 req-f0b5af12-e736-4599-8354-d95a2fcf3249 service nova] Acquiring lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-96a110a4-2854-4152-8003-c861b4066482 req-f0b5af12-e736-4599-8354-d95a2fcf3249 service nova] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-96a110a4-2854-4152-8003-c861b4066482 req-f0b5af12-e736-4599-8354-d95a2fcf3249 service nova] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-96a110a4-2854-4152-8003-c861b4066482 req-f0b5af12-e736-4599-8354-d95a2fcf3249 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] No waiting events found dispatching network-vif-plugged-b71ba39e-3a76-4e07-971a-383990d2d6a3 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:05:26 user nova-compute[74242]: WARNING nova.compute.manager [req-96a110a4-2854-4152-8003-c861b4066482 req-f0b5af12-e736-4599-8354-d95a2fcf3249 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received unexpected event network-vif-plugged-b71ba39e-3a76-4e07-971a-383990d2d6a3 for instance with vm_state active and task_state None.
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] No BDM found with device name hda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] No VIF found with MAC fa:16:3e:86:90:03, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:05:26 user nova-compute[74242]:   <nova:package version="0.0.0"/>
Oct 20 02:05:26 user nova-compute[74242]:   <nova:name>tempest-device-tagging-server-1179443261</nova:name>
Oct 20 02:05:26 user nova-compute[74242]:   <nova:creationTime>2023-10-20 02:05:26</nova:creationTime>
Oct 20 02:05:26 user nova-compute[74242]:   <nova:flavor name="m1.tiny">
Oct 20 02:05:26 user nova-compute[74242]:     <nova:memory>512</nova:memory>
Oct 20 02:05:26 user nova-compute[74242]:     <nova:disk>1</nova:disk>
Oct 20 02:05:26 user nova-compute[74242]:     <nova:swap>0</nova:swap>
Oct 20 02:05:26 user nova-compute[74242]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:05:26 user nova-compute[74242]:     <nova:vcpus>1</nova:vcpus>
Oct 20 02:05:26 user nova-compute[74242]:   </nova:flavor>
Oct 20 02:05:26 user nova-compute[74242]:   <nova:owner>
Oct 20 02:05:26 user nova-compute[74242]:     <nova:user uuid="e81797a2a7a744fa8298b767cf469631">tempest-TaggedAttachmentsTest-789715889-project-member</nova:user>
Oct 20 02:05:26 user nova-compute[74242]:     <nova:project uuid="28a8e047fa564263971543d6342579b1">tempest-TaggedAttachmentsTest-789715889</nova:project>
Oct 20 02:05:26 user nova-compute[74242]:   </nova:owner>
Oct 20 02:05:26 user nova-compute[74242]:   <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:05:26 user nova-compute[74242]:   <nova:ports>
Oct 20 02:05:26 user nova-compute[74242]:     <nova:port uuid="7575478b-29e4-493e-a04f-0e3747a5c64a">
Oct 20 02:05:26 user nova-compute[74242]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 02:05:26 user nova-compute[74242]:     </nova:port>
Oct 20 02:05:26 user nova-compute[74242]:     <nova:port uuid="b71ba39e-3a76-4e07-971a-383990d2d6a3">
Oct 20 02:05:26 user nova-compute[74242]:       <nova:ip type="fixed" address="10.10.10.226" ipVersion="4"/>
Oct 20 02:05:26 user nova-compute[74242]:     </nova:port>
Oct 20 02:05:26 user nova-compute[74242]:   </nova:ports>
Oct 20 02:05:26 user nova-compute[74242]: </nova:instance>
Oct 20 02:05:26 user nova-compute[74242]:  {{(pid=74242) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ff201aff-7655-4836-ba57-eb5f74199628 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "interface-e22cb246-155d-48f5-9eee-bd543c0bbaf1-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 5.338s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.network.neutron [req-22b66b53-763c-4e42-b435-020d8b573313 req-1c2b5a73-47f0-4bed-975a-0ce7a54f9001 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Updated VIF entry in instance network info cache for port b71ba39e-3a76-4e07-971a-383990d2d6a3. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.network.neutron [req-22b66b53-763c-4e42-b435-020d8b573313 req-1c2b5a73-47f0-4bed-975a-0ce7a54f9001 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Updating instance_info_cache with network_info: [{"id": "7575478b-29e4-493e-a04f-0e3747a5c64a", "address": "fa:16:3e:86:90:03", "network": {"id": "bba69f21-fd72-478c-8f16-a8fcd9b41e96", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1592153998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7575478b-29", "ovs_interfaceid": "7575478b-29e4-493e-a04f-0e3747a5c64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "address": "fa:16:3e:87:07:58", "network": {"id": "b33a8d23-714f-435e-8194-0add90523af5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1175840430", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71ba39e-3a", "ovs_interfaceid": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-22b66b53-763c-4e42-b435-020d8b573313 req-1c2b5a73-47f0-4bed-975a-0ce7a54f9001 service nova] Releasing lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-2657d929-1bf1-4d18-b46c-6441fa0cde79 req-afcd82bc-2e12-4ce4-a3cf-d1f4757c3221 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-changed-c809bd71-9a30-4d1c-9884-b2881cd21f70 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-2657d929-1bf1-4d18-b46c-6441fa0cde79 req-afcd82bc-2e12-4ce4-a3cf-d1f4757c3221 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing instance network info cache due to event network-changed-c809bd71-9a30-4d1c-9884-b2881cd21f70. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2657d929-1bf1-4d18-b46c-6441fa0cde79 req-afcd82bc-2e12-4ce4-a3cf-d1f4757c3221 service nova] Acquiring lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2657d929-1bf1-4d18-b46c-6441fa0cde79 req-afcd82bc-2e12-4ce4-a3cf-d1f4757c3221 service nova] Acquired lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.network.neutron [req-2657d929-1bf1-4d18-b46c-6441fa0cde79 req-afcd82bc-2e12-4ce4-a3cf-d1f4757c3221 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing network info cache for port c809bd71-9a30-4d1c-9884-b2881cd21f70 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:26 user nova-compute[74242]: DEBUG nova.network.neutron [req-2657d929-1bf1-4d18-b46c-6441fa0cde79 req-afcd82bc-2e12-4ce4-a3cf-d1f4757c3221 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.objects.instance [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lazy-loading 'flavor' on Instance uuid e22cb246-155d-48f5-9eee-bd543c0bbaf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Successfully updated port: 2de0cc37-2422-461f-8a4a-3b77033ce618 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.network.neutron [req-2657d929-1bf1-4d18-b46c-6441fa0cde79 req-afcd82bc-2e12-4ce4-a3cf-d1f4757c3221 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2657d929-1bf1-4d18-b46c-6441fa0cde79 req-afcd82bc-2e12-4ce4-a3cf-d1f4757c3221 service nova] Releasing lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:27 user nova-compute[74242]: INFO nova.compute.manager [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Attaching volume 0ebc0088-c1ac-4e57-98c3-3637207d924c to /dev/vdb
Oct 20 02:05:27 user nova-compute[74242]: DEBUG os_brick.utils [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[961747cc-d34a-4e62-8567-d983d183ba92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c4be5f-4671-4e11-bab8-647f2d0d589e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[961a9bef-4e5d-4180-9d83-a68c8daf576c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bad1fc5-746b-4129-b714-27e7ef27d4c0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b3a8e5da-8ac3-4738-b1b6-44d1b4bdfdd5 req-3e77dcf4-6bb4-4c68-b795-6da1b3cf2bc4 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Received event network-vif-plugged-0f970626-ca00-4d2c-a588-4d5c703fdad4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b3a8e5da-8ac3-4738-b1b6-44d1b4bdfdd5 req-3e77dcf4-6bb4-4c68-b795-6da1b3cf2bc4 service nova] Acquiring lock "1e23c60d-f373-431e-952e-600b9b5d6ea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b3a8e5da-8ac3-4738-b1b6-44d1b4bdfdd5 req-3e77dcf4-6bb4-4c68-b795-6da1b3cf2bc4 service nova] Lock "1e23c60d-f373-431e-952e-600b9b5d6ea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b3a8e5da-8ac3-4738-b1b6-44d1b4bdfdd5 req-3e77dcf4-6bb4-4c68-b795-6da1b3cf2bc4 service nova] Lock "1e23c60d-f373-431e-952e-600b9b5d6ea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b3a8e5da-8ac3-4738-b1b6-44d1b4bdfdd5 req-3e77dcf4-6bb4-4c68-b795-6da1b3cf2bc4 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] No waiting events found dispatching network-vif-plugged-0f970626-ca00-4d2c-a588-4d5c703fdad4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:05:27 user nova-compute[74242]: WARNING nova.compute.manager [req-b3a8e5da-8ac3-4738-b1b6-44d1b4bdfdd5 req-3e77dcf4-6bb4-4c68-b795-6da1b3cf2bc4 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Received unexpected event network-vif-plugged-0f970626-ca00-4d2c-a588-4d5c703fdad4 for instance with vm_state building and task_state spawning.
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:05:27 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bc016f-4a01-48c4-baca-147879876e36]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG os_brick.utils [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Updating existing volume attachment record: fa5b0515-2938-4880-97d2-c0587a7a08d8 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:05:27 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Instance spawned successfully.
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:05:27 user nova-compute[74242]: INFO nova.compute.manager [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Took 5.53 seconds to spawn the instance on the hypervisor.
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:05:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Successfully updated port: 87632b36-c7fb-47e4-a792-cf94f02ac6f3 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:05:28 user nova-compute[74242]: INFO nova.compute.manager [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Took 31.45 seconds to build instance.
Oct 20 02:05:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b260b5b-01b8-47ec-92ed-923c3d0d2c69 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "1e23c60d-f373-431e-952e-600b9b5d6ea2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.580s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-54be2bbc-ed72-450a-813b-bea2da039a98 req-be01b8b5-eda3-45aa-9a5e-7886e77325d5 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received event network-vif-plugged-b71ba39e-3a76-4e07-971a-383990d2d6a3 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-54be2bbc-ed72-450a-813b-bea2da039a98 req-be01b8b5-eda3-45aa-9a5e-7886e77325d5 service nova] Acquiring lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-54be2bbc-ed72-450a-813b-bea2da039a98 req-be01b8b5-eda3-45aa-9a5e-7886e77325d5 service nova] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-54be2bbc-ed72-450a-813b-bea2da039a98 req-be01b8b5-eda3-45aa-9a5e-7886e77325d5 service nova] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-54be2bbc-ed72-450a-813b-bea2da039a98 req-be01b8b5-eda3-45aa-9a5e-7886e77325d5 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] No waiting events found dispatching network-vif-plugged-b71ba39e-3a76-4e07-971a-383990d2d6a3 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:05:28 user nova-compute[74242]: WARNING nova.compute.manager [req-54be2bbc-ed72-450a-813b-bea2da039a98 req-be01b8b5-eda3-45aa-9a5e-7886e77325d5 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received unexpected event network-vif-plugged-b71ba39e-3a76-4e07-971a-383990d2d6a3 for instance with vm_state active and task_state None.
Oct 20 02:05:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25/disk --force-share --output=json" returned: 0 in 0.467s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Successfully updated port: 67449c80-5905-4656-9c55-45460e214374 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-changed-2de0cc37-2422-461f-8a4a-3b77033ce618 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing instance network info cache due to event network-changed-2de0cc37-2422-461f-8a4a-3b77033ce618. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] Acquiring lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] Acquired lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:05:28 user nova-compute[74242]: DEBUG nova.network.neutron [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing network info cache for port 2de0cc37-2422-461f-8a4a-3b77033ce618 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG nova.network.neutron [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG nova.network.neutron [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] Releasing lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-changed-87632b36-c7fb-47e4-a792-cf94f02ac6f3 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing instance network info cache due to event network-changed-87632b36-c7fb-47e4-a792-cf94f02ac6f3. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] Acquiring lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] Acquired lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG nova.network.neutron [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing network info cache for port 87632b36-c7fb-47e4-a792-cf94f02ac6f3 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG nova.network.neutron [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Successfully updated port: ebac74b9-c5ad-48b8-8b0a-370831dbd710 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG nova.network.neutron [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] Releasing lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-changed-67449c80-5905-4656-9c55-45460e214374 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing instance network info cache due to event network-changed-67449c80-5905-4656-9c55-45460e214374. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] Acquiring lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] Acquired lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG nova.network.neutron [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing network info cache for port 67449c80-5905-4656-9c55-45460e214374 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG nova.network.neutron [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG nova.network.neutron [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-37781261-b4bb-4724-9d89-d5ae7a6a2b0e req-24057f4f-a046-450c-97e7-7836e7ca55dc service nova] Releasing lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Successfully updated port: f5e47a50-c8fb-46e8-9f8b-54470f96061e {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-changed-ebac74b9-c5ad-48b8-8b0a-370831dbd710 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing instance network info cache due to event network-changed-ebac74b9-c5ad-48b8-8b0a-370831dbd710. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] Acquiring lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] Acquired lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG nova.network.neutron [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing network info cache for port ebac74b9-c5ad-48b8-8b0a-370831dbd710 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.network.neutron [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Successfully updated port: d45e11fc-f0b3-4bd3-92d3-9508adbcd839 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:05:31 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d87147b4-29ec-4e82-8525-b795647422bd is timed out.
Oct 20 02:05:31 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Successfully detached device vdb from instance d87147b4-29ec-4e82-8525-b795647422bd from the live domain config.
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] [instance: d87147b4-29ec-4e82-8525-b795647422bd] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RVCElZQt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:05:31 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:31 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:05:31 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7738MB free_disk=25.402976989746094GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f49047-ed5e-4022-a30d-5d3593e00c4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:05:31 user nova-compute[74242]: No targets found.
Oct 20 02:05:31 user nova-compute[74242]: iSNS:
Oct 20 02:05:31 user nova-compute[74242]: No targets found.
Oct 20 02:05:31 user nova-compute[74242]: STATIC:
Oct 20 02:05:31 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3
Oct 20 02:05:31 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:05:31 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:05:31 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d
Oct 20 02:05:31 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:05:31 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:05:31 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7
Oct 20 02:05:31 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:05:31 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:05:31 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68
Oct 20 02:05:31 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:05:31 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:05:31 user nova-compute[74242]: FIRMWARE:
Oct 20 02:05:31 user nova-compute[74242]: No targets found.
Oct 20 02:05:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:05:31 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:05:31 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17efb87-05c8-4839-90bd-c64c7007e63e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[51be7990-bf61-4f95-93af-631514a71363]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:31 user nova-compute[74242]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)
Oct 20 02:05:31 user nova-compute[74242]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d (non-flash)
Oct 20 02:05:31 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:05:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:31 user nova-compute[74242]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 (non-flash)
Oct 20 02:05:31 user nova-compute[74242]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d (non-flash)
Oct 20 02:05:31 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:05:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d0188820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3'): ({'sdc'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Removing single pathed devices sdc {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.network.neutron [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2acb8ba-50e5-4808-8a92-0685eda898d8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] Releasing lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.compute.manager [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-changed-f5e47a50-c8fb-46e8-9f8b-54470f96061e {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.compute.manager [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing instance network info cache due to event network-changed-f5e47a50-c8fb-46e8-9f8b-54470f96061e. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] Acquiring lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] Acquired lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.network.neutron [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing network info cache for port f5e47a50-c8fb-46e8-9f8b-54470f96061e {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7410e6ce-bc4f-417a-876c-e27ff0540f59]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Flushing IO for device /dev/sdc {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72fed58-4697-4a2d-a219-6ccc7cef7ebc]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance af9f3d52-79f0-4ce0-9b14-3373b30c2b26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance ec8965b7-0f68-4445-bc29-a0584570de8e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d87147b4-29ec-4e82-8525-b795647422bd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d0231be7-4850-48ce-8757-fade8f3e4e25 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 9a0fc135-ab9b-4b81-950d-84da9e99a422 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 5cea10bc-ac5a-48b0-b6b7-7db8f520339d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 1e23c60d-f373-431e-952e-600b9b5d6ea2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance a77f802c-7ee6-4596-ac65-221e2a6bb533 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG nova.network.neutron [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[06998e0e-902a-4226-bfd8-747caa3aa56c]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Checking to see if SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7093e047-3209-427c-b825-f6a3b0562405]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dfe2ad-2c9d-4db3-b023-cf970816d2ed]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3, portal: 172.16.0.220,3260]
Oct 20 02:05:32 user nova-compute[74242]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3, portal: 172.16.0.220,3260] successful.
Oct 20 02:05:32 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:524e6cc6-d717-4a9b-8523-affb6e026ca3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb1ebd0-8d43-4b30-a7e9-d552fb0fbb1e]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] <== disconnect_volume: return (382ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-13af535b-ac30-4cda-83e1-4258c33a65d9 req-d9001e4b-9ea8-4c2a-be0d-9b0f3ddf987b service nova] Releasing lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquired lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:05:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.596s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-43b30269-a84c-4ac0-a347-8366a2d5c1a5 req-9fec241c-fb23-4ea9-9f4f-0536e8661c22 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-changed-d45e11fc-f0b3-4bd3-92d3-9508adbcd839 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-43b30269-a84c-4ac0-a347-8366a2d5c1a5 req-9fec241c-fb23-4ea9-9f4f-0536e8661c22 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing instance network info cache due to event network-changed-d45e11fc-f0b3-4bd3-92d3-9508adbcd839. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:05:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-43b30269-a84c-4ac0-a347-8366a2d5c1a5 req-9fec241c-fb23-4ea9-9f4f-0536e8661c22 service nova] Acquiring lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:05:33 user nova-compute[74242]: DEBUG nova.objects.instance [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Lazy-loading 'flavor' on Instance uuid d87147b4-29ec-4e82-8525-b795647422bd {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:05:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a69ca81c-baea-4c75-a43f-6567a6076551 tempest-VolumesAssistedSnapshotsTest-2023267975 tempest-VolumesAssistedSnapshotsTest-2023267975-project-admin] Lock "d87147b4-29ec-4e82-8525-b795647422bd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.176s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:33 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:05:33 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updating instance_info_cache with network_info: [{"id": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "address": "fa:16:3e:1b:f2:1f", "network": {"id": "b7bde1f3-dede-4765-9ea9-d294203c607f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2003879386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc809bd71-9a", "ovs_interfaceid": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2de0cc37-2422-461f-8a4a-3b77033ce618", "address": "fa:16:3e:bc:54:72", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de0cc37-24", "ovs_interfaceid": "2de0cc37-2422-461f-8a4a-3b77033ce618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "address": "fa:16:3e:bf:06:d5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87632b36-c7", "ovs_interfaceid": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67449c80-5905-4656-9c55-45460e214374", "address": "fa:16:3e:6e:a7:08", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67449c80-59", "ovs_interfaceid": "67449c80-5905-4656-9c55-45460e214374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "address": "fa:16:3e:81:03:b5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebac74b9-c5", "ovs_interfaceid": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "address": "fa:16:3e:79:9b:bb", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e47a50-c8", "ovs_interfaceid": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "address": "fa:16:3e:57:89:56", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd45e11fc-f0", "ovs_interfaceid": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Releasing lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Instance network_info: |[{"id": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "address": "fa:16:3e:1b:f2:1f", "network": {"id": "b7bde1f3-dede-4765-9ea9-d294203c607f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2003879386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc809bd71-9a", "ovs_interfaceid": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2de0cc37-2422-461f-8a4a-3b77033ce618", "address": "fa:16:3e:bc:54:72", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de0cc37-24", "ovs_interfaceid": "2de0cc37-2422-461f-8a4a-3b77033ce618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "address": "fa:16:3e:bf:06:d5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87632b36-c7", "ovs_interfaceid": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67449c80-5905-4656-9c55-45460e214374", "address": "fa:16:3e:6e:a7:08", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67449c80-59", "ovs_interfaceid": "67449c80-5905-4656-9c55-45460e214374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "address": "fa:16:3e:81:03:b5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebac74b9-c5", "ovs_interfaceid": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "address": "fa:16:3e:79:9b:bb", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e47a50-c8", "ovs_interfaceid": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "address": "fa:16:3e:57:89:56", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd45e11fc-f0", "ovs_interfaceid": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-43b30269-a84c-4ac0-a347-8366a2d5c1a5 req-9fec241c-fb23-4ea9-9f4f-0536e8661c22 service nova] Acquired lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG nova.network.neutron [req-43b30269-a84c-4ac0-a347-8366a2d5c1a5 req-9fec241c-fb23-4ea9-9f4f-0536e8661c22 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing network info cache for port d45e11fc-f0b3-4bd3-92d3-9508adbcd839 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:05:34 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance ec8965b7-0f68-4445-bc29-a0584570de8e is timed out.
Oct 20 02:05:34 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Successfully detached device sdc from instance ec8965b7-0f68-4445-bc29-a0584570de8e from the live domain config.
Oct 20 02:05:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sNYITKEq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:05:34 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a3e5c7-f0bc-4ede-b506-518aa9f0909a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:05:34 user nova-compute[74242]: No targets found.
Oct 20 02:05:34 user nova-compute[74242]: iSNS:
Oct 20 02:05:34 user nova-compute[74242]: No targets found.
Oct 20 02:05:34 user nova-compute[74242]: STATIC:
Oct 20 02:05:34 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d
Oct 20 02:05:34 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:05:34 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:05:34 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7
Oct 20 02:05:34 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:05:34 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:05:34 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68
Oct 20 02:05:34 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:05:34 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:05:34 user nova-compute[74242]: FIRMWARE:
Oct 20 02:05:34 user nova-compute[74242]: No targets found.
Oct 20 02:05:34 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:05:34 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:05:34 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c46d84d-f661-41e0-997e-54157e30e7f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[544701cc-7b33-4c0d-9fc2-af2c5db070cd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:34 user nova-compute[74242]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d (non-flash)
Oct 20 02:05:34 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:05:34 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:34 user nova-compute[74242]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d (non-flash)
Oct 20 02:05:34 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:05:34 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d0189510>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d'): ({'sdd'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Removing single pathed devices sdd {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e942ec7-dc23-4be6-aa4b-bd6867b2ebd6]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28b4ec1-f483-45ad-96c0-321e79c21922]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Flushing IO for device /dev/sdd {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccbfb71-b463-4b44-bd5f-9d35cbff69db]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG nova.network.neutron [req-43b30269-a84c-4ac0-a347-8366a2d5c1a5 req-9fec241c-fb23-4ea9-9f4f-0536e8661c22 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updated VIF entry in instance network info cache for port d45e11fc-f0b3-4bd3-92d3-9508adbcd839. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG nova.network.neutron [req-43b30269-a84c-4ac0-a347-8366a2d5c1a5 req-9fec241c-fb23-4ea9-9f4f-0536e8661c22 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updating instance_info_cache with network_info: [{"id": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "address": "fa:16:3e:1b:f2:1f", "network": {"id": "b7bde1f3-dede-4765-9ea9-d294203c607f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2003879386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc809bd71-9a", "ovs_interfaceid": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2de0cc37-2422-461f-8a4a-3b77033ce618", "address": "fa:16:3e:bc:54:72", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de0cc37-24", "ovs_interfaceid": "2de0cc37-2422-461f-8a4a-3b77033ce618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "address": "fa:16:3e:bf:06:d5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87632b36-c7", "ovs_interfaceid": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67449c80-5905-4656-9c55-45460e214374", "address": "fa:16:3e:6e:a7:08", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67449c80-59", "ovs_interfaceid": "67449c80-5905-4656-9c55-45460e214374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "address": "fa:16:3e:81:03:b5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebac74b9-c5", "ovs_interfaceid": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "address": "fa:16:3e:79:9b:bb", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e47a50-c8", "ovs_interfaceid": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "address": "fa:16:3e:57:89:56", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd45e11fc-f0", "ovs_interfaceid": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-43b30269-a84c-4ac0-a347-8366a2d5c1a5 req-9fec241c-fb23-4ea9-9f4f-0536e8661c22 service nova] Releasing lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0526109-b657-4dcc-87c1-08ef2abd7450]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[954fe14d-ef73-450b-920f-7efbf28ccb49]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[97690ce1-78ff-47d6-88d7-cf7e2ca52a64]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d, portal: 172.16.0.220,3260]
Oct 20 02:05:34 user nova-compute[74242]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d, portal: 172.16.0.220,3260] successful.
Oct 20 02:05:34 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33fee36a-f75c-4b20-a0c8-a3098c28254d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db2363d-ef03-41d5-b1f0-b04228112299]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] <== disconnect_volume: return (306ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:05:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:05:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:38 user nova-compute[74242]: INFO nova.virt.block_device [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Booting with volume 2f690cba-01ce-436f-80c3-20a1c9f0d8cd at /dev/vdb
Oct 20 02:05:38 user nova-compute[74242]: DEBUG os_brick.utils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[11804883-9895-4b35-9293-564425f04c22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc71aad-34b5-4e54-8789-0fa532d3d794]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60583d1-a535-4cda-98e2-3ed13be88c45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b8e524-be47-4881-9681-4c8d04b2d782]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:05:38 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:05:38 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7586d66-c95b-4073-8b55-a3eeedaf0bed]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG os_brick.utils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:05:38 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updating existing volume attachment record: ab79bf5d-ea85-43a2-b9a7-11c3008ba35e {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:05:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVetpPcN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:05:46 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:05:46 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:05:46 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbfe9ae-8abc-4b2a-886d-f423722e5cca]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:05:46 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[032332a3-c9a5-4ccf-aa42-3dd5108cc397]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c] added
Oct 20 02:05:46 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccbf91a3-cba5-4404-a3ef-222451321ea4]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[91776511-d738-44a2-a241-1cef1f944bbc]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IVetpPcN {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IVetpPcN" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[296964e0-b254-4823-98b3-2399c40b2296]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IVetpPcN'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b870d004-6277-406d-a159-8e44f2ce7a47]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[301255a6-d74f-41a7-94d8-fa54184fa048]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:46 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:05:46 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:46 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:05:46 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb9516e-0492-4be2-a090-fc450c2f4ef0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c, portal: 172.16.0.220,3260]
Oct 20 02:05:46 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c, portal: 172.16.0.220,3260] successful.
Oct 20 02:05:46 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1449a7-03c6-449e-84dd-c1baca5d3cc8]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e963421-c6cd-46a3-b8e7-5c1b9591f060]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:46 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:05:46 user nova-compute[74242]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c (non-flash)
Oct 20 02:05:46 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:05:46 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:05:46 user nova-compute[74242]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c (non-flash)
Oct 20 02:05:46 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] HCTL ('34', '-', '-', 0) found on session 7 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9c54be-21a7-44c7-a943-3ae260e31dcb]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Searching for a device in session 7 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:05:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVetpPcN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:05:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.325s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:05:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23862353865646666', 'path': '/dev/sdc'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:05:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862353865646666', 'path': '/dev/sdc'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:05:47 user nova-compute[74242]: DEBUG nova.objects.instance [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lazy-loading 'flavor' on Instance uuid e22cb246-155d-48f5-9eee-bd543c0bbaf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:05:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:05:47 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:05:47 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:05:47 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:05:47 user nova-compute[74242]:   <serial>0ebc0088-c1ac-4e57-98c3-3637207d924c</serial>
Oct 20 02:05:47 user nova-compute[74242]: </disk>
Oct 20 02:05:47 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:05:47 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lazy-loading 'flavor' on Instance uuid ec8965b7-0f68-4445-bc29-a0584570de8e {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:05:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8d930f0d-65a1-4ba6-81d7-730027b3cac7 tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 34.035s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:05:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] No BDM found with device name hda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:05:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] No VIF found with MAC fa:16:3e:86:90:03, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:05:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b582cd7-8e0a-4b46-8d17-5a44d62b70f1 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.640s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "ec8965b7-0f68-4445-bc29-a0584570de8e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "ec8965b7-0f68-4445-bc29-a0584570de8e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:48 user nova-compute[74242]: INFO nova.compute.manager [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Terminating instance
Oct 20 02:05:49 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:49 user nova-compute[74242]: INFO nova.compute.manager [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Detaching volume 0ebc0088-c1ac-4e57-98c3-3637207d924c
Oct 20 02:05:49 user nova-compute[74242]: INFO nova.virt.block_device [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Attempting to driver detach volume 0ebc0088-c1ac-4e57-98c3-3637207d924c from mountpoint /dev/vdb
Oct 20 02:05:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-9a093a6b-017b-4c44-8a38-83cbd939f548 req-f37c12c7-6f4e-4879-933f-aa18a3d89d9d service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Received event network-vif-unplugged-021be9fd-6020-4990-803f-08001190c668 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9a093a6b-017b-4c44-8a38-83cbd939f548 req-f37c12c7-6f4e-4879-933f-aa18a3d89d9d service nova] Acquiring lock "ec8965b7-0f68-4445-bc29-a0584570de8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9a093a6b-017b-4c44-8a38-83cbd939f548 req-f37c12c7-6f4e-4879-933f-aa18a3d89d9d service nova] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9a093a6b-017b-4c44-8a38-83cbd939f548 req-f37c12c7-6f4e-4879-933f-aa18a3d89d9d service nova] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-9a093a6b-017b-4c44-8a38-83cbd939f548 req-f37c12c7-6f4e-4879-933f-aa18a3d89d9d service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] No waiting events found dispatching network-vif-unplugged-021be9fd-6020-4990-803f-08001190c668 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-9a093a6b-017b-4c44-8a38-83cbd939f548 req-f37c12c7-6f4e-4879-933f-aa18a3d89d9d service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Received event network-vif-unplugged-021be9fd-6020-4990-803f-08001190c668 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Attempting to detach device vdb from instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:05:49 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:05:49 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:05:49 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:05:49 user nova-compute[74242]:   <serial>0ebc0088-c1ac-4e57-98c3-3637207d924c</serial>
Oct 20 02:05:49 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 02:05:49 user nova-compute[74242]: </disk>
Oct 20 02:05:49 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:05:49 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Successfully detached device vdb from instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 from the persistent domain config.
Oct 20 02:05:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:05:49 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:05:49 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:05:49 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:05:49 user nova-compute[74242]:   <serial>0ebc0088-c1ac-4e57-98c3-3637207d924c</serial>
Oct 20 02:05:49 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 02:05:49 user nova-compute[74242]: </disk>
Oct 20 02:05:49 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:05:50 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Instance destroyed successfully.
Oct 20 02:05:50 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lazy-loading 'resources' on Instance uuid ec8965b7-0f68-4445-bc29-a0584570de8e {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:05:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:02:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1984968572',display_name='tempest-AttachSCSIVolumeTestJSON-server-1984968572',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1984968572',id=5,image_ref='74028ac9-9600-4738-9013-afd4f1f01416',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMPDkaPgGLXFU1/OzUmYk9jFQmkS5y/OjRQgtaSGkrx9jseoCiUEsBbkG6lHxQ6qpkYzSZcuqmI8rHvkgcYSiT8wmC267m3t1LAcgufa8nzGthd1nxrfV//yTmYwbBxHwA==',key_name='tempest-keypair-1364790523',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:03:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34d590ebe2f34743899f05f0ca0f53b0',ramdisk_id='',reservation_id='r-e8tovf2a',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='74028ac9-9600-4738-9013-afd4f1f01416',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-2135817157',owner_user_name='tempest-AttachSCSIVolumeTestJSON-2135817157-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:03:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='96d07ff6f5a04f8db75dacd6ad291ca4',uuid=ec8965b7-0f68-4445-bc29-a0584570de8e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "021be9fd-6020-4990-803f-08001190c668", "address": "fa:16:3e:4d:ba:d2", "network": {"id": "29396b47-375a-4974-a6cb-9b3dcf05dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1285119154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34d590ebe2f34743899f05f0ca0f53b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021be9fd-60", "ovs_interfaceid": "021be9fd-6020-4990-803f-08001190c668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:05:50 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Converting VIF {"id": "021be9fd-6020-4990-803f-08001190c668", "address": "fa:16:3e:4d:ba:d2", "network": {"id": "29396b47-375a-4974-a6cb-9b3dcf05dcbc", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1285119154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34d590ebe2f34743899f05f0ca0f53b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap021be9fd-60", "ovs_interfaceid": "021be9fd-6020-4990-803f-08001190c668", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:05:50 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4d:ba:d2,bridge_name='br-int',has_traffic_filtering=True,id=021be9fd-6020-4990-803f-08001190c668,network=Network(29396b47-375a-4974-a6cb-9b3dcf05dcbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021be9fd-60') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:05:50 user nova-compute[74242]: DEBUG os_vif [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:ba:d2,bridge_name='br-int',has_traffic_filtering=True,id=021be9fd-6020-4990-803f-08001190c668,network=Network(29396b47-375a-4974-a6cb-9b3dcf05dcbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021be9fd-60') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:05:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap021be9fd-60, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:05:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0400cc1-4b6d-4f10-a902-143d5709b63b) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:05:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:50 user nova-compute[74242]: INFO os_vif [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4d:ba:d2,bridge_name='br-int',has_traffic_filtering=True,id=021be9fd-6020-4990-803f-08001190c668,network=Network(29396b47-375a-4974-a6cb-9b3dcf05dcbc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap021be9fd-60')
Oct 20 02:05:50 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Deleting instance files /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e_del
Oct 20 02:05:50 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Deletion of /opt/stack/data/nova/instances/ec8965b7-0f68-4445-bc29-a0584570de8e_del complete
Oct 20 02:05:50 user nova-compute[74242]: INFO nova.compute.manager [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 20 02:05:50 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:05:50 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:05:50 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:05:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-82621c63-9066-45a0-9eb6-b45c4ab08b34 req-d51c4f6e-cf84-4c90-a1ee-2ee003a9121b service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Received event network-vif-plugged-021be9fd-6020-4990-803f-08001190c668 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-82621c63-9066-45a0-9eb6-b45c4ab08b34 req-d51c4f6e-cf84-4c90-a1ee-2ee003a9121b service nova] Acquiring lock "ec8965b7-0f68-4445-bc29-a0584570de8e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-82621c63-9066-45a0-9eb6-b45c4ab08b34 req-d51c4f6e-cf84-4c90-a1ee-2ee003a9121b service nova] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-82621c63-9066-45a0-9eb6-b45c4ab08b34 req-d51c4f6e-cf84-4c90-a1ee-2ee003a9121b service nova] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-82621c63-9066-45a0-9eb6-b45c4ab08b34 req-d51c4f6e-cf84-4c90-a1ee-2ee003a9121b service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] No waiting events found dispatching network-vif-plugged-021be9fd-6020-4990-803f-08001190c668 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:05:51 user nova-compute[74242]: WARNING nova.compute.manager [req-82621c63-9066-45a0-9eb6-b45c4ab08b34 req-d51c4f6e-cf84-4c90-a1ee-2ee003a9121b service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Received unexpected event network-vif-plugged-021be9fd-6020-4990-803f-08001190c668 for instance with vm_state active and task_state deleting.
Oct 20 02:05:51 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:05:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-0a954d67-78d8-41c4-8984-3dcbda3172dc req-bea46fe3-d3d8-41f1-88c0-d8716ae49fa7 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Received event network-vif-deleted-021be9fd-6020-4990-803f-08001190c668 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:05:51 user nova-compute[74242]: INFO nova.compute.manager [req-0a954d67-78d8-41c4-8984-3dcbda3172dc req-bea46fe3-d3d8-41f1-88c0-d8716ae49fa7 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Neutron deleted interface 021be9fd-6020-4990-803f-08001190c668; detaching it from the instance and deleting it from the info cache
Oct 20 02:05:51 user nova-compute[74242]: DEBUG nova.network.neutron [req-0a954d67-78d8-41c4-8984-3dcbda3172dc req-bea46fe3-d3d8-41f1-88c0-d8716ae49fa7 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:05:51 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Took 1.20 seconds to deallocate network for instance.
Oct 20 02:05:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-0a954d67-78d8-41c4-8984-3dcbda3172dc req-bea46fe3-d3d8-41f1-88c0-d8716ae49fa7 service nova] [instance: ec8965b7-0f68-4445-bc29-a0584570de8e] Detach interface failed, port_id=021be9fd-6020-4990-803f-08001190c668, reason: Instance ec8965b7-0f68-4445-bc29-a0584570de8e could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:05:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:05:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:05:51 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:05:51 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:05:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.348s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:51 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Deleted allocations for instance ec8965b7-0f68-4445-bc29-a0584570de8e
Oct 20 02:05:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8a8fb5ef-bad4-4457-9957-e706f83cdb2d tempest-AttachSCSIVolumeTestJSON-2135817157 tempest-AttachSCSIVolumeTestJSON-2135817157-project-member] Lock "ec8965b7-0f68-4445-bc29-a0584570de8e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.974s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:05:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:56 user nova-compute[74242]: INFO nova.virt.block_device [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Booting with volume e065c065-f373-44f2-a086-d493ba3a0bd8 at /dev/vdc
Oct 20 02:05:56 user nova-compute[74242]: DEBUG os_brick.utils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85eef00-2dea-4542-b1ab-25bfcf0f82ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edeeac6-d96e-4a5d-ab4c-7e799d1f5ff7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[23de0f73-767b-4de8-8842-5147c71a8e8d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80b569c-f28d-4fe8-a876-7e7143318d8a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:05:56 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:05:56 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb47746-9bc3-449e-9eed-6abb40c71e24]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG os_brick.utils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:05:56 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updating existing volume attachment record: acb6ccbd-4776-4195-a0d2-d80f8038e600 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:05:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:05:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Acquiring lock "d0231be7-4850-48ce-8757-fade8f3e4e25" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Acquiring lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:06 user nova-compute[74242]: INFO nova.compute.manager [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Terminating instance
Oct 20 02:06:06 user nova-compute[74242]: DEBUG nova.compute.manager [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-e164fea3-36f2-439c-8ee2-50c6265ffa9d req-d34b75cb-d842-410a-a485-552d3e7d0442 service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received event network-vif-unplugged-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e164fea3-36f2-439c-8ee2-50c6265ffa9d req-d34b75cb-d842-410a-a485-552d3e7d0442 service nova] Acquiring lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e164fea3-36f2-439c-8ee2-50c6265ffa9d req-d34b75cb-d842-410a-a485-552d3e7d0442 service nova] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e164fea3-36f2-439c-8ee2-50c6265ffa9d req-d34b75cb-d842-410a-a485-552d3e7d0442 service nova] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-e164fea3-36f2-439c-8ee2-50c6265ffa9d req-d34b75cb-d842-410a-a485-552d3e7d0442 service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] No waiting events found dispatching network-vif-unplugged-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-e164fea3-36f2-439c-8ee2-50c6265ffa9d req-d34b75cb-d842-410a-a485-552d3e7d0442 service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received event network-vif-unplugged-3ce48996-f63a-4331-8ac0-09af8a20548f for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:07 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Instance destroyed successfully.
Oct 20 02:06:07 user nova-compute[74242]: DEBUG nova.objects.instance [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lazy-loading 'resources' on Instance uuid d0231be7-4850-48ce-8757-fade8f3e4e25 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:03:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1136647226',display_name='tempest-VolumesActionsTest-instance-1136647226',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1136647226',id=8,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:03:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a463d28cea7941299b13a42f39f7d885',ramdisk_id='',reservation_id='r-37fqw5b8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1808425642',owner_user_name='tempest-VolumesActionsTest-1808425642-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:03:42Z,user_data=None,user_id='bdc01d186a974e0386d40868e3819caf',uuid=d0231be7-4850-48ce-8757-fade8f3e4e25,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ce48996-f63a-4331-8ac0-09af8a20548f", "address": "fa:16:3e:3d:b4:a8", "network": {"id": "9e9db320-57f7-473a-8b95-a0d46ad78525", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1430458944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a463d28cea7941299b13a42f39f7d885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce48996-f6", "ovs_interfaceid": "3ce48996-f63a-4331-8ac0-09af8a20548f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Converting VIF {"id": "3ce48996-f63a-4331-8ac0-09af8a20548f", "address": "fa:16:3e:3d:b4:a8", "network": {"id": "9e9db320-57f7-473a-8b95-a0d46ad78525", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1430458944-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a463d28cea7941299b13a42f39f7d885", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ce48996-f6", "ovs_interfaceid": "3ce48996-f63a-4331-8ac0-09af8a20548f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:b4:a8,bridge_name='br-int',has_traffic_filtering=True,id=3ce48996-f63a-4331-8ac0-09af8a20548f,network=Network(9e9db320-57f7-473a-8b95-a0d46ad78525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce48996-f6') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG os_vif [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:b4:a8,bridge_name='br-int',has_traffic_filtering=True,id=3ce48996-f63a-4331-8ac0-09af8a20548f,network=Network(9e9db320-57f7-473a-8b95-a0d46ad78525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce48996-f6') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ce48996-f6, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2065c27c-a67d-43a9-ba4d-dafeb562d687) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:07 user nova-compute[74242]: INFO os_vif [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:b4:a8,bridge_name='br-int',has_traffic_filtering=True,id=3ce48996-f63a-4331-8ac0-09af8a20548f,network=Network(9e9db320-57f7-473a-8b95-a0d46ad78525),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ce48996-f6')
Oct 20 02:06:07 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Deleting instance files /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25_del
Oct 20 02:06:07 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Deletion of /opt/stack/data/nova/instances/d0231be7-4850-48ce-8757-fade8f3e4e25_del complete
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:07 user nova-compute[74242]: INFO nova.compute.manager [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Took 1.05 seconds to destroy the instance on the hypervisor.
Oct 20 02:06:07 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "9a0fc135-ab9b-4b81-950d-84da9e99a422" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "9a0fc135-ab9b-4b81-950d-84da9e99a422" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "9a0fc135-ab9b-4b81-950d-84da9e99a422-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "9a0fc135-ab9b-4b81-950d-84da9e99a422-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "9a0fc135-ab9b-4b81-950d-84da9e99a422-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:07 user nova-compute[74242]: INFO nova.compute.manager [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Terminating instance
Oct 20 02:06:07 user nova-compute[74242]: DEBUG nova.compute.manager [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:06:08 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Took 0.81 seconds to deallocate network for instance.
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-4b60db5c-1005-4c61-9fbf-957b6fd53636 req-1c1549cd-7af0-4b95-858f-2598baf2c564 service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received event network-vif-deleted-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:08 user nova-compute[74242]: INFO nova.compute.manager [req-4b60db5c-1005-4c61-9fbf-957b6fd53636 req-1c1549cd-7af0-4b95-858f-2598baf2c564 service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Neutron deleted interface 3ce48996-f63a-4331-8ac0-09af8a20548f; detaching it from the instance and deleting it from the info cache
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.network.neutron [req-4b60db5c-1005-4c61-9fbf-957b6fd53636 req-1c1549cd-7af0-4b95-858f-2598baf2c564 service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-4b60db5c-1005-4c61-9fbf-957b6fd53636 req-1c1549cd-7af0-4b95-858f-2598baf2c564 service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Detach interface failed, port_id=3ce48996-f63a-4331-8ac0-09af8a20548f, reason: Instance d0231be7-4850-48ce-8757-fade8f3e4e25 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:08 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Instance destroyed successfully.
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.objects.instance [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lazy-loading 'resources' on Instance uuid 9a0fc135-ab9b-4b81-950d-84da9e99a422 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:04:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-351421422',display_name='tempest-ServersNegativeTestJSON-server-351421422',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-351421422',id=9,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:04:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a8561fb233b4571a47c188a1d9555dc',ramdisk_id='',reservation_id='r-mp6ehozx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-873263142',owner_user_name='tempest-ServersNegativeTestJSON-873263142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:04:24Z,user_data=None,user_id='fee6d4bd2fe04600a6962eeca70b0645',uuid=9a0fc135-ab9b-4b81-950d-84da9e99a422,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "address": "fa:16:3e:55:56:49", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982faaf3-9f", "ovs_interfaceid": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Converting VIF {"id": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "address": "fa:16:3e:55:56:49", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap982faaf3-9f", "ovs_interfaceid": "982faaf3-9f52-4af8-b2f7-18ecde4b280c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:56:49,bridge_name='br-int',has_traffic_filtering=True,id=982faaf3-9f52-4af8-b2f7-18ecde4b280c,network=Network(1b405f0d-8443-4073-9a46-631015e6ac57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982faaf3-9f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG os_vif [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:56:49,bridge_name='br-int',has_traffic_filtering=True,id=982faaf3-9f52-4af8-b2f7-18ecde4b280c,network=Network(1b405f0d-8443-4073-9a46-631015e6ac57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982faaf3-9f') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap982faaf3-9f, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=71458b2f-772a-44ff-a74c-1c95d6811410) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:08 user nova-compute[74242]: INFO os_vif [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:56:49,bridge_name='br-int',has_traffic_filtering=True,id=982faaf3-9f52-4af8-b2f7-18ecde4b280c,network=Network(1b405f0d-8443-4073-9a46-631015e6ac57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap982faaf3-9f')
Oct 20 02:06:08 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Deleting instance files /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422_del
Oct 20 02:06:08 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Deletion of /opt/stack/data/nova/instances/9a0fc135-ab9b-4b81-950d-84da9e99a422_del complete
Oct 20 02:06:08 user nova-compute[74242]: INFO nova.compute.manager [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Took 1.06 seconds to destroy the instance on the hypervisor.
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.495s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:08 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Deleted allocations for instance d0231be7-4850-48ce-8757-fade8f3e4e25
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-66d85087-4dfd-4b14-893f-13e948001576 req-ce8ac05e-4dad-41fa-9a7b-b1ccfb5c38e5 service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received event network-changed-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-66d85087-4dfd-4b14-893f-13e948001576 req-ce8ac05e-4dad-41fa-9a7b-b1ccfb5c38e5 service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Refreshing instance network info cache due to event network-changed-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-66d85087-4dfd-4b14-893f-13e948001576 req-ce8ac05e-4dad-41fa-9a7b-b1ccfb5c38e5 service nova] Acquiring lock "refresh_cache-5cea10bc-ac5a-48b0-b6b7-7db8f520339d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-66d85087-4dfd-4b14-893f-13e948001576 req-ce8ac05e-4dad-41fa-9a7b-b1ccfb5c38e5 service nova] Acquired lock "refresh_cache-5cea10bc-ac5a-48b0-b6b7-7db8f520339d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.network.neutron [req-66d85087-4dfd-4b14-893f-13e948001576 req-ce8ac05e-4dad-41fa-9a7b-b1ccfb5c38e5 service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Refreshing network info cache for port 5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received event network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] Acquiring lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] No waiting events found dispatching network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:08 user nova-compute[74242]: WARNING nova.compute.manager [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received unexpected event network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f for instance with vm_state deleted and task_state None.
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received event network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] Acquiring lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] No waiting events found dispatching network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:08 user nova-compute[74242]: WARNING nova.compute.manager [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received unexpected event network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f for instance with vm_state deleted and task_state None.
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received event network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] Acquiring lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] No waiting events found dispatching network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:08 user nova-compute[74242]: WARNING nova.compute.manager [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received unexpected event network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f for instance with vm_state deleted and task_state None.
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received event network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] Acquiring lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] No waiting events found dispatching network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:08 user nova-compute[74242]: WARNING nova.compute.manager [req-30e7bb9d-3118-4b92-9421-8084061f302b req-3d493ee8-ffe2-4f68-ad12-55f1ee6e0aea service nova] [instance: d0231be7-4850-48ce-8757-fade8f3e4e25] Received unexpected event network-vif-plugged-3ce48996-f63a-4331-8ac0-09af8a20548f for instance with vm_state deleted and task_state None.
Oct 20 02:06:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-618d55cb-e3dc-470a-8b70-c545303e1206 tempest-VolumesActionsTest-1808425642 tempest-VolumesActionsTest-1808425642-project-member] Lock "d0231be7-4850-48ce-8757-fade8f3e4e25" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.666s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:09 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:06:09 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Took 1.33 seconds to deallocate network for instance.
Oct 20 02:06:10 user nova-compute[74242]: DEBUG nova.network.neutron [req-66d85087-4dfd-4b14-893f-13e948001576 req-ce8ac05e-4dad-41fa-9a7b-b1ccfb5c38e5 service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Updated VIF entry in instance network info cache for port 5fe0eca0-44d0-43d0-acc4-b34fa7126eaf. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG nova.network.neutron [req-66d85087-4dfd-4b14-893f-13e948001576 req-ce8ac05e-4dad-41fa-9a7b-b1ccfb5c38e5 service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Updating instance_info_cache with network_info: [{"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:06:10 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 is timed out.
Oct 20 02:06:10 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Successfully detached device vdb from instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 from the live domain config.
Oct 20 02:06:10 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IVetpPcN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:06:10 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-66d85087-4dfd-4b14-893f-13e948001576 req-ce8ac05e-4dad-41fa-9a7b-b1ccfb5c38e5 service nova] Releasing lock "refresh_cache-5cea10bc-ac5a-48b0-b6b7-7db8f520339d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec3196e-6943-4c67-9d6e-3b5bc31ef74b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:06:10 user nova-compute[74242]: No targets found.
Oct 20 02:06:10 user nova-compute[74242]: iSNS:
Oct 20 02:06:10 user nova-compute[74242]: No targets found.
Oct 20 02:06:10 user nova-compute[74242]: STATIC:
Oct 20 02:06:10 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7
Oct 20 02:06:10 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:06:10 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:06:10 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68
Oct 20 02:06:10 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:06:10 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:06:10 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c
Oct 20 02:06:10 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:06:10 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:06:10 user nova-compute[74242]: FIRMWARE:
Oct 20 02:06:10 user nova-compute[74242]: No targets found.
Oct 20 02:06:10 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:06:10 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:06:10 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:10 user nova-compute[74242]: INFO nova.compute.manager [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Rebuilding instance
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf54361e-4715-416b-a0da-4517c9e72f6b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1120971-33e1-4a90-b1d0-5f04769b02b9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:06:10 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:10 user nova-compute[74242]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c (non-flash)
Oct 20 02:06:10 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:06:10 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:10 user nova-compute[74242]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c (non-flash)
Oct 20 02:06:10 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b86a0940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c'): ({'sdc'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Removing single pathed devices sdc {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[be393423-5ad5-42c7-90f3-bb9378c7175f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.029s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b65f6d39-61ca-49df-8743-7800943093b5]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Flushing IO for device /dev/sdc {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e458e386-acdc-41bc-a933-e38e0d314e73]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG nova.compute.manager [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.046s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ed21fc-0512-4f8a-98bc-6e3321f82065]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG nova.compute.manager [req-927765db-0e7f-4b4e-9531-a3a7bc0da6c9 req-3afb67c7-fb12-420b-9539-04fec78a2620 service nova] [instance: 9a0fc135-ab9b-4b81-950d-84da9e99a422] Received event network-vif-deleted-982faaf3-9f52-4af8-b2f7-18ecde4b280c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac69e6c-d075-4d55-983b-c0cbb20abbe6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[15822742-1bbb-445a-bc19-b92d256c4d54]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c, portal: 172.16.0.220,3260]
Oct 20 02:06:10 user nova-compute[74242]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c, portal: 172.16.0.220,3260] successful.
Oct 20 02:06:10 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebc0088-c1ac-4e57-98c3-3637207d924c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a822a0-b202-4776-a106-1e44cc0ec951]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.404s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] <== disconnect_volume: return (407ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.501s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:10 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Deleted allocations for instance 9a0fc135-ab9b-4b81-950d-84da9e99a422
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fe5d1de2-8688-4689-9c2a-55784ba06d7b tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "9a0fc135-ab9b-4b81-950d-84da9e99a422" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.208s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG nova.compute.manager [req-fc5b6463-4ef4-475f-8e27-ec22fe0f5c6a req-e718569f-1535-45cf-9e5f-e6c9fce6465d service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received event network-vif-unplugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fc5b6463-4ef4-475f-8e27-ec22fe0f5c6a req-e718569f-1535-45cf-9e5f-e6c9fce6465d service nova] Acquiring lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fc5b6463-4ef4-475f-8e27-ec22fe0f5c6a req-e718569f-1535-45cf-9e5f-e6c9fce6465d service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fc5b6463-4ef4-475f-8e27-ec22fe0f5c6a req-e718569f-1535-45cf-9e5f-e6c9fce6465d service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:10 user nova-compute[74242]: DEBUG nova.compute.manager [req-fc5b6463-4ef4-475f-8e27-ec22fe0f5c6a req-e718569f-1535-45cf-9e5f-e6c9fce6465d service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] No waiting events found dispatching network-vif-unplugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:10 user nova-compute[74242]: WARNING nova.compute.manager [req-fc5b6463-4ef4-475f-8e27-ec22fe0f5c6a req-e718569f-1535-45cf-9e5f-e6c9fce6465d service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received unexpected event network-vif-unplugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf for instance with vm_state active and task_state rebuilding.
Oct 20 02:06:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:11 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Instance destroyed successfully.
Oct 20 02:06:11 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Instance destroyed successfully.
Oct 20 02:06:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:04:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-188573106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1398678858',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByq2xkP/vLfwqbivLj0KOupEkRC+NVhYdkJQ+o9Ygk0jtRSmlqIS+Xl5BP30YNRKfmP8HR4R+7hEidAzKb1ATRlMuwuTOJ2xjm20F8owUQAX54yM4FHVtvIf38i+rcUgw==',key_name='tempest-keypair-522194978',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:04:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='647e5ec77b024268af7209c8a0b73380',ramdisk_id='',reservation_id='r-sntnqamj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-320668090',owner_user_name='tempest-ServerActionsV293TestJSON-320668090-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:06:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67ba274f41b04cbaa4cbfd77948bb7e6',uuid=5cea10bc-ac5a-48b0-b6b7-7db8f520339d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Converting VIF {"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=5fe0eca0-44d0-43d0-acc4-b34fa7126eaf,network=Network(ba22ead9-82b0-4d2e-82d8-851d65f25ab1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe0eca0-44') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_vif [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=5fe0eca0-44d0-43d0-acc4-b34fa7126eaf,network=Network(ba22ead9-82b0-4d2e-82d8-851d65f25ab1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe0eca0-44') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fe0eca0-44, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d2ef1968-57d0-46c1-b061-3c1372012472) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:11 user nova-compute[74242]: INFO os_vif [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=5fe0eca0-44d0-43d0-acc4-b34fa7126eaf,network=Network(ba22ead9-82b0-4d2e-82d8-851d65f25ab1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe0eca0-44')
Oct 20 02:06:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkyiaYHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:06:11 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b58cf20-72c2-4f88-921b-c9208c828e20]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:06:11 user nova-compute[74242]: No targets found.
Oct 20 02:06:11 user nova-compute[74242]: iSNS:
Oct 20 02:06:11 user nova-compute[74242]: No targets found.
Oct 20 02:06:11 user nova-compute[74242]: STATIC:
Oct 20 02:06:11 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7
Oct 20 02:06:11 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:06:11 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:06:11 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68
Oct 20 02:06:11 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:06:11 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:06:11 user nova-compute[74242]: FIRMWARE:
Oct 20 02:06:11 user nova-compute[74242]: No targets found.
Oct 20 02:06:11 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:06:11 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:06:11 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5717e29c-abff-4053-89f7-c439915b7280]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ba5f73-5bbf-4521-98eb-eb4898f5e4e3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:06:11 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:11 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:06:11 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:11 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b82e5000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68'): ({'sdb'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Removing single pathed devices sdb {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1764b10-4d2e-4cc0-9e5b-a2dd7ac789bb]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b17f233-3895-4528-845c-3951d2d0d441]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Flushing IO for device /dev/sdb {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[883f44ff-609b-4ae8-bf65-64f238dc336b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2182f5fe-a992-4663-a59f-e6112be0395f]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ec5875-bd36-4cde-a244-ccc82aa9d432]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c56b70-5d11-4291-abb3-d4ca0ea33f88]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260]
Oct 20 02:06:11 user nova-compute[74242]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260] successful.
Oct 20 02:06:11 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf457708-cbe3-405c-8469-49ebce389d0f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] <== disconnect_volume: return (290ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:06:11 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Deleting instance files /opt/stack/data/nova/instances/5cea10bc-ac5a-48b0-b6b7-7db8f520339d_del
Oct 20 02:06:11 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Deletion of /opt/stack/data/nova/instances/5cea10bc-ac5a-48b0-b6b7-7db8f520339d_del complete
Oct 20 02:06:11 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 5cea10bc-ac5a-48b0-b6b7-7db8f520339d could not be found.
Oct 20 02:06:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkyiaYHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:06:11 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[09eddebf-ec6d-4eb0-935e-720de344be03]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:06:11 user nova-compute[74242]: No targets found.
Oct 20 02:06:11 user nova-compute[74242]: iSNS:
Oct 20 02:06:11 user nova-compute[74242]: No targets found.
Oct 20 02:06:11 user nova-compute[74242]: STATIC:
Oct 20 02:06:11 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7
Oct 20 02:06:11 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:06:11 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:06:11 user nova-compute[74242]: FIRMWARE:
Oct 20 02:06:11 user nova-compute[74242]: No targets found.
Oct 20 02:06:11 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:06:11 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:06:11 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[794693cc-2f96-4dc1-bbb3-96268cc513cf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[de9ed451-cef4-41fc-915e-5f3e70935781]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:11 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:11 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b8348790>, {}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Disconnecting from: [] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.091s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] <== disconnect_volume: return (93ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:06:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:12 user nova-compute[74242]: DEBUG nova.compute.manager [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Preparing to wait for external event volume-reimaged-6e79478c-34db-431c-86df-ffa42a493f68 {{(pid=74242) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 20 02:06:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Acquiring lock "d87147b4-29ec-4e82-8525-b795647422bd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "d87147b4-29ec-4e82-8525-b795647422bd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Acquiring lock "d87147b4-29ec-4e82-8525-b795647422bd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "d87147b4-29ec-4e82-8525-b795647422bd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "d87147b4-29ec-4e82-8525-b795647422bd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:12 user nova-compute[74242]: INFO nova.compute.manager [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Terminating instance
Oct 20 02:06:12 user nova-compute[74242]: DEBUG nova.compute.manager [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG nova.compute.manager [req-8072bd40-a753-45ba-a4d5-66fceabacd1e req-10993076-f363-495e-957d-440407cc754f service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received event network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8072bd40-a753-45ba-a4d5-66fceabacd1e req-10993076-f363-495e-957d-440407cc754f service nova] Acquiring lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8072bd40-a753-45ba-a4d5-66fceabacd1e req-10993076-f363-495e-957d-440407cc754f service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8072bd40-a753-45ba-a4d5-66fceabacd1e req-10993076-f363-495e-957d-440407cc754f service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG nova.compute.manager [req-8072bd40-a753-45ba-a4d5-66fceabacd1e req-10993076-f363-495e-957d-440407cc754f service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] No event matching network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf in dict_keys([('volume-reimaged', '6e79478c-34db-431c-86df-ffa42a493f68')]) {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Oct 20 02:06:13 user nova-compute[74242]: WARNING nova.compute.manager [req-8072bd40-a753-45ba-a4d5-66fceabacd1e req-10993076-f363-495e-957d-440407cc754f service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received unexpected event network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf for instance with vm_state active and task_state rebuilding.
Oct 20 02:06:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:13 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Instance destroyed successfully.
Oct 20 02:06:13 user nova-compute[74242]: DEBUG nova.objects.instance [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lazy-loading 'resources' on Instance uuid d87147b4-29ec-4e82-8525-b795647422bd {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:02:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1800132474',display_name='tempest-VolumesAssistedSnapshotsTest-server-1800132474',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1800132474',id=6,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGRSyvm6N4dfNXEya1XkAc/iDMXoU0QMvnsIZXB19o8PTOm5vO8scq7fHInaXUbdEoQxIkF3ADD6pZ2RoJLZ2njfQ7emcmzHMV2XRO+23gTwdhwPr0OzFQR+/t+AasLtMg==',key_name='tempest-keypair-384468491',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:03:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='29ef800f86ac45a4be04b234f72b43b0',ramdisk_id='',reservation_id='r-29lszntt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1664071548',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1664071548-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:03:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='346f4f728e8b4b9c8f77cbeb588be8b8',uuid=d87147b4-29ec-4e82-8525-b795647422bd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0c67b16f-3a40-471a-a468-c1f15e5160af", "address": "fa:16:3e:78:da:eb", "network": {"id": "d271dbb4-e918-4562-b162-0ba34f9ed9e2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1682652744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef800f86ac45a4be04b234f72b43b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67b16f-3a", "ovs_interfaceid": "0c67b16f-3a40-471a-a468-c1f15e5160af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Converting VIF {"id": "0c67b16f-3a40-471a-a468-c1f15e5160af", "address": "fa:16:3e:78:da:eb", "network": {"id": "d271dbb4-e918-4562-b162-0ba34f9ed9e2", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1682652744-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "29ef800f86ac45a4be04b234f72b43b0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0c67b16f-3a", "ovs_interfaceid": "0c67b16f-3a40-471a-a468-c1f15e5160af", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:da:eb,bridge_name='br-int',has_traffic_filtering=True,id=0c67b16f-3a40-471a-a468-c1f15e5160af,network=Network(d271dbb4-e918-4562-b162-0ba34f9ed9e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c67b16f-3a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG os_vif [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:da:eb,bridge_name='br-int',has_traffic_filtering=True,id=0c67b16f-3a40-471a-a468-c1f15e5160af,network=Network(d271dbb4-e918-4562-b162-0ba34f9ed9e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c67b16f-3a') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0c67b16f-3a, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=41e18b94-a58a-4fc9-aaa0-bd0df9cd9cf3) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:13 user nova-compute[74242]: INFO os_vif [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:da:eb,bridge_name='br-int',has_traffic_filtering=True,id=0c67b16f-3a40-471a-a468-c1f15e5160af,network=Network(d271dbb4-e918-4562-b162-0ba34f9ed9e2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0c67b16f-3a')
Oct 20 02:06:13 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Deleting instance files /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd_del
Oct 20 02:06:13 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Deletion of /opt/stack/data/nova/instances/d87147b4-29ec-4e82-8525-b795647422bd_del complete
Oct 20 02:06:13 user nova-compute[74242]: INFO nova.compute.manager [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 02:06:13 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:06:13 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: d87147b4-29ec-4e82-8525-b795647422bd] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:06:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-54f30bd2-bd5e-4eb3-82cd-bd025233288d req-fc2c0af4-03ca-4f62-8f49-e6e5eed8bea8 service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Received event network-vif-unplugged-0c67b16f-3a40-471a-a468-c1f15e5160af {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-54f30bd2-bd5e-4eb3-82cd-bd025233288d req-fc2c0af4-03ca-4f62-8f49-e6e5eed8bea8 service nova] Acquiring lock "d87147b4-29ec-4e82-8525-b795647422bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-54f30bd2-bd5e-4eb3-82cd-bd025233288d req-fc2c0af4-03ca-4f62-8f49-e6e5eed8bea8 service nova] Lock "d87147b4-29ec-4e82-8525-b795647422bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-54f30bd2-bd5e-4eb3-82cd-bd025233288d req-fc2c0af4-03ca-4f62-8f49-e6e5eed8bea8 service nova] Lock "d87147b4-29ec-4e82-8525-b795647422bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-54f30bd2-bd5e-4eb3-82cd-bd025233288d req-fc2c0af4-03ca-4f62-8f49-e6e5eed8bea8 service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] No waiting events found dispatching network-vif-unplugged-0c67b16f-3a40-471a-a468-c1f15e5160af {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-54f30bd2-bd5e-4eb3-82cd-bd025233288d req-fc2c0af4-03ca-4f62-8f49-e6e5eed8bea8 service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Received event network-vif-unplugged-0c67b16f-3a40-471a-a468-c1f15e5160af for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-54f30bd2-bd5e-4eb3-82cd-bd025233288d req-fc2c0af4-03ca-4f62-8f49-e6e5eed8bea8 service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Received event network-vif-plugged-0c67b16f-3a40-471a-a468-c1f15e5160af {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-54f30bd2-bd5e-4eb3-82cd-bd025233288d req-fc2c0af4-03ca-4f62-8f49-e6e5eed8bea8 service nova] Acquiring lock "d87147b4-29ec-4e82-8525-b795647422bd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-54f30bd2-bd5e-4eb3-82cd-bd025233288d req-fc2c0af4-03ca-4f62-8f49-e6e5eed8bea8 service nova] Lock "d87147b4-29ec-4e82-8525-b795647422bd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-54f30bd2-bd5e-4eb3-82cd-bd025233288d req-fc2c0af4-03ca-4f62-8f49-e6e5eed8bea8 service nova] Lock "d87147b4-29ec-4e82-8525-b795647422bd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-54f30bd2-bd5e-4eb3-82cd-bd025233288d req-fc2c0af4-03ca-4f62-8f49-e6e5eed8bea8 service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] No waiting events found dispatching network-vif-plugged-0c67b16f-3a40-471a-a468-c1f15e5160af {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:15 user nova-compute[74242]: WARNING nova.compute.manager [req-54f30bd2-bd5e-4eb3-82cd-bd025233288d req-fc2c0af4-03ca-4f62-8f49-e6e5eed8bea8 service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Received unexpected event network-vif-plugged-0c67b16f-3a40-471a-a468-c1f15e5160af for instance with vm_state active and task_state deleting.
Oct 20 02:06:15 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Took 1.27 seconds to deallocate network for instance.
Oct 20 02:06:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-2c4f2667-4315-448f-a267-6c0d98b7e8d9 req-8ada60f2-2bc8-4413-a9fd-439336d78ccf service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Received event network-vif-deleted-0c67b16f-3a40-471a-a468-c1f15e5160af {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:15 user nova-compute[74242]: INFO nova.compute.manager [req-2c4f2667-4315-448f-a267-6c0d98b7e8d9 req-8ada60f2-2bc8-4413-a9fd-439336d78ccf service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Neutron deleted interface 0c67b16f-3a40-471a-a468-c1f15e5160af; detaching it from the instance and deleting it from the info cache
Oct 20 02:06:15 user nova-compute[74242]: DEBUG nova.network.neutron [req-2c4f2667-4315-448f-a267-6c0d98b7e8d9 req-8ada60f2-2bc8-4413-a9fd-439336d78ccf service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-2c4f2667-4315-448f-a267-6c0d98b7e8d9 req-8ada60f2-2bc8-4413-a9fd-439336d78ccf service nova] [instance: d87147b4-29ec-4e82-8525-b795647422bd] Detach interface failed, port_id=0c67b16f-3a40-471a-a468-c1f15e5160af, reason: Instance d87147b4-29ec-4e82-8525-b795647422bd could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:06:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:15 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Deleted allocations for instance d87147b4-29ec-4e82-8525-b795647422bd
Oct 20 02:06:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-09197279-b10f-46cd-a1c1-b99f138bc9b6 tempest-VolumesAssistedSnapshotsTest-1664071548 tempest-VolumesAssistedSnapshotsTest-1664071548-project-member] Lock "d87147b4-29ec-4e82-8525-b795647422bd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.710s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:16 user nova-compute[74242]: DEBUG nova.objects.instance [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lazy-loading 'flavor' on Instance uuid e22cb246-155d-48f5-9eee-bd543c0bbaf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0d9395e5-afa6-45a3-9345-73640e586204 tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 27.988s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "interface-e22cb246-155d-48f5-9eee-bd543c0bbaf1-b71ba39e-3a76-4e07-971a-383990d2d6a3" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "interface-e22cb246-155d-48f5-9eee-bd543c0bbaf1-b71ba39e-3a76-4e07-971a-383990d2d6a3" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.objects.instance [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lazy-loading 'flavor' on Instance uuid e22cb246-155d-48f5-9eee-bd543c0bbaf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1179443261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1179443261',id=7,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpogir2lL5fxgT+aGdQt1FD0OBJl3IivuczQXbzwg0f71VsW0nMR64AVx2F5qXSCYftEKlBnA8CPoiaBKJjZl9XM4BiISexAmTWuqad0JPqRMC1MStDpdYS3HjZNGmZWg==',key_name='tempest-keypair-808065593',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28a8e047fa564263971543d6342579b1',ramdisk_id='',reservation_id='r-91z09vmf',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-789715889',owner_user_name='tempest-TaggedAttachmentsTest-789715889-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81797a2a7a744fa8298b767cf469631',uuid=e22cb246-155d-48f5-9eee-bd543c0bbaf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "address": "fa:16:3e:87:07:58", "network": {"id": "b33a8d23-714f-435e-8194-0add90523af5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1175840430", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71ba39e-3a", "ovs_interfaceid": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Converting VIF {"id": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "address": "fa:16:3e:87:07:58", "network": {"id": "b33a8d23-714f-435e-8194-0add90523af5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1175840430", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71ba39e-3a", "ovs_interfaceid": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:58,bridge_name='br-int',has_traffic_filtering=True,id=b71ba39e-3a76-4e07-971a-383990d2d6a3,network=Network(b33a8d23-714f-435e-8194-0add90523af5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71ba39e-3a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:07:58"/><model type="virtio"/><mtu size="1442"/><target dev="tapb71ba39e-3a"/></interface> {{(pid=74242) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:07:58"/><model type="virtio"/><mtu size="1442"/><target dev="tapb71ba39e-3a"/></interface> {{(pid=74242) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Attempting to detach device tapb71ba39e-3a from instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] detach device xml: <interface type="ethernet">
Oct 20 02:06:17 user nova-compute[74242]:   <mac address="fa:16:3e:87:07:58"/>
Oct 20 02:06:17 user nova-compute[74242]:   <model type="virtio"/>
Oct 20 02:06:17 user nova-compute[74242]:   <mtu size="1442"/>
Oct 20 02:06:17 user nova-compute[74242]:   <target dev="tapb71ba39e-3a"/>
Oct 20 02:06:17 user nova-compute[74242]: </interface>
Oct 20 02:06:17 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:07:58"/><model type="virtio"/><mtu size="1442"/><target dev="tapb71ba39e-3a"/></interface> {{(pid=74242) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:87:07:58"/><model type="virtio"/><mtu size="1442"/><target dev="tapb71ba39e-3a"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 20 02:06:17 user nova-compute[74242]:   <name>instance-00000007</name>
Oct 20 02:06:17 user nova-compute[74242]:   <uuid>e22cb246-155d-48f5-9eee-bd543c0bbaf1</uuid>
Oct 20 02:06:17 user nova-compute[74242]:   <metadata>
Oct 20 02:06:17 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:06:17 user nova-compute[74242]:   <nova:package version="0.0.0"/>
Oct 20 02:06:17 user nova-compute[74242]:   <nova:name>tempest-device-tagging-server-1179443261</nova:name>
Oct 20 02:06:17 user nova-compute[74242]:   <nova:creationTime>2023-10-20 02:05:26</nova:creationTime>
Oct 20 02:06:17 user nova-compute[74242]:   <nova:flavor name="m1.tiny">
Oct 20 02:06:17 user nova-compute[74242]:     <nova:memory>512</nova:memory>
Oct 20 02:06:17 user nova-compute[74242]:     <nova:disk>1</nova:disk>
Oct 20 02:06:17 user nova-compute[74242]:     <nova:swap>0</nova:swap>
Oct 20 02:06:17 user nova-compute[74242]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:06:17 user nova-compute[74242]:     <nova:vcpus>1</nova:vcpus>
Oct 20 02:06:17 user nova-compute[74242]:   </nova:flavor>
Oct 20 02:06:17 user nova-compute[74242]:   <nova:owner>
Oct 20 02:06:17 user nova-compute[74242]:     <nova:user uuid="e81797a2a7a744fa8298b767cf469631">tempest-TaggedAttachmentsTest-789715889-project-member</nova:user>
Oct 20 02:06:17 user nova-compute[74242]:     <nova:project uuid="28a8e047fa564263971543d6342579b1">tempest-TaggedAttachmentsTest-789715889</nova:project>
Oct 20 02:06:17 user nova-compute[74242]:   </nova:owner>
Oct 20 02:06:17 user nova-compute[74242]:   <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:06:17 user nova-compute[74242]:   <nova:ports>
Oct 20 02:06:17 user nova-compute[74242]:     <nova:port uuid="7575478b-29e4-493e-a04f-0e3747a5c64a">
Oct 20 02:06:17 user nova-compute[74242]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 02:06:17 user nova-compute[74242]:     </nova:port>
Oct 20 02:06:17 user nova-compute[74242]:     <nova:port uuid="b71ba39e-3a76-4e07-971a-383990d2d6a3">
Oct 20 02:06:17 user nova-compute[74242]:       <nova:ip type="fixed" address="10.10.10.226" ipVersion="4"/>
Oct 20 02:06:17 user nova-compute[74242]:     </nova:port>
Oct 20 02:06:17 user nova-compute[74242]:   </nova:ports>
Oct 20 02:06:17 user nova-compute[74242]: </nova:instance>
Oct 20 02:06:17 user nova-compute[74242]:   </metadata>
Oct 20 02:06:17 user nova-compute[74242]:   <memory unit='KiB'>524288</memory>
Oct 20 02:06:17 user nova-compute[74242]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 02:06:17 user nova-compute[74242]:   <vcpu placement='static'>1</vcpu>
Oct 20 02:06:17 user nova-compute[74242]:   <resource>
Oct 20 02:06:17 user nova-compute[74242]:     <partition>/machine</partition>
Oct 20 02:06:17 user nova-compute[74242]:   </resource>
Oct 20 02:06:17 user nova-compute[74242]:   <sysinfo type='smbios'>
Oct 20 02:06:17 user nova-compute[74242]:     <system>
Oct 20 02:06:17 user nova-compute[74242]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 02:06:17 user nova-compute[74242]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 02:06:17 user nova-compute[74242]:       <entry name='version'>0.0.0</entry>
Oct 20 02:06:17 user nova-compute[74242]:       <entry name='serial'>e22cb246-155d-48f5-9eee-bd543c0bbaf1</entry>
Oct 20 02:06:17 user nova-compute[74242]:       <entry name='uuid'>e22cb246-155d-48f5-9eee-bd543c0bbaf1</entry>
Oct 20 02:06:17 user nova-compute[74242]:       <entry name='family'>Virtual Machine</entry>
Oct 20 02:06:17 user nova-compute[74242]:     </system>
Oct 20 02:06:17 user nova-compute[74242]:   </sysinfo>
Oct 20 02:06:17 user nova-compute[74242]:   <os>
Oct 20 02:06:17 user nova-compute[74242]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 02:06:17 user nova-compute[74242]:     <boot dev='hd'/>
Oct 20 02:06:17 user nova-compute[74242]:     <smbios mode='sysinfo'/>
Oct 20 02:06:17 user nova-compute[74242]:   </os>
Oct 20 02:06:17 user nova-compute[74242]:   <features>
Oct 20 02:06:17 user nova-compute[74242]:     <acpi/>
Oct 20 02:06:17 user nova-compute[74242]:     <apic/>
Oct 20 02:06:17 user nova-compute[74242]:     <vmcoreinfo state='on'/>
Oct 20 02:06:17 user nova-compute[74242]:   </features>
Oct 20 02:06:17 user nova-compute[74242]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 02:06:17 user nova-compute[74242]:     <model fallback='forbid'>Nehalem</model>
Oct 20 02:06:17 user nova-compute[74242]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 02:06:17 user nova-compute[74242]:     <feature policy='require' name='vme'/>
Oct 20 02:06:17 user nova-compute[74242]:     <feature policy='require' name='x2apic'/>
Oct 20 02:06:17 user nova-compute[74242]:     <feature policy='require' name='hypervisor'/>
Oct 20 02:06:17 user nova-compute[74242]:   </cpu>
Oct 20 02:06:17 user nova-compute[74242]:   <clock offset='utc'>
Oct 20 02:06:17 user nova-compute[74242]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 02:06:17 user nova-compute[74242]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 02:06:17 user nova-compute[74242]:     <timer name='hpet' present='no'/>
Oct 20 02:06:17 user nova-compute[74242]:   </clock>
Oct 20 02:06:17 user nova-compute[74242]:   <on_poweroff>destroy</on_poweroff>
Oct 20 02:06:17 user nova-compute[74242]:   <on_reboot>restart</on_reboot>
Oct 20 02:06:17 user nova-compute[74242]:   <on_crash>destroy</on_crash>
Oct 20 02:06:17 user nova-compute[74242]:   <devices>
Oct 20 02:06:17 user nova-compute[74242]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 02:06:17 user nova-compute[74242]:     <disk type='file' device='disk'>
Oct 20 02:06:17 user nova-compute[74242]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 02:06:17 user nova-compute[74242]:       <source file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk' index='2'/>
Oct 20 02:06:17 user nova-compute[74242]:       <backingStore type='file' index='3'>
Oct 20 02:06:17 user nova-compute[74242]:         <format type='raw'/>
Oct 20 02:06:17 user nova-compute[74242]:         <source file='/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8'/>
Oct 20 02:06:17 user nova-compute[74242]:         <backingStore/>
Oct 20 02:06:17 user nova-compute[74242]:       </backingStore>
Oct 20 02:06:17 user nova-compute[74242]:       <target dev='vda' bus='virtio'/>
Oct 20 02:06:17 user nova-compute[74242]:       <alias name='virtio-disk0'/>
Oct 20 02:06:17 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 02:06:17 user nova-compute[74242]:     </disk>
Oct 20 02:06:17 user nova-compute[74242]:     <disk type='file' device='cdrom'>
Oct 20 02:06:17 user nova-compute[74242]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 02:06:17 user nova-compute[74242]:       <source file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk.config' index='1'/>
Oct 20 02:06:17 user nova-compute[74242]:       <backingStore/>
Oct 20 02:06:17 user nova-compute[74242]:       <target dev='hda' bus='ide'/>
Oct 20 02:06:17 user nova-compute[74242]:       <readonly/>
Oct 20 02:06:17 user nova-compute[74242]:       <alias name='ide0-0-0'/>
Oct 20 02:06:17 user nova-compute[74242]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 02:06:17 user nova-compute[74242]:     </disk>
Oct 20 02:06:17 user nova-compute[74242]:     <controller type='usb' index='0' model='none'>
Oct 20 02:06:17 user nova-compute[74242]:       <alias name='usb'/>
Oct 20 02:06:17 user nova-compute[74242]:     </controller>
Oct 20 02:06:17 user nova-compute[74242]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 02:06:17 user nova-compute[74242]:       <alias name='pci.0'/>
Oct 20 02:06:17 user nova-compute[74242]:     </controller>
Oct 20 02:06:17 user nova-compute[74242]:     <controller type='ide' index='0'>
Oct 20 02:06:17 user nova-compute[74242]:       <alias name='ide'/>
Oct 20 02:06:17 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 02:06:17 user nova-compute[74242]:     </controller>
Oct 20 02:06:17 user nova-compute[74242]:     <interface type='ethernet'>
Oct 20 02:06:17 user nova-compute[74242]:       <mac address='fa:16:3e:86:90:03'/>
Oct 20 02:06:17 user nova-compute[74242]:       <target dev='tap7575478b-29'/>
Oct 20 02:06:17 user nova-compute[74242]:       <model type='virtio'/>
Oct 20 02:06:17 user nova-compute[74242]:       <mtu size='1442'/>
Oct 20 02:06:17 user nova-compute[74242]:       <alias name='net0'/>
Oct 20 02:06:17 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 02:06:17 user nova-compute[74242]:     </interface>
Oct 20 02:06:17 user nova-compute[74242]:     <interface type='ethernet'>
Oct 20 02:06:17 user nova-compute[74242]:       <mac address='fa:16:3e:87:07:58'/>
Oct 20 02:06:17 user nova-compute[74242]:       <target dev='tapb71ba39e-3a'/>
Oct 20 02:06:17 user nova-compute[74242]:       <model type='virtio'/>
Oct 20 02:06:17 user nova-compute[74242]:       <mtu size='1442'/>
Oct 20 02:06:17 user nova-compute[74242]:       <alias name='net1'/>
Oct 20 02:06:17 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 20 02:06:17 user nova-compute[74242]:     </interface>
Oct 20 02:06:17 user nova-compute[74242]:     <serial type='pty'>
Oct 20 02:06:17 user nova-compute[74242]:       <source path='/dev/pts/6'/>
Oct 20 02:06:17 user nova-compute[74242]:       <log file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/console.log' append='off'/>
Oct 20 02:06:17 user nova-compute[74242]:       <target type='isa-serial' port='0'>
Oct 20 02:06:17 user nova-compute[74242]:         <model name='isa-serial'/>
Oct 20 02:06:17 user nova-compute[74242]:       </target>
Oct 20 02:06:17 user nova-compute[74242]:       <alias name='serial0'/>
Oct 20 02:06:17 user nova-compute[74242]:     </serial>
Oct 20 02:06:17 user nova-compute[74242]:     <console type='pty' tty='/dev/pts/6'>
Oct 20 02:06:17 user nova-compute[74242]:       <source path='/dev/pts/6'/>
Oct 20 02:06:17 user nova-compute[74242]:       <log file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/console.log' append='off'/>
Oct 20 02:06:17 user nova-compute[74242]:       <target type='serial' port='0'/>
Oct 20 02:06:17 user nova-compute[74242]:       <alias name='serial0'/>
Oct 20 02:06:17 user nova-compute[74242]:     </console>
Oct 20 02:06:17 user nova-compute[74242]:     <input type='mouse' bus='ps2'>
Oct 20 02:06:17 user nova-compute[74242]:       <alias name='input0'/>
Oct 20 02:06:17 user nova-compute[74242]:     </input>
Oct 20 02:06:17 user nova-compute[74242]:     <input type='keyboard' bus='ps2'>
Oct 20 02:06:17 user nova-compute[74242]:       <alias name='input1'/>
Oct 20 02:06:17 user nova-compute[74242]:     </input>
Oct 20 02:06:17 user nova-compute[74242]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 20 02:06:17 user nova-compute[74242]:       <listen type='address' address='0.0.0.0'/>
Oct 20 02:06:17 user nova-compute[74242]:     </graphics>
Oct 20 02:06:17 user nova-compute[74242]:     <audio id='1' type='none'/>
Oct 20 02:06:17 user nova-compute[74242]:     <video>
Oct 20 02:06:17 user nova-compute[74242]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 02:06:17 user nova-compute[74242]:       <alias name='video0'/>
Oct 20 02:06:17 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 02:06:17 user nova-compute[74242]:     </video>
Oct 20 02:06:17 user nova-compute[74242]:     <memballoon model='virtio'>
Oct 20 02:06:17 user nova-compute[74242]:       <stats period='10'/>
Oct 20 02:06:17 user nova-compute[74242]:       <alias name='balloon0'/>
Oct 20 02:06:17 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 02:06:17 user nova-compute[74242]:     </memballoon>
Oct 20 02:06:17 user nova-compute[74242]:     <rng model='virtio'>
Oct 20 02:06:17 user nova-compute[74242]:       <backend model='random'>/dev/urandom</backend>
Oct 20 02:06:17 user nova-compute[74242]:       <alias name='rng0'/>
Oct 20 02:06:17 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 02:06:17 user nova-compute[74242]:     </rng>
Oct 20 02:06:17 user nova-compute[74242]:   </devices>
Oct 20 02:06:17 user nova-compute[74242]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 02:06:17 user nova-compute[74242]:     <label>libvirt-e22cb246-155d-48f5-9eee-bd543c0bbaf1</label>
Oct 20 02:06:17 user nova-compute[74242]:     <imagelabel>libvirt-e22cb246-155d-48f5-9eee-bd543c0bbaf1</imagelabel>
Oct 20 02:06:17 user nova-compute[74242]:   </seclabel>
Oct 20 02:06:17 user nova-compute[74242]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 02:06:17 user nova-compute[74242]:     <label>+64055:+108</label>
Oct 20 02:06:17 user nova-compute[74242]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 02:06:17 user nova-compute[74242]:   </seclabel>
Oct 20 02:06:17 user nova-compute[74242]: </domain>
Oct 20 02:06:17 user nova-compute[74242]:  {{(pid=74242) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 02:06:17 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Successfully detached device tapb71ba39e-3a from instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 from the persistent domain config.
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] (1/8): Attempting to detach device tapb71ba39e-3a with device alias net1 from instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] detach device xml: <interface type="ethernet">
Oct 20 02:06:17 user nova-compute[74242]:   <mac address="fa:16:3e:87:07:58"/>
Oct 20 02:06:17 user nova-compute[74242]:   <model type="virtio"/>
Oct 20 02:06:17 user nova-compute[74242]:   <mtu size="1442"/>
Oct 20 02:06:17 user nova-compute[74242]:   <target dev="tapb71ba39e-3a"/>
Oct 20 02:06:17 user nova-compute[74242]: </interface>
Oct 20 02:06:17 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:06:17 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Creating image(s)
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Ensure instance console log exists: /opt/stack/data/nova/instances/a77f802c-7ee6-4596-ac65-221e2a6bb533/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Start _get_guest_xml network_info=[{"id": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "address": "fa:16:3e:1b:f2:1f", "network": {"id": "b7bde1f3-dede-4765-9ea9-d294203c607f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2003879386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc809bd71-9a", "ovs_interfaceid": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2de0cc37-2422-461f-8a4a-3b77033ce618", "address": "fa:16:3e:bc:54:72", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de0cc37-24", "ovs_interfaceid": "2de0cc37-2422-461f-8a4a-3b77033ce618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "address": "fa:16:3e:bf:06:d5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87632b36-c7", "ovs_interfaceid": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67449c80-5905-4656-9c55-45460e214374", "address": "fa:16:3e:6e:a7:08", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67449c80-59", "ovs_interfaceid": "67449c80-5905-4656-9c55-45460e214374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "address": "fa:16:3e:81:03:b5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebac74b9-c5", "ovs_interfaceid": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "address": "fa:16:3e:79:9b:bb", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e47a50-c8", "ovs_interfaceid": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "address": "fa:16:3e:57:89:56", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd45e11fc-f0", "ovs_interfaceid": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '598cde26-32f3-4fdd-9fbd-e84e36c82bbc', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqPCvVjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a77f802c-7ee6-4596-ac65-221e2a6bb533', 'attached_at': '', 'detached_at': '', 'volume_id': '90ae876e-4e5a-4a4a-8bb0-e98910d1c67e', 'serial': '90ae876e-4e5a-4a4a-8bb0-e98910d1c67e'}, 'volume_type': None}, {'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': 'ab79bf5d-ea85-43a2-b9a7-11c3008ba35e', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naQdeiBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a77f802c-7ee6-4596-ac65-221e2a6bb533', 'attached_at': '', 'detached_at': '', 'volume_id': '2f690cba-01ce-436f-80c3-20a1c9f0d8cd', 'serial': '2f690cba-01ce-436f-80c3-20a1c9f0d8cd'}, 'volume_type': None}, {'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'attachment_id': 'acb6ccbd-4776-4195-a0d2-d80f8038e600', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcLatbwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a77f802c-7ee6-4596-ac65-221e2a6bb533', 'attached_at': '', 'detached_at': '', 'volume_id': 'e065c065-f373-44f2-a086-d493ba3a0bd8', 'serial': 'e065c065-f373-44f2-a086-d493ba3a0bd8'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:06:17 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:06:17 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqPCvVjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:06:17 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:06:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:06:17 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:06:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:06:17 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c3d787-712d-42c6-b54a-ce67d06196d3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:06:17 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[18ba3e66-f19c-4c84-805c-948b6bfc9b13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e] added
Oct 20 02:06:17 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2fb3e3-7236-4d96-bc19-2138b4e1eb33]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80e5be0-f849-4f25-969c-8309cc7eb87c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fqPCvVjc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Start waiting for the detach event from libvirt for device tapb71ba39e-3a with device alias net1 for instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fqPCvVjc" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e955fe-a0d6-4762-bcef-4a00ba7314c0]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fqPCvVjc'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[de7fc1fd-db40-4174-b301-0f9ae11f78ea]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc91217-54dc-4aca-9689-32dca50eed4d]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:17 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:17 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.compute.manager [req-73e71ab8-11e3-42f7-8519-72f1823f75b7 req-eefc94a3-e017-4b06-98f6-a4602a9c0c02 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received event network-vif-unplugged-b71ba39e-3a76-4e07-971a-383990d2d6a3 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-73e71ab8-11e3-42f7-8519-72f1823f75b7 req-eefc94a3-e017-4b06-98f6-a4602a9c0c02 service nova] Acquiring lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-73e71ab8-11e3-42f7-8519-72f1823f75b7 req-eefc94a3-e017-4b06-98f6-a4602a9c0c02 service nova] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-73e71ab8-11e3-42f7-8519-72f1823f75b7 req-eefc94a3-e017-4b06-98f6-a4602a9c0c02 service nova] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG nova.compute.manager [req-73e71ab8-11e3-42f7-8519-72f1823f75b7 req-eefc94a3-e017-4b06-98f6-a4602a9c0c02 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] No waiting events found dispatching network-vif-unplugged-b71ba39e-3a76-4e07-971a-383990d2d6a3 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:17 user nova-compute[74242]: WARNING nova.compute.manager [req-73e71ab8-11e3-42f7-8519-72f1823f75b7 req-eefc94a3-e017-4b06-98f6-a4602a9c0c02 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received unexpected event network-vif-unplugged-b71ba39e-3a76-4e07-971a-383990d2d6a3 for instance with vm_state active and task_state None.
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1afba960-9102-483a-b1a1-72b9ea968868]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e, portal: 172.16.0.220,3260]
Oct 20 02:06:17 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e, portal: 172.16.0.220,3260] successful.
Oct 20 02:06:17 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2250d7-4ecc-49f4-bad9-28d2d1289a59]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[811c8b06-005a-413f-b3e0-3d8a7dc3e618]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:18 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:06:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:18 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:06:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] HCTL ('33', '-', '-', 0) found on session 8 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df1acf3-7b9d-42a3-b338-06d5d5877a51]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Searching for a device in session 8 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqPCvVjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:06:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '23437353937326638', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437353937326638', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naQdeiBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:06:19 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:06:19 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:06:19 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a363e0e6-249d-40d4-8143-19a60fa24da4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:06:19 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[77035984-7e45-4074-b8d4-90f6c19b50cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd] added
Oct 20 02:06:19 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.058s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9153fbbd-6a5d-4a24-ba83-7cd736c6792d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b364f86d-130f-497f-992f-9f875723d7b2]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v naQdeiBL {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v naQdeiBL" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[413dc490-f2a3-4cfd-ad21-ab30cc7bf60e]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'naQdeiBL'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffb7e3c-2575-416a-9a59-5f4ea7326626]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[10df4835-b198-4348-a15b-aa74a55533ec]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:19 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:06:19 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:19 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:06:19 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b5923b-4cd1-4f24-b66f-0767ba104f8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd, portal: 172.16.0.220,3260]
Oct 20 02:06:19 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd, portal: 172.16.0.220,3260] successful.
Oct 20 02:06:19 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4f50e3-c4e9-4b15-b4e6-5e5b5b544be4]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf9a9d4-5edd-4e76-8613-d4351ea4bd2b]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:19 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:06:19 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:06:19 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:19 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:06:19 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:06:19 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[659923bb-29d6-41d5-b05d-7ff904a11b38]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:19 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG nova.compute.manager [req-ee98f89c-78b5-48df-bd72-7a3be51e8978 req-6ad13af7-c86a-45fe-bb93-0a73c76f1579 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received event network-vif-plugged-b71ba39e-3a76-4e07-971a-383990d2d6a3 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ee98f89c-78b5-48df-bd72-7a3be51e8978 req-6ad13af7-c86a-45fe-bb93-0a73c76f1579 service nova] Acquiring lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ee98f89c-78b5-48df-bd72-7a3be51e8978 req-6ad13af7-c86a-45fe-bb93-0a73c76f1579 service nova] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ee98f89c-78b5-48df-bd72-7a3be51e8978 req-6ad13af7-c86a-45fe-bb93-0a73c76f1579 service nova] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG nova.compute.manager [req-ee98f89c-78b5-48df-bd72-7a3be51e8978 req-6ad13af7-c86a-45fe-bb93-0a73c76f1579 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] No waiting events found dispatching network-vif-plugged-b71ba39e-3a76-4e07-971a-383990d2d6a3 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:20 user nova-compute[74242]: WARNING nova.compute.manager [req-ee98f89c-78b5-48df-bd72-7a3be51e8978 req-6ad13af7-c86a-45fe-bb93-0a73c76f1579 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received unexpected event network-vif-plugged-b71ba39e-3a76-4e07-971a-383990d2d6a3 for instance with vm_state active and task_state None.
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naQdeiBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.390s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26461386530623065', 'path': '/dev/sdc'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461386530623065', 'path': '/dev/sdc'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcLatbwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:06:20 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:06:20 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:06:20 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5b8de8-29a4-4a1f-b9a0-787712ce0600]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:06:20 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0592e9bc-0a22-45bf-81e8-25f1b3074598]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8] added
Oct 20 02:06:20 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[30756e47-385e-4b8a-9208-d24bd55c2eca]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9d8de5-0d1a-46d8-b4d4-a0cee346deeb]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hcLatbwj {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hcLatbwj" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdcdbb3-0ab0-4315-8de6-3cab6faa4b6b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hcLatbwj'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e82857a-98d5-483d-b122-ba0fde3fa8a6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1abe52-a872-4135-9229-9f836efe22f7]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:20 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:06:20 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:06:20 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:20 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:06:20 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:06:20 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d75f4405-0adf-4f39-8670-ed817680a2d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8, portal: 172.16.0.220,3260]
Oct 20 02:06:20 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8, portal: 172.16.0.220,3260] successful.
Oct 20 02:06:20 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[153ffb32-26a2-4be2-98ef-d1328838ef7b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d510561e-78f6-4a23-a0ee-25f355c4680f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:06:20 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:20 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:06:20 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:06:20 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:06:20 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:20 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:06:20 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:06:20 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.278s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] HCTL ('35', '-', '-', 0) found on session 10 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d40155-f573-48a1-89dc-db38ca9c0b5d]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:20 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Searching for a device in session 10 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcLatbwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26665323332346366', 'path': '/dev/sdd'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665323332346366', 'path': '/dev/sdd'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "address": "fa:16:3e:1b:f2:1f", "network": {"id": "b7bde1f3-dede-4765-9ea9-d294203c607f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2003879386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc809bd71-9a", "ovs_interfaceid": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "address": "fa:16:3e:1b:f2:1f", "network": {"id": "b7bde1f3-dede-4765-9ea9-d294203c607f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2003879386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc809bd71-9a", "ovs_interfaceid": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:f2:1f,bridge_name='br-int',has_traffic_filtering=True,id=c809bd71-9a30-4d1c-9884-b2881cd21f70,network=Network(b7bde1f3-dede-4765-9ea9-d294203c607f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc809bd71-9a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2de0cc37-2422-461f-8a4a-3b77033ce618", "address": "fa:16:3e:bc:54:72", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de0cc37-24", "ovs_interfaceid": "2de0cc37-2422-461f-8a4a-3b77033ce618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "2de0cc37-2422-461f-8a4a-3b77033ce618", "address": "fa:16:3e:bc:54:72", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de0cc37-24", "ovs_interfaceid": "2de0cc37-2422-461f-8a4a-3b77033ce618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:54:72,bridge_name='br-int',has_traffic_filtering=True,id=2de0cc37-2422-461f-8a4a-3b77033ce618,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2de0cc37-24') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "address": "fa:16:3e:bf:06:d5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87632b36-c7", "ovs_interfaceid": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "address": "fa:16:3e:bf:06:d5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87632b36-c7", "ovs_interfaceid": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:06:d5,bridge_name='br-int',has_traffic_filtering=True,id=87632b36-c7fb-47e4-a792-cf94f02ac6f3,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap87632b36-c7') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67449c80-5905-4656-9c55-45460e214374", "address": "fa:16:3e:6e:a7:08", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67449c80-59", "ovs_interfaceid": "67449c80-5905-4656-9c55-45460e214374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "67449c80-5905-4656-9c55-45460e214374", "address": "fa:16:3e:6e:a7:08", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67449c80-59", "ovs_interfaceid": "67449c80-5905-4656-9c55-45460e214374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a7:08,bridge_name='br-int',has_traffic_filtering=True,id=67449c80-5905-4656-9c55-45460e214374,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67449c80-59') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "address": "fa:16:3e:81:03:b5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebac74b9-c5", "ovs_interfaceid": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "address": "fa:16:3e:81:03:b5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebac74b9-c5", "ovs_interfaceid": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:03:b5,bridge_name='br-int',has_traffic_filtering=True,id=ebac74b9-c5ad-48b8-8b0a-370831dbd710,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebac74b9-c5') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "address": "fa:16:3e:79:9b:bb", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e47a50-c8", "ovs_interfaceid": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "address": "fa:16:3e:79:9b:bb", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e47a50-c8", "ovs_interfaceid": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:9b:bb,bridge_name='br-int',has_traffic_filtering=True,id=f5e47a50-c8fb-46e8-9f8b-54470f96061e,network=Network(14d6a553-2afd-4f57-9332-8107fa123909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e47a50-c8') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "address": "fa:16:3e:57:89:56", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd45e11fc-f0", "ovs_interfaceid": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "address": "fa:16:3e:57:89:56", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd45e11fc-f0", "ovs_interfaceid": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:89:56,bridge_name='br-int',has_traffic_filtering=True,id=d45e11fc-f0b3-4bd3-92d3-9508adbcd839,network=Network(14d6a553-2afd-4f57-9332-8107fa123909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd45e11fc-f0') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.objects.instance [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lazy-loading 'pci_devices' on Instance uuid a77f802c-7ee6-4596-ac65-221e2a6bb533 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:06:21 user nova-compute[74242]:   <uuid>a77f802c-7ee6-4596-ac65-221e2a6bb533</uuid>
Oct 20 02:06:21 user nova-compute[74242]:   <name>instance-0000000c</name>
Oct 20 02:06:21 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:06:21 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:06:21 user nova-compute[74242]:   <metadata>
Oct 20 02:06:21 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:06:21 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:06:21 user nova-compute[74242]:       <nova:name>tempest-device-tagging-server-718064377</nova:name>
Oct 20 02:06:21 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:06:17</nova:creationTime>
Oct 20 02:06:21 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:06:21 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:06:21 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:06:21 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:06:21 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:06:21 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:06:21 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:06:21 user nova-compute[74242]:       <nova:owner>
Oct 20 02:06:21 user nova-compute[74242]:         <nova:user uuid="1691c4936b8d40a4a316785d7b19f2d0">tempest-TaggedBootDevicesTest-1060458579-project-member</nova:user>
Oct 20 02:06:21 user nova-compute[74242]:         <nova:project uuid="934523cf034040e2bc013e8469759699">tempest-TaggedBootDevicesTest-1060458579</nova:project>
Oct 20 02:06:21 user nova-compute[74242]:       </nova:owner>
Oct 20 02:06:21 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:06:21 user nova-compute[74242]:       <nova:ports>
Oct 20 02:06:21 user nova-compute[74242]:         <nova:port uuid="c809bd71-9a30-4d1c-9884-b2881cd21f70">
Oct 20 02:06:21 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 02:06:21 user nova-compute[74242]:         </nova:port>
Oct 20 02:06:21 user nova-compute[74242]:         <nova:port uuid="2de0cc37-2422-461f-8a4a-3b77033ce618">
Oct 20 02:06:21 user nova-compute[74242]:           <nova:ip type="fixed" address="10.1.1.79" ipVersion="4"/>
Oct 20 02:06:21 user nova-compute[74242]:         </nova:port>
Oct 20 02:06:21 user nova-compute[74242]:         <nova:port uuid="87632b36-c7fb-47e4-a792-cf94f02ac6f3">
Oct 20 02:06:21 user nova-compute[74242]:           <nova:ip type="fixed" address="10.1.1.30" ipVersion="4"/>
Oct 20 02:06:21 user nova-compute[74242]:         </nova:port>
Oct 20 02:06:21 user nova-compute[74242]:         <nova:port uuid="67449c80-5905-4656-9c55-45460e214374">
Oct 20 02:06:21 user nova-compute[74242]:           <nova:ip type="fixed" address="10.1.1.240" ipVersion="4"/>
Oct 20 02:06:21 user nova-compute[74242]:         </nova:port>
Oct 20 02:06:21 user nova-compute[74242]:         <nova:port uuid="ebac74b9-c5ad-48b8-8b0a-370831dbd710">
Oct 20 02:06:21 user nova-compute[74242]:           <nova:ip type="fixed" address="10.1.1.216" ipVersion="4"/>
Oct 20 02:06:21 user nova-compute[74242]:         </nova:port>
Oct 20 02:06:21 user nova-compute[74242]:         <nova:port uuid="f5e47a50-c8fb-46e8-9f8b-54470f96061e">
Oct 20 02:06:21 user nova-compute[74242]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 20 02:06:21 user nova-compute[74242]:         </nova:port>
Oct 20 02:06:21 user nova-compute[74242]:         <nova:port uuid="d45e11fc-f0b3-4bd3-92d3-9508adbcd839">
Oct 20 02:06:21 user nova-compute[74242]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 20 02:06:21 user nova-compute[74242]:         </nova:port>
Oct 20 02:06:21 user nova-compute[74242]:       </nova:ports>
Oct 20 02:06:21 user nova-compute[74242]:     </nova:instance>
Oct 20 02:06:21 user nova-compute[74242]:   </metadata>
Oct 20 02:06:21 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:06:21 user nova-compute[74242]:     <system>
Oct 20 02:06:21 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:06:21 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:06:21 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:06:21 user nova-compute[74242]:       <entry name="serial">a77f802c-7ee6-4596-ac65-221e2a6bb533</entry>
Oct 20 02:06:21 user nova-compute[74242]:       <entry name="uuid">a77f802c-7ee6-4596-ac65-221e2a6bb533</entry>
Oct 20 02:06:21 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:06:21 user nova-compute[74242]:     </system>
Oct 20 02:06:21 user nova-compute[74242]:   </sysinfo>
Oct 20 02:06:21 user nova-compute[74242]:   <os>
Oct 20 02:06:21 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:06:21 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:06:21 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:06:21 user nova-compute[74242]:   </os>
Oct 20 02:06:21 user nova-compute[74242]:   <features>
Oct 20 02:06:21 user nova-compute[74242]:     <acpi/>
Oct 20 02:06:21 user nova-compute[74242]:     <apic/>
Oct 20 02:06:21 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:06:21 user nova-compute[74242]:   </features>
Oct 20 02:06:21 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:06:21 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:06:21 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:06:21 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:06:21 user nova-compute[74242]:   </clock>
Oct 20 02:06:21 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:06:21 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:06:21 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:06:21 user nova-compute[74242]:   </cpu>
Oct 20 02:06:21 user nova-compute[74242]:   <devices>
Oct 20 02:06:21 user nova-compute[74242]:     <disk type="file" device="cdrom">
Oct 20 02:06:21 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 02:06:21 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/a77f802c-7ee6-4596-ac65-221e2a6bb533/disk.config"/>
Oct 20 02:06:21 user nova-compute[74242]:       <target dev="hda" bus="ide"/>
Oct 20 02:06:21 user nova-compute[74242]:     </disk>
Oct 20 02:06:21 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:06:21 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:06:21 user nova-compute[74242]:       <source dev="/dev/sdb"/>
Oct 20 02:06:21 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:06:21 user nova-compute[74242]:       <serial>90ae876e-4e5a-4a4a-8bb0-e98910d1c67e</serial>
Oct 20 02:06:21 user nova-compute[74242]:     </disk>
Oct 20 02:06:21 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:06:21 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:06:21 user nova-compute[74242]:       <source dev="/dev/sdc"/>
Oct 20 02:06:21 user nova-compute[74242]:       <target dev="vdb" bus="virtio"/>
Oct 20 02:06:21 user nova-compute[74242]:       <serial>2f690cba-01ce-436f-80c3-20a1c9f0d8cd</serial>
Oct 20 02:06:21 user nova-compute[74242]:     </disk>
Oct 20 02:06:21 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:06:21 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:06:21 user nova-compute[74242]:       <source dev="/dev/sdd"/>
Oct 20 02:06:21 user nova-compute[74242]:       <target dev="vdc" bus="virtio"/>
Oct 20 02:06:21 user nova-compute[74242]:       <serial>e065c065-f373-44f2-a086-d493ba3a0bd8</serial>
Oct 20 02:06:21 user nova-compute[74242]:     </disk>
Oct 20 02:06:21 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:06:21 user nova-compute[74242]:       <mac address="fa:16:3e:1b:f2:1f"/>
Oct 20 02:06:21 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:06:21 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:06:21 user nova-compute[74242]:       <target dev="tapc809bd71-9a"/>
Oct 20 02:06:21 user nova-compute[74242]:     </interface>
Oct 20 02:06:21 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:06:21 user nova-compute[74242]:       <mac address="fa:16:3e:bc:54:72"/>
Oct 20 02:06:21 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:06:21 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:06:21 user nova-compute[74242]:       <target dev="tap2de0cc37-24"/>
Oct 20 02:06:21 user nova-compute[74242]:     </interface>
Oct 20 02:06:21 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:06:21 user nova-compute[74242]:       <mac address="fa:16:3e:bf:06:d5"/>
Oct 20 02:06:21 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:06:21 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:06:21 user nova-compute[74242]:       <target dev="tap87632b36-c7"/>
Oct 20 02:06:21 user nova-compute[74242]:     </interface>
Oct 20 02:06:21 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:06:21 user nova-compute[74242]:       <mac address="fa:16:3e:6e:a7:08"/>
Oct 20 02:06:21 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:06:21 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:06:21 user nova-compute[74242]:       <target dev="tap67449c80-59"/>
Oct 20 02:06:21 user nova-compute[74242]:     </interface>
Oct 20 02:06:21 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:06:21 user nova-compute[74242]:       <mac address="fa:16:3e:81:03:b5"/>
Oct 20 02:06:21 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:06:21 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:06:21 user nova-compute[74242]:       <target dev="tapebac74b9-c5"/>
Oct 20 02:06:21 user nova-compute[74242]:     </interface>
Oct 20 02:06:21 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:06:21 user nova-compute[74242]:       <mac address="fa:16:3e:79:9b:bb"/>
Oct 20 02:06:21 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:06:21 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:06:21 user nova-compute[74242]:       <target dev="tapf5e47a50-c8"/>
Oct 20 02:06:21 user nova-compute[74242]:     </interface>
Oct 20 02:06:21 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:06:21 user nova-compute[74242]:       <mac address="fa:16:3e:57:89:56"/>
Oct 20 02:06:21 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:06:21 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:06:21 user nova-compute[74242]:       <target dev="tapd45e11fc-f0"/>
Oct 20 02:06:21 user nova-compute[74242]:     </interface>
Oct 20 02:06:21 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:06:21 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/a77f802c-7ee6-4596-ac65-221e2a6bb533/console.log" append="off"/>
Oct 20 02:06:21 user nova-compute[74242]:     </serial>
Oct 20 02:06:21 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:06:21 user nova-compute[74242]:     <video>
Oct 20 02:06:21 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:06:21 user nova-compute[74242]:     </video>
Oct 20 02:06:21 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:06:21 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:06:21 user nova-compute[74242]:     </rng>
Oct 20 02:06:21 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:06:21 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:06:21 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:06:21 user nova-compute[74242]:     </memballoon>
Oct 20 02:06:21 user nova-compute[74242]:   </devices>
Oct 20 02:06:21 user nova-compute[74242]: </domain>
Oct 20 02:06:21 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "address": "fa:16:3e:1b:f2:1f", "network": {"id": "b7bde1f3-dede-4765-9ea9-d294203c607f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2003879386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc809bd71-9a", "ovs_interfaceid": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "address": "fa:16:3e:1b:f2:1f", "network": {"id": "b7bde1f3-dede-4765-9ea9-d294203c607f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2003879386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc809bd71-9a", "ovs_interfaceid": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:f2:1f,bridge_name='br-int',has_traffic_filtering=True,id=c809bd71-9a30-4d1c-9884-b2881cd21f70,network=Network(b7bde1f3-dede-4765-9ea9-d294203c607f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc809bd71-9a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG os_vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:f2:1f,bridge_name='br-int',has_traffic_filtering=True,id=c809bd71-9a30-4d1c-9884-b2881cd21f70,network=Network(b7bde1f3-dede-4765-9ea9-d294203c607f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc809bd71-9a') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '45e77ad2-a242-502e-88c4-709cecea2eaf', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc809bd71-9a, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc809bd71-9a, col_values=(('qos', UUID('e13417e5-a294-4b75-8df2-b9bebb3fea42')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc809bd71-9a, col_values=(('external_ids', {'iface-id': 'c809bd71-9a30-4d1c-9884-b2881cd21f70', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:f2:1f', 'vm-uuid': 'a77f802c-7ee6-4596-ac65-221e2a6bb533'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:21 user nova-compute[74242]: INFO os_vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:f2:1f,bridge_name='br-int',has_traffic_filtering=True,id=c809bd71-9a30-4d1c-9884-b2881cd21f70,network=Network(b7bde1f3-dede-4765-9ea9-d294203c607f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc809bd71-9a')
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2de0cc37-2422-461f-8a4a-3b77033ce618", "address": "fa:16:3e:bc:54:72", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de0cc37-24", "ovs_interfaceid": "2de0cc37-2422-461f-8a4a-3b77033ce618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "2de0cc37-2422-461f-8a4a-3b77033ce618", "address": "fa:16:3e:bc:54:72", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de0cc37-24", "ovs_interfaceid": "2de0cc37-2422-461f-8a4a-3b77033ce618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:54:72,bridge_name='br-int',has_traffic_filtering=True,id=2de0cc37-2422-461f-8a4a-3b77033ce618,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2de0cc37-24') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG os_vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:54:72,bridge_name='br-int',has_traffic_filtering=True,id=2de0cc37-2422-461f-8a4a-3b77033ce618,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2de0cc37-24') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7629d26e-5fe8-55f1-91d0-5d72fb535b93', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2de0cc37-24, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2de0cc37-24, col_values=(('qos', UUID('cd29748e-b4d9-42be-9462-0023362bcab8')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2de0cc37-24, col_values=(('external_ids', {'iface-id': '2de0cc37-2422-461f-8a4a-3b77033ce618', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:54:72', 'vm-uuid': 'a77f802c-7ee6-4596-ac65-221e2a6bb533'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: INFO os_vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:54:72,bridge_name='br-int',has_traffic_filtering=True,id=2de0cc37-2422-461f-8a4a-3b77033ce618,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2de0cc37-24')
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "address": "fa:16:3e:bf:06:d5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87632b36-c7", "ovs_interfaceid": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "address": "fa:16:3e:bf:06:d5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87632b36-c7", "ovs_interfaceid": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:06:d5,bridge_name='br-int',has_traffic_filtering=True,id=87632b36-c7fb-47e4-a792-cf94f02ac6f3,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap87632b36-c7') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG os_vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:06:d5,bridge_name='br-int',has_traffic_filtering=True,id=87632b36-c7fb-47e4-a792-cf94f02ac6f3,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap87632b36-c7') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f63d760-1ae7-58bd-8ae2-ecd50031c29b', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap87632b36-c7, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap87632b36-c7, col_values=(('qos', UUID('337e25eb-d209-4a99-8630-d6aafb191ec3')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap87632b36-c7, col_values=(('external_ids', {'iface-id': '87632b36-c7fb-47e4-a792-cf94f02ac6f3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bf:06:d5', 'vm-uuid': 'a77f802c-7ee6-4596-ac65-221e2a6bb533'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: INFO os_vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:06:d5,bridge_name='br-int',has_traffic_filtering=True,id=87632b36-c7fb-47e4-a792-cf94f02ac6f3,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap87632b36-c7')
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "67449c80-5905-4656-9c55-45460e214374", "address": "fa:16:3e:6e:a7:08", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67449c80-59", "ovs_interfaceid": "67449c80-5905-4656-9c55-45460e214374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "67449c80-5905-4656-9c55-45460e214374", "address": "fa:16:3e:6e:a7:08", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67449c80-59", "ovs_interfaceid": "67449c80-5905-4656-9c55-45460e214374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a7:08,bridge_name='br-int',has_traffic_filtering=True,id=67449c80-5905-4656-9c55-45460e214374,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67449c80-59') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG os_vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a7:08,bridge_name='br-int',has_traffic_filtering=True,id=67449c80-5905-4656-9c55-45460e214374,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67449c80-59') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b82f3cf-f707-5f07-b3b6-91cc549357c5', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap67449c80-59, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap67449c80-59, col_values=(('qos', UUID('f9be2622-c243-497d-8250-9887f83a5fda')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap67449c80-59, col_values=(('external_ids', {'iface-id': '67449c80-5905-4656-9c55-45460e214374', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:a7:08', 'vm-uuid': 'a77f802c-7ee6-4596-ac65-221e2a6bb533'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: INFO os_vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a7:08,bridge_name='br-int',has_traffic_filtering=True,id=67449c80-5905-4656-9c55-45460e214374,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67449c80-59')
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "address": "fa:16:3e:81:03:b5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebac74b9-c5", "ovs_interfaceid": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "address": "fa:16:3e:81:03:b5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebac74b9-c5", "ovs_interfaceid": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:03:b5,bridge_name='br-int',has_traffic_filtering=True,id=ebac74b9-c5ad-48b8-8b0a-370831dbd710,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebac74b9-c5') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG os_vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:03:b5,bridge_name='br-int',has_traffic_filtering=True,id=ebac74b9-c5ad-48b8-8b0a-370831dbd710,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebac74b9-c5') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7ecde33-31ab-531f-a0b9-f60878bf464d', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebac74b9-c5, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebac74b9-c5, col_values=(('qos', UUID('9a8e815f-adb5-4876-acb8-fbac92734e09')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebac74b9-c5, col_values=(('external_ids', {'iface-id': 'ebac74b9-c5ad-48b8-8b0a-370831dbd710', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:81:03:b5', 'vm-uuid': 'a77f802c-7ee6-4596-ac65-221e2a6bb533'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: INFO os_vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:03:b5,bridge_name='br-int',has_traffic_filtering=True,id=ebac74b9-c5ad-48b8-8b0a-370831dbd710,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebac74b9-c5')
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "address": "fa:16:3e:79:9b:bb", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e47a50-c8", "ovs_interfaceid": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "address": "fa:16:3e:79:9b:bb", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e47a50-c8", "ovs_interfaceid": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:9b:bb,bridge_name='br-int',has_traffic_filtering=True,id=f5e47a50-c8fb-46e8-9f8b-54470f96061e,network=Network(14d6a553-2afd-4f57-9332-8107fa123909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e47a50-c8') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG os_vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:9b:bb,bridge_name='br-int',has_traffic_filtering=True,id=f5e47a50-c8fb-46e8-9f8b-54470f96061e,network=Network(14d6a553-2afd-4f57-9332-8107fa123909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e47a50-c8') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8764366d-e692-5b86-88b9-1d1ab036a3ac', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5e47a50-c8, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5e47a50-c8, col_values=(('qos', UUID('cf619f6f-a25c-4cc4-9326-43785a55cfec')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5e47a50-c8, col_values=(('external_ids', {'iface-id': 'f5e47a50-c8fb-46e8-9f8b-54470f96061e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:9b:bb', 'vm-uuid': 'a77f802c-7ee6-4596-ac65-221e2a6bb533'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: INFO os_vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:9b:bb,bridge_name='br-int',has_traffic_filtering=True,id=f5e47a50-c8fb-46e8-9f8b-54470f96061e,network=Network(14d6a553-2afd-4f57-9332-8107fa123909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e47a50-c8')
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:05:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "address": "fa:16:3e:57:89:56", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd45e11fc-f0", "ovs_interfaceid": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "address": "fa:16:3e:57:89:56", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd45e11fc-f0", "ovs_interfaceid": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:89:56,bridge_name='br-int',has_traffic_filtering=True,id=d45e11fc-f0b3-4bd3-92d3-9508adbcd839,network=Network(14d6a553-2afd-4f57-9332-8107fa123909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd45e11fc-f0') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG os_vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:89:56,bridge_name='br-int',has_traffic_filtering=True,id=d45e11fc-f0b3-4bd3-92d3-9508adbcd839,network=Network(14d6a553-2afd-4f57-9332-8107fa123909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd45e11fc-f0') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9010133-9632-52ce-9951-608240996149', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd45e11fc-f0, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd45e11fc-f0, col_values=(('qos', UUID('3a2559b5-e0be-4aef-b99f-6a867c944d76')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd45e11fc-f0, col_values=(('external_ids', {'iface-id': 'd45e11fc-f0b3-4bd3-92d3-9508adbcd839', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:57:89:56', 'vm-uuid': 'a77f802c-7ee6-4596-ac65-221e2a6bb533'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:22 user nova-compute[74242]: INFO os_vif [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:89:56,bridge_name='br-int',has_traffic_filtering=True,id=d45e11fc-f0b3-4bd3-92d3-9508adbcd839,network=Network(14d6a553-2afd-4f57-9332-8107fa123909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd45e11fc-f0')
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] No BDM found with device name hda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] No VIF found with MAC fa:16:3e:1b:f2:1f, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] No VIF found with MAC fa:16:3e:81:03:b5, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:06:22 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Using config drive
Oct 20 02:06:22 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Creating config drive at /opt/stack/data/nova/instances/a77f802c-7ee6-4596-ac65-221e2a6bb533/disk.config
Oct 20 02:06:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a77f802c-7ee6-4596-ac65-221e2a6bb533/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9lw3120l {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a77f802c-7ee6-4596-ac65-221e2a6bb533/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp9lw3120l" returned: 0 in 0.056s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:23 user nova-compute[74242]: INFO nova.compute.manager [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Unshelving
Oct 20 02:06:23 user nova-compute[74242]: INFO nova.virt.block_device [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Booting with volume 069f2fdc-94b6-4546-8e3e-58bc608d7ba3 at /dev/vdc
Oct 20 02:06:23 user nova-compute[74242]: DEBUG os_brick.utils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[14322872-ead8-4e1a-bf28-68b1700bf09d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[be99ab58-271f-4f03-8ee9-ea8a0856016f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[59887db3-27cd-4e6e-b16d-6cffea448fe1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1598ab78-972f-43c4-a3d5-88298680b42e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:06:23 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:06:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a77db8-f9d7-4168-a00e-cd77240adb50]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG os_brick.utils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:06:23 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updating existing volume attachment record: 7a99e7dc-62ea-4070-919d-712d9d7106ec {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Didn't find any instances for network info cache update. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-f8c1313e-8e9a-4b81-93c2-673e9ca0048e req-98a9f6ce-1492-4270-8591-db2bfef028ac service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-c809bd71-9a30-4d1c-9884-b2881cd21f70 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f8c1313e-8e9a-4b81-93c2-673e9ca0048e req-98a9f6ce-1492-4270-8591-db2bfef028ac service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f8c1313e-8e9a-4b81-93c2-673e9ca0048e req-98a9f6ce-1492-4270-8591-db2bfef028ac service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f8c1313e-8e9a-4b81-93c2-673e9ca0048e req-98a9f6ce-1492-4270-8591-db2bfef028ac service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-f8c1313e-8e9a-4b81-93c2-673e9ca0048e req-98a9f6ce-1492-4270-8591-db2bfef028ac service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-c809bd71-9a30-4d1c-9884-b2881cd21f70 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:24 user nova-compute[74242]: WARNING nova.compute.manager [req-f8c1313e-8e9a-4b81-93c2-673e9ca0048e req-98a9f6ce-1492-4270-8591-db2bfef028ac service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-c809bd71-9a30-4d1c-9884-b2881cd21f70 for instance with vm_state building and task_state spawning.
Oct 20 02:06:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-3b2440f2-c90b-4bf5-8624-8d584d2410ee req-2a9bcb85-7ba6-4db8-b4b9-804c1070a9c6 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-2de0cc37-2422-461f-8a4a-3b77033ce618 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3b2440f2-c90b-4bf5-8624-8d584d2410ee req-2a9bcb85-7ba6-4db8-b4b9-804c1070a9c6 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3b2440f2-c90b-4bf5-8624-8d584d2410ee req-2a9bcb85-7ba6-4db8-b4b9-804c1070a9c6 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3b2440f2-c90b-4bf5-8624-8d584d2410ee req-2a9bcb85-7ba6-4db8-b4b9-804c1070a9c6 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-3b2440f2-c90b-4bf5-8624-8d584d2410ee req-2a9bcb85-7ba6-4db8-b4b9-804c1070a9c6 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-2de0cc37-2422-461f-8a4a-3b77033ce618 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:24 user nova-compute[74242]: WARNING nova.compute.manager [req-3b2440f2-c90b-4bf5-8624-8d584d2410ee req-2a9bcb85-7ba6-4db8-b4b9-804c1070a9c6 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-2de0cc37-2422-461f-8a4a-3b77033ce618 for instance with vm_state building and task_state spawning.
Oct 20 02:06:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG nova.compute.manager [req-9add5dc0-9935-43be-830d-ab256558ae6d req-cef00d8b-e753-49ab-9ea5-8e476638d517 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-87632b36-c7fb-47e4-a792-cf94f02ac6f3 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9add5dc0-9935-43be-830d-ab256558ae6d req-cef00d8b-e753-49ab-9ea5-8e476638d517 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9add5dc0-9935-43be-830d-ab256558ae6d req-cef00d8b-e753-49ab-9ea5-8e476638d517 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9add5dc0-9935-43be-830d-ab256558ae6d req-cef00d8b-e753-49ab-9ea5-8e476638d517 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG nova.compute.manager [req-9add5dc0-9935-43be-830d-ab256558ae6d req-cef00d8b-e753-49ab-9ea5-8e476638d517 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-87632b36-c7fb-47e4-a792-cf94f02ac6f3 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:25 user nova-compute[74242]: WARNING nova.compute.manager [req-9add5dc0-9935-43be-830d-ab256558ae6d req-cef00d8b-e753-49ab-9ea5-8e476638d517 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-87632b36-c7fb-47e4-a792-cf94f02ac6f3 for instance with vm_state building and task_state spawning.
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-d13d3306-0740-4ef0-89c7-d842f4473799 req-4ac00d64-86cf-4cc7-a337-8e9fc8aac2e6 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-c809bd71-9a30-4d1c-9884-b2881cd21f70 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d13d3306-0740-4ef0-89c7-d842f4473799 req-4ac00d64-86cf-4cc7-a337-8e9fc8aac2e6 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d13d3306-0740-4ef0-89c7-d842f4473799 req-4ac00d64-86cf-4cc7-a337-8e9fc8aac2e6 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d13d3306-0740-4ef0-89c7-d842f4473799 req-4ac00d64-86cf-4cc7-a337-8e9fc8aac2e6 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-d13d3306-0740-4ef0-89c7-d842f4473799 req-4ac00d64-86cf-4cc7-a337-8e9fc8aac2e6 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-c809bd71-9a30-4d1c-9884-b2881cd21f70 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:26 user nova-compute[74242]: WARNING nova.compute.manager [req-d13d3306-0740-4ef0-89c7-d842f4473799 req-4ac00d64-86cf-4cc7-a337-8e9fc8aac2e6 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-c809bd71-9a30-4d1c-9884-b2881cd21f70 for instance with vm_state building and task_state spawning.
Oct 20 02:06:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "c909c918-59a9-42fe-99fe-72431ba43443" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "c909c918-59a9-42fe-99fe-72431ba43443" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:26 user nova-compute[74242]: DEBUG nova.compute.manager [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-2de0cc37-2422-461f-8a4a-3b77033ce618 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-2de0cc37-2422-461f-8a4a-3b77033ce618 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:27 user nova-compute[74242]: WARNING nova.compute.manager [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-2de0cc37-2422-461f-8a4a-3b77033ce618 for instance with vm_state building and task_state spawning.
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-f5e47a50-c8fb-46e8-9f8b-54470f96061e {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-f5e47a50-c8fb-46e8-9f8b-54470f96061e {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:27 user nova-compute[74242]: WARNING nova.compute.manager [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-f5e47a50-c8fb-46e8-9f8b-54470f96061e for instance with vm_state building and task_state spawning.
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-f5e47a50-c8fb-46e8-9f8b-54470f96061e {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-f5e47a50-c8fb-46e8-9f8b-54470f96061e {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:27 user nova-compute[74242]: WARNING nova.compute.manager [req-f3a12336-7307-435f-b5f3-42beb179ca57 req-370f95f8-0afb-4aaf-9741-a0b8b33416f3 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-f5e47a50-c8fb-46e8-9f8b-54470f96061e for instance with vm_state building and task_state spawning.
Oct 20 02:06:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:06:27 user nova-compute[74242]: INFO nova.compute.claims [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Claim successful on node user
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-87632b36-c7fb-47e4-a792-cf94f02ac6f3 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-87632b36-c7fb-47e4-a792-cf94f02ac6f3 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:27 user nova-compute[74242]: WARNING nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-87632b36-c7fb-47e4-a792-cf94f02ac6f3 for instance with vm_state building and task_state spawning.
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-67449c80-5905-4656-9c55-45460e214374 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-67449c80-5905-4656-9c55-45460e214374 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:27 user nova-compute[74242]: WARNING nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-67449c80-5905-4656-9c55-45460e214374 for instance with vm_state building and task_state spawning.
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-67449c80-5905-4656-9c55-45460e214374 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-67449c80-5905-4656-9c55-45460e214374 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:27 user nova-compute[74242]: WARNING nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-67449c80-5905-4656-9c55-45460e214374 for instance with vm_state building and task_state spawning.
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-ebac74b9-c5ad-48b8-8b0a-370831dbd710 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-ebac74b9-c5ad-48b8-8b0a-370831dbd710 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:27 user nova-compute[74242]: WARNING nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-ebac74b9-c5ad-48b8-8b0a-370831dbd710 for instance with vm_state building and task_state spawning.
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-ebac74b9-c5ad-48b8-8b0a-370831dbd710 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-ebac74b9-c5ad-48b8-8b0a-370831dbd710 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:27 user nova-compute[74242]: WARNING nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-ebac74b9-c5ad-48b8-8b0a-370831dbd710 for instance with vm_state building and task_state spawning.
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-d45e11fc-f0b3-4bd3-92d3-9508adbcd839 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-d45e11fc-f0b3-4bd3-92d3-9508adbcd839 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:27 user nova-compute[74242]: WARNING nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-d45e11fc-f0b3-4bd3-92d3-9508adbcd839 for instance with vm_state building and task_state spawning.
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-d45e11fc-f0b3-4bd3-92d3-9508adbcd839 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-d45e11fc-f0b3-4bd3-92d3-9508adbcd839 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:27 user nova-compute[74242]: WARNING nova.compute.manager [req-b7de75d3-d3dd-4203-a381-726a19ed0635 req-f25c5948-8184-43e3-ac15-c4db61360c43 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-d45e11fc-f0b3-4bd3-92d3-9508adbcd839 for instance with vm_state building and task_state spawning.
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.444s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.network.neutron [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:06:27 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.policy [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1f488a444de49f5bed5351efd55dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9b187fe8443aba57a8c629d78978e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:06:27 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Creating image(s)
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "/opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "/opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "/opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.208s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk 1073741824" returned: 0 in 0.056s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.network.neutron [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Successfully created port: c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Cannot resize image /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Ensure instance console log exists: /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:06:28 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Instance spawned successfully.
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.network.neutron [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Successfully updated port: c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "refresh_cache-c909c918-59a9-42fe-99fe-72431ba43443" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquired lock "refresh_cache-c909c918-59a9-42fe-99fe-72431ba43443" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.network.neutron [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:06:28 user nova-compute[74242]: INFO nova.compute.manager [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Took 11.31 seconds to spawn the instance on the hypervisor.
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:06:28 user nova-compute[74242]: DEBUG nova.network.neutron [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-66dba9df-3583-4597-98dd-c3c4d03cc7bb req-1bf2026c-92e0-4de9-9df2-4b396733d60e service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received event network-changed-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-66dba9df-3583-4597-98dd-c3c4d03cc7bb req-1bf2026c-92e0-4de9-9df2-4b396733d60e service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Refreshing instance network info cache due to event network-changed-c358f4c8-2f05-4449-af69-dd6108ecf241. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-66dba9df-3583-4597-98dd-c3c4d03cc7bb req-1bf2026c-92e0-4de9-9df2-4b396733d60e service nova] Acquiring lock "refresh_cache-c909c918-59a9-42fe-99fe-72431ba43443" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:06:29 user nova-compute[74242]: INFO nova.compute.manager [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Took 71.36 seconds to build instance.
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e884395-a5a6-4e9b-9f63-0e09b3ba4859 tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 71.467s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.network.neutron [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Updating instance_info_cache with network_info: [{"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Releasing lock "refresh_cache-c909c918-59a9-42fe-99fe-72431ba43443" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Instance network_info: |[{"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-66dba9df-3583-4597-98dd-c3c4d03cc7bb req-1bf2026c-92e0-4de9-9df2-4b396733d60e service nova] Acquired lock "refresh_cache-c909c918-59a9-42fe-99fe-72431ba43443" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.network.neutron [req-66dba9df-3583-4597-98dd-c3c4d03cc7bb req-1bf2026c-92e0-4de9-9df2-4b396733d60e service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Refreshing network info cache for port c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Start _get_guest_xml network_info=[{"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:06:29 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:06:29 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1170021543',display_name='tempest-tempest.common.compute-instance-1170021543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1170021543',id=13,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrPBdfgfIOd9Bbgyl7XwDZEaA2/I2ig7YDFuATYsERYinJSZl+I4zqRDKdZ1kEG5DAM+H4I0B67KuA8LEv3daLR6RzgTmC0EkFXmvmntpdQWOjWI81e1VZVgofosnIjFA==',key_name='tempest-keypair-1122737131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cf9b187fe8443aba57a8c629d78978e',ramdisk_id='',reservation_id='r-84vssbut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2076229102',owner_user_name='tempest-ServerActionsTestOtherA-2076229102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:06:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1f488a444de49f5bed5351efd55dafa',uuid=c909c918-59a9-42fe-99fe-72431ba43443,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converting VIF {"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d5:37,bridge_name='br-int',has_traffic_filtering=True,id=c358f4c8-2f05-4449-af69-dd6108ecf241,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc358f4c8-2f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.objects.instance [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lazy-loading 'pci_devices' on Instance uuid c909c918-59a9-42fe-99fe-72431ba43443 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:06:29 user nova-compute[74242]:   <uuid>c909c918-59a9-42fe-99fe-72431ba43443</uuid>
Oct 20 02:06:29 user nova-compute[74242]:   <name>instance-0000000d</name>
Oct 20 02:06:29 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:06:29 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:06:29 user nova-compute[74242]:   <metadata>
Oct 20 02:06:29 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:06:29 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:06:29 user nova-compute[74242]:       <nova:name>tempest-tempest.common.compute-instance-1170021543</nova:name>
Oct 20 02:06:29 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:06:29</nova:creationTime>
Oct 20 02:06:29 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:06:29 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:06:29 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:06:29 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:06:29 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:06:29 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:06:29 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:06:29 user nova-compute[74242]:       <nova:owner>
Oct 20 02:06:29 user nova-compute[74242]:         <nova:user uuid="c1f488a444de49f5bed5351efd55dafa">tempest-ServerActionsTestOtherA-2076229102-project-member</nova:user>
Oct 20 02:06:29 user nova-compute[74242]:         <nova:project uuid="5cf9b187fe8443aba57a8c629d78978e">tempest-ServerActionsTestOtherA-2076229102</nova:project>
Oct 20 02:06:29 user nova-compute[74242]:       </nova:owner>
Oct 20 02:06:29 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:06:29 user nova-compute[74242]:       <nova:ports>
Oct 20 02:06:29 user nova-compute[74242]:         <nova:port uuid="c358f4c8-2f05-4449-af69-dd6108ecf241">
Oct 20 02:06:29 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 02:06:29 user nova-compute[74242]:         </nova:port>
Oct 20 02:06:29 user nova-compute[74242]:       </nova:ports>
Oct 20 02:06:29 user nova-compute[74242]:     </nova:instance>
Oct 20 02:06:29 user nova-compute[74242]:   </metadata>
Oct 20 02:06:29 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:06:29 user nova-compute[74242]:     <system>
Oct 20 02:06:29 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:06:29 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:06:29 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:06:29 user nova-compute[74242]:       <entry name="serial">c909c918-59a9-42fe-99fe-72431ba43443</entry>
Oct 20 02:06:29 user nova-compute[74242]:       <entry name="uuid">c909c918-59a9-42fe-99fe-72431ba43443</entry>
Oct 20 02:06:29 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:06:29 user nova-compute[74242]:     </system>
Oct 20 02:06:29 user nova-compute[74242]:   </sysinfo>
Oct 20 02:06:29 user nova-compute[74242]:   <os>
Oct 20 02:06:29 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:06:29 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:06:29 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:06:29 user nova-compute[74242]:   </os>
Oct 20 02:06:29 user nova-compute[74242]:   <features>
Oct 20 02:06:29 user nova-compute[74242]:     <acpi/>
Oct 20 02:06:29 user nova-compute[74242]:     <apic/>
Oct 20 02:06:29 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:06:29 user nova-compute[74242]:   </features>
Oct 20 02:06:29 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:06:29 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:06:29 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:06:29 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:06:29 user nova-compute[74242]:   </clock>
Oct 20 02:06:29 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:06:29 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:06:29 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:06:29 user nova-compute[74242]:   </cpu>
Oct 20 02:06:29 user nova-compute[74242]:   <devices>
Oct 20 02:06:29 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:06:29 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:06:29 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk"/>
Oct 20 02:06:29 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:06:29 user nova-compute[74242]:     </disk>
Oct 20 02:06:29 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:06:29 user nova-compute[74242]:       <mac address="fa:16:3e:ba:d5:37"/>
Oct 20 02:06:29 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:06:29 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:06:29 user nova-compute[74242]:       <target dev="tapc358f4c8-2f"/>
Oct 20 02:06:29 user nova-compute[74242]:     </interface>
Oct 20 02:06:29 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:06:29 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/console.log" append="off"/>
Oct 20 02:06:29 user nova-compute[74242]:     </serial>
Oct 20 02:06:29 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:06:29 user nova-compute[74242]:     <video>
Oct 20 02:06:29 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:06:29 user nova-compute[74242]:     </video>
Oct 20 02:06:29 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:06:29 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:06:29 user nova-compute[74242]:     </rng>
Oct 20 02:06:29 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:06:29 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:06:29 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:06:29 user nova-compute[74242]:     </memballoon>
Oct 20 02:06:29 user nova-compute[74242]:   </devices>
Oct 20 02:06:29 user nova-compute[74242]: </domain>
Oct 20 02:06:29 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1170021543',display_name='tempest-tempest.common.compute-instance-1170021543',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1170021543',id=13,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrPBdfgfIOd9Bbgyl7XwDZEaA2/I2ig7YDFuATYsERYinJSZl+I4zqRDKdZ1kEG5DAM+H4I0B67KuA8LEv3daLR6RzgTmC0EkFXmvmntpdQWOjWI81e1VZVgofosnIjFA==',key_name='tempest-keypair-1122737131',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cf9b187fe8443aba57a8c629d78978e',ramdisk_id='',reservation_id='r-84vssbut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2076229102',owner_user_name='tempest-ServerActionsTestOtherA-2076229102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:06:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1f488a444de49f5bed5351efd55dafa',uuid=c909c918-59a9-42fe-99fe-72431ba43443,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converting VIF {"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d5:37,bridge_name='br-int',has_traffic_filtering=True,id=c358f4c8-2f05-4449-af69-dd6108ecf241,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc358f4c8-2f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG os_vif [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d5:37,bridge_name='br-int',has_traffic_filtering=True,id=c358f4c8-2f05-4449-af69-dd6108ecf241,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc358f4c8-2f') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9115218-6591-5c10-8252-a38765418375', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc358f4c8-2f, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc358f4c8-2f, col_values=(('qos', UUID('d5793ed1-b71f-4335-a5c5-6388cf23f971')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc358f4c8-2f, col_values=(('external_ids', {'iface-id': 'c358f4c8-2f05-4449-af69-dd6108ecf241', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:d5:37', 'vm-uuid': 'c909c918-59a9-42fe-99fe-72431ba43443'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:29 user nova-compute[74242]: INFO os_vif [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:d5:37,bridge_name='br-int',has_traffic_filtering=True,id=c358f4c8-2f05-4449-af69-dd6108ecf241,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc358f4c8-2f')
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] No VIF found with MAC fa:16:3e:ba:d5:37, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.network.neutron [req-66dba9df-3583-4597-98dd-c3c4d03cc7bb req-1bf2026c-92e0-4de9-9df2-4b396733d60e service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Updated VIF entry in instance network info cache for port c358f4c8-2f05-4449-af69-dd6108ecf241. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG nova.network.neutron [req-66dba9df-3583-4597-98dd-c3c4d03cc7bb req-1bf2026c-92e0-4de9-9df2-4b396733d60e service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Updating instance_info_cache with network_info: [{"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-66dba9df-3583-4597-98dd-c3c4d03cc7bb req-1bf2026c-92e0-4de9-9df2-4b396733d60e service nova] Releasing lock "refresh_cache-c909c918-59a9-42fe-99fe-72431ba43443" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:06:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:06:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:06:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:06:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-8b912f55-6965-4ce7-91a9-baa7a0ccf8ef req-2081fbfe-6bf9-4044-b870-167667419c24 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received event network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8b912f55-6965-4ce7-91a9-baa7a0ccf8ef req-2081fbfe-6bf9-4044-b870-167667419c24 service nova] Acquiring lock "c909c918-59a9-42fe-99fe-72431ba43443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8b912f55-6965-4ce7-91a9-baa7a0ccf8ef req-2081fbfe-6bf9-4044-b870-167667419c24 service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8b912f55-6965-4ce7-91a9-baa7a0ccf8ef req-2081fbfe-6bf9-4044-b870-167667419c24 service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-8b912f55-6965-4ce7-91a9-baa7a0ccf8ef req-2081fbfe-6bf9-4044-b870-167667419c24 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] No waiting events found dispatching network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:33 user nova-compute[74242]: WARNING nova.compute.manager [req-8b912f55-6965-4ce7-91a9-baa7a0ccf8ef req-2081fbfe-6bf9-4044-b870-167667419c24 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received unexpected event network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 for instance with vm_state building and task_state spawning.
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-80311b66-e3c0-490c-9c2d-973cc9b552ab req-b3823a89-7fcf-4d99-9051-ef829a8f75ea service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received event network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-80311b66-e3c0-490c-9c2d-973cc9b552ab req-b3823a89-7fcf-4d99-9051-ef829a8f75ea service nova] Acquiring lock "c909c918-59a9-42fe-99fe-72431ba43443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-80311b66-e3c0-490c-9c2d-973cc9b552ab req-b3823a89-7fcf-4d99-9051-ef829a8f75ea service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-80311b66-e3c0-490c-9c2d-973cc9b552ab req-b3823a89-7fcf-4d99-9051-ef829a8f75ea service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-80311b66-e3c0-490c-9c2d-973cc9b552ab req-b3823a89-7fcf-4d99-9051-ef829a8f75ea service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] No waiting events found dispatching network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:33 user nova-compute[74242]: WARNING nova.compute.manager [req-80311b66-e3c0-490c-9c2d-973cc9b552ab req-b3823a89-7fcf-4d99-9051-ef829a8f75ea service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received unexpected event network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 for instance with vm_state building and task_state spawning.
Oct 20 02:06:33 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Instance spawned successfully.
Oct 20 02:06:33 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:06:33 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8231MB free_disk=25.48355484008789GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:06:33 user nova-compute[74242]: INFO nova.compute.manager [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Took 5.87 seconds to spawn the instance on the hypervisor.
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance af9f3d52-79f0-4ce0-9b14-3373b30c2b26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 5cea10bc-ac5a-48b0-b6b7-7db8f520339d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 1e23c60d-f373-431e-952e-600b9b5d6ea2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance a77f802c-7ee6-4596-ac65-221e2a6bb533 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c909c918-59a9-42fe-99fe-72431ba43443 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:06:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:06:33 user nova-compute[74242]: INFO nova.compute.manager [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Took 6.70 seconds to build instance.
Oct 20 02:06:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-710c7c76-6932-45de-ac23-6d89c15a3b9c tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "c909c918-59a9-42fe-99fe-72431ba43443" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.905s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:34 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:06:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:34 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:06:34 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:06:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.553s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:37 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Waiting for libvirt event about the detach of device tapb71ba39e-3a with device alias net1 from instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 is timed out.
Oct 20 02:06:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:07:58"/><model type="virtio"/><mtu size="1442"/><target dev="tapb71ba39e-3a"/></interface> {{(pid=74242) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 02:06:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:87:07:58"/><model type="virtio"/><mtu size="1442"/><target dev="tapb71ba39e-3a"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 20 02:06:37 user nova-compute[74242]:   <name>instance-00000007</name>
Oct 20 02:06:37 user nova-compute[74242]:   <uuid>e22cb246-155d-48f5-9eee-bd543c0bbaf1</uuid>
Oct 20 02:06:37 user nova-compute[74242]:   <metadata>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:06:37 user nova-compute[74242]:   <nova:package version="0.0.0"/>
Oct 20 02:06:37 user nova-compute[74242]:   <nova:name>tempest-device-tagging-server-1179443261</nova:name>
Oct 20 02:06:37 user nova-compute[74242]:   <nova:creationTime>2023-10-20 02:05:26</nova:creationTime>
Oct 20 02:06:37 user nova-compute[74242]:   <nova:flavor name="m1.tiny">
Oct 20 02:06:37 user nova-compute[74242]:     <nova:memory>512</nova:memory>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:disk>1</nova:disk>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:swap>0</nova:swap>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:vcpus>1</nova:vcpus>
Oct 20 02:06:37 user nova-compute[74242]:   </nova:flavor>
Oct 20 02:06:37 user nova-compute[74242]:   <nova:owner>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:user uuid="e81797a2a7a744fa8298b767cf469631">tempest-TaggedAttachmentsTest-789715889-project-member</nova:user>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:project uuid="28a8e047fa564263971543d6342579b1">tempest-TaggedAttachmentsTest-789715889</nova:project>
Oct 20 02:06:37 user nova-compute[74242]:   </nova:owner>
Oct 20 02:06:37 user nova-compute[74242]:   <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:06:37 user nova-compute[74242]:   <nova:ports>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:port uuid="7575478b-29e4-493e-a04f-0e3747a5c64a">
Oct 20 02:06:37 user nova-compute[74242]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 02:06:37 user nova-compute[74242]:     </nova:port>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:port uuid="b71ba39e-3a76-4e07-971a-383990d2d6a3">
Oct 20 02:06:37 user nova-compute[74242]:       <nova:ip type="fixed" address="10.10.10.226" ipVersion="4"/>
Oct 20 02:06:37 user nova-compute[74242]:     </nova:port>
Oct 20 02:06:37 user nova-compute[74242]:   </nova:ports>
Oct 20 02:06:37 user nova-compute[74242]: </nova:instance>
Oct 20 02:06:37 user nova-compute[74242]:   </metadata>
Oct 20 02:06:37 user nova-compute[74242]:   <memory unit='KiB'>524288</memory>
Oct 20 02:06:37 user nova-compute[74242]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 02:06:37 user nova-compute[74242]:   <vcpu placement='static'>1</vcpu>
Oct 20 02:06:37 user nova-compute[74242]:   <resource>
Oct 20 02:06:37 user nova-compute[74242]:     <partition>/machine</partition>
Oct 20 02:06:37 user nova-compute[74242]:   </resource>
Oct 20 02:06:37 user nova-compute[74242]:   <sysinfo type='smbios'>
Oct 20 02:06:37 user nova-compute[74242]:     <system>
Oct 20 02:06:37 user nova-compute[74242]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 02:06:37 user nova-compute[74242]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 02:06:37 user nova-compute[74242]:       <entry name='version'>0.0.0</entry>
Oct 20 02:06:37 user nova-compute[74242]:       <entry name='serial'>e22cb246-155d-48f5-9eee-bd543c0bbaf1</entry>
Oct 20 02:06:37 user nova-compute[74242]:       <entry name='uuid'>e22cb246-155d-48f5-9eee-bd543c0bbaf1</entry>
Oct 20 02:06:37 user nova-compute[74242]:       <entry name='family'>Virtual Machine</entry>
Oct 20 02:06:37 user nova-compute[74242]:     </system>
Oct 20 02:06:37 user nova-compute[74242]:   </sysinfo>
Oct 20 02:06:37 user nova-compute[74242]:   <os>
Oct 20 02:06:37 user nova-compute[74242]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 02:06:37 user nova-compute[74242]:     <boot dev='hd'/>
Oct 20 02:06:37 user nova-compute[74242]:     <smbios mode='sysinfo'/>
Oct 20 02:06:37 user nova-compute[74242]:   </os>
Oct 20 02:06:37 user nova-compute[74242]:   <features>
Oct 20 02:06:37 user nova-compute[74242]:     <acpi/>
Oct 20 02:06:37 user nova-compute[74242]:     <apic/>
Oct 20 02:06:37 user nova-compute[74242]:     <vmcoreinfo state='on'/>
Oct 20 02:06:37 user nova-compute[74242]:   </features>
Oct 20 02:06:37 user nova-compute[74242]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 02:06:37 user nova-compute[74242]:     <model fallback='forbid'>Nehalem</model>
Oct 20 02:06:37 user nova-compute[74242]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 02:06:37 user nova-compute[74242]:     <feature policy='require' name='vme'/>
Oct 20 02:06:37 user nova-compute[74242]:     <feature policy='require' name='x2apic'/>
Oct 20 02:06:37 user nova-compute[74242]:     <feature policy='require' name='hypervisor'/>
Oct 20 02:06:37 user nova-compute[74242]:   </cpu>
Oct 20 02:06:37 user nova-compute[74242]:   <clock offset='utc'>
Oct 20 02:06:37 user nova-compute[74242]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 02:06:37 user nova-compute[74242]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 02:06:37 user nova-compute[74242]:     <timer name='hpet' present='no'/>
Oct 20 02:06:37 user nova-compute[74242]:   </clock>
Oct 20 02:06:37 user nova-compute[74242]:   <on_poweroff>destroy</on_poweroff>
Oct 20 02:06:37 user nova-compute[74242]:   <on_reboot>restart</on_reboot>
Oct 20 02:06:37 user nova-compute[74242]:   <on_crash>destroy</on_crash>
Oct 20 02:06:37 user nova-compute[74242]:   <devices>
Oct 20 02:06:37 user nova-compute[74242]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 02:06:37 user nova-compute[74242]:     <disk type='file' device='disk'>
Oct 20 02:06:37 user nova-compute[74242]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 02:06:37 user nova-compute[74242]:       <source file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk' index='2'/>
Oct 20 02:06:37 user nova-compute[74242]:       <backingStore type='file' index='3'>
Oct 20 02:06:37 user nova-compute[74242]:         <format type='raw'/>
Oct 20 02:06:37 user nova-compute[74242]:         <source file='/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8'/>
Oct 20 02:06:37 user nova-compute[74242]:         <backingStore/>
Oct 20 02:06:37 user nova-compute[74242]:       </backingStore>
Oct 20 02:06:37 user nova-compute[74242]:       <target dev='vda' bus='virtio'/>
Oct 20 02:06:37 user nova-compute[74242]:       <alias name='virtio-disk0'/>
Oct 20 02:06:37 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 02:06:37 user nova-compute[74242]:     </disk>
Oct 20 02:06:37 user nova-compute[74242]:     <disk type='file' device='cdrom'>
Oct 20 02:06:37 user nova-compute[74242]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 02:06:37 user nova-compute[74242]:       <source file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk.config' index='1'/>
Oct 20 02:06:37 user nova-compute[74242]:       <backingStore/>
Oct 20 02:06:37 user nova-compute[74242]:       <target dev='hda' bus='ide'/>
Oct 20 02:06:37 user nova-compute[74242]:       <readonly/>
Oct 20 02:06:37 user nova-compute[74242]:       <alias name='ide0-0-0'/>
Oct 20 02:06:37 user nova-compute[74242]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 02:06:37 user nova-compute[74242]:     </disk>
Oct 20 02:06:37 user nova-compute[74242]:     <controller type='usb' index='0' model='none'>
Oct 20 02:06:37 user nova-compute[74242]:       <alias name='usb'/>
Oct 20 02:06:37 user nova-compute[74242]:     </controller>
Oct 20 02:06:37 user nova-compute[74242]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 02:06:37 user nova-compute[74242]:       <alias name='pci.0'/>
Oct 20 02:06:37 user nova-compute[74242]:     </controller>
Oct 20 02:06:37 user nova-compute[74242]:     <controller type='ide' index='0'>
Oct 20 02:06:37 user nova-compute[74242]:       <alias name='ide'/>
Oct 20 02:06:37 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 02:06:37 user nova-compute[74242]:     </controller>
Oct 20 02:06:37 user nova-compute[74242]:     <interface type='ethernet'>
Oct 20 02:06:37 user nova-compute[74242]:       <mac address='fa:16:3e:86:90:03'/>
Oct 20 02:06:37 user nova-compute[74242]:       <target dev='tap7575478b-29'/>
Oct 20 02:06:37 user nova-compute[74242]:       <model type='virtio'/>
Oct 20 02:06:37 user nova-compute[74242]:       <mtu size='1442'/>
Oct 20 02:06:37 user nova-compute[74242]:       <alias name='net0'/>
Oct 20 02:06:37 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 02:06:37 user nova-compute[74242]:     </interface>
Oct 20 02:06:37 user nova-compute[74242]:     <serial type='pty'>
Oct 20 02:06:37 user nova-compute[74242]:       <source path='/dev/pts/6'/>
Oct 20 02:06:37 user nova-compute[74242]:       <log file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/console.log' append='off'/>
Oct 20 02:06:37 user nova-compute[74242]:       <target type='isa-serial' port='0'>
Oct 20 02:06:37 user nova-compute[74242]:         <model name='isa-serial'/>
Oct 20 02:06:37 user nova-compute[74242]:       </target>
Oct 20 02:06:37 user nova-compute[74242]:       <alias name='serial0'/>
Oct 20 02:06:37 user nova-compute[74242]:     </serial>
Oct 20 02:06:37 user nova-compute[74242]:     <console type='pty' tty='/dev/pts/6'>
Oct 20 02:06:37 user nova-compute[74242]:       <source path='/dev/pts/6'/>
Oct 20 02:06:37 user nova-compute[74242]:       <log file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/console.log' append='off'/>
Oct 20 02:06:37 user nova-compute[74242]:       <target type='serial' port='0'/>
Oct 20 02:06:37 user nova-compute[74242]:       <alias name='serial0'/>
Oct 20 02:06:37 user nova-compute[74242]:     </console>
Oct 20 02:06:37 user nova-compute[74242]:     <input type='mouse' bus='ps2'>
Oct 20 02:06:37 user nova-compute[74242]:       <alias name='input0'/>
Oct 20 02:06:37 user nova-compute[74242]:     </input>
Oct 20 02:06:37 user nova-compute[74242]:     <input type='keyboard' bus='ps2'>
Oct 20 02:06:37 user nova-compute[74242]:       <alias name='input1'/>
Oct 20 02:06:37 user nova-compute[74242]:     </input>
Oct 20 02:06:37 user nova-compute[74242]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 20 02:06:37 user nova-compute[74242]:       <listen type='address' address='0.0.0.0'/>
Oct 20 02:06:37 user nova-compute[74242]:     </graphics>
Oct 20 02:06:37 user nova-compute[74242]:     <audio id='1' type='none'/>
Oct 20 02:06:37 user nova-compute[74242]:     <video>
Oct 20 02:06:37 user nova-compute[74242]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 02:06:37 user nova-compute[74242]:       <alias name='video0'/>
Oct 20 02:06:37 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 02:06:37 user nova-compute[74242]:     </video>
Oct 20 02:06:37 user nova-compute[74242]:     <memballoon model='virtio'>
Oct 20 02:06:37 user nova-compute[74242]:       <stats period='10'/>
Oct 20 02:06:37 user nova-compute[74242]:       <alias name='balloon0'/>
Oct 20 02:06:37 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 02:06:37 user nova-compute[74242]:     </memballoon>
Oct 20 02:06:37 user nova-compute[74242]:     <rng model='virtio'>
Oct 20 02:06:37 user nova-compute[74242]:       <backend model='random'>/dev/urandom</backend>
Oct 20 02:06:37 user nova-compute[74242]:       <alias name='rng0'/>
Oct 20 02:06:37 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 02:06:37 user nova-compute[74242]:     </rng>
Oct 20 02:06:37 user nova-compute[74242]:   </devices>
Oct 20 02:06:37 user nova-compute[74242]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 02:06:37 user nova-compute[74242]:     <label>libvirt-e22cb246-155d-48f5-9eee-bd543c0bbaf1</label>
Oct 20 02:06:37 user nova-compute[74242]:     <imagelabel>libvirt-e22cb246-155d-48f5-9eee-bd543c0bbaf1</imagelabel>
Oct 20 02:06:37 user nova-compute[74242]:   </seclabel>
Oct 20 02:06:37 user nova-compute[74242]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 02:06:37 user nova-compute[74242]:     <label>+64055:+108</label>
Oct 20 02:06:37 user nova-compute[74242]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 02:06:37 user nova-compute[74242]:   </seclabel>
Oct 20 02:06:37 user nova-compute[74242]: </domain>
Oct 20 02:06:37 user nova-compute[74242]:  {{(pid=74242) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 02:06:37 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Successfully detached device tapb71ba39e-3a from instance e22cb246-155d-48f5-9eee-bd543c0bbaf1 from the live domain config.
Oct 20 02:06:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1179443261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1179443261',id=7,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpogir2lL5fxgT+aGdQt1FD0OBJl3IivuczQXbzwg0f71VsW0nMR64AVx2F5qXSCYftEKlBnA8CPoiaBKJjZl9XM4BiISexAmTWuqad0JPqRMC1MStDpdYS3HjZNGmZWg==',key_name='tempest-keypair-808065593',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28a8e047fa564263971543d6342579b1',ramdisk_id='',reservation_id='r-91z09vmf',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-789715889',owner_user_name='tempest-TaggedAttachmentsTest-789715889-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81797a2a7a744fa8298b767cf469631',uuid=e22cb246-155d-48f5-9eee-bd543c0bbaf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "address": "fa:16:3e:87:07:58", "network": {"id": "b33a8d23-714f-435e-8194-0add90523af5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1175840430", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71ba39e-3a", "ovs_interfaceid": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:06:37 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Converting VIF {"id": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "address": "fa:16:3e:87:07:58", "network": {"id": "b33a8d23-714f-435e-8194-0add90523af5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1175840430", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71ba39e-3a", "ovs_interfaceid": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:37 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:58,bridge_name='br-int',has_traffic_filtering=True,id=b71ba39e-3a76-4e07-971a-383990d2d6a3,network=Network(b33a8d23-714f-435e-8194-0add90523af5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71ba39e-3a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:37 user nova-compute[74242]: DEBUG os_vif [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:58,bridge_name='br-int',has_traffic_filtering=True,id=b71ba39e-3a76-4e07-971a-383990d2d6a3,network=Network(b33a8d23-714f-435e-8194-0add90523af5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71ba39e-3a') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:06:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb71ba39e-3a, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4cc8a3f5-5bb7-4154-861a-2157916b5488) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:37 user nova-compute[74242]: INFO os_vif [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:58,bridge_name='br-int',has_traffic_filtering=True,id=b71ba39e-3a76-4e07-971a-383990d2d6a3,network=Network(b33a8d23-714f-435e-8194-0add90523af5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71ba39e-3a')
Oct 20 02:06:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:06:37 user nova-compute[74242]:   <nova:package version="0.0.0"/>
Oct 20 02:06:37 user nova-compute[74242]:   <nova:name>tempest-device-tagging-server-1179443261</nova:name>
Oct 20 02:06:37 user nova-compute[74242]:   <nova:creationTime>2023-10-20 02:06:37</nova:creationTime>
Oct 20 02:06:37 user nova-compute[74242]:   <nova:flavor name="m1.tiny">
Oct 20 02:06:37 user nova-compute[74242]:     <nova:memory>512</nova:memory>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:disk>1</nova:disk>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:swap>0</nova:swap>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:vcpus>1</nova:vcpus>
Oct 20 02:06:37 user nova-compute[74242]:   </nova:flavor>
Oct 20 02:06:37 user nova-compute[74242]:   <nova:owner>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:user uuid="e81797a2a7a744fa8298b767cf469631">tempest-TaggedAttachmentsTest-789715889-project-member</nova:user>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:project uuid="28a8e047fa564263971543d6342579b1">tempest-TaggedAttachmentsTest-789715889</nova:project>
Oct 20 02:06:37 user nova-compute[74242]:   </nova:owner>
Oct 20 02:06:37 user nova-compute[74242]:   <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:06:37 user nova-compute[74242]:   <nova:ports>
Oct 20 02:06:37 user nova-compute[74242]:     <nova:port uuid="7575478b-29e4-493e-a04f-0e3747a5c64a">
Oct 20 02:06:37 user nova-compute[74242]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 02:06:37 user nova-compute[74242]:     </nova:port>
Oct 20 02:06:37 user nova-compute[74242]:   </nova:ports>
Oct 20 02:06:37 user nova-compute[74242]: </nova:instance>
Oct 20 02:06:37 user nova-compute[74242]:  {{(pid=74242) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received event network-vif-deleted-b71ba39e-3a76-4e07-971a-383990d2d6a3 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:38 user nova-compute[74242]: INFO nova.compute.manager [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Neutron deleted interface b71ba39e-3a76-4e07-971a-383990d2d6a3; detaching it from the instance and deleting it from the info cache
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.network.neutron [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Updating instance_info_cache with network_info: [{"id": "7575478b-29e4-493e-a04f-0e3747a5c64a", "address": "fa:16:3e:86:90:03", "network": {"id": "bba69f21-fd72-478c-8f16-a8fcd9b41e96", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1592153998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7575478b-29", "ovs_interfaceid": "7575478b-29e4-493e-a04f-0e3747a5c64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquired lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.network.neutron [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.objects.instance [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] Lazy-loading 'system_metadata' on Instance uuid e22cb246-155d-48f5-9eee-bd543c0bbaf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.objects.instance [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] Lazy-loading 'flavor' on Instance uuid e22cb246-155d-48f5-9eee-bd543c0bbaf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.objects.base [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] Object Instance<e22cb246-155d-48f5-9eee-bd543c0bbaf1> lazy-loaded attributes: system_metadata,flavor {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1179443261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1179443261',id=7,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpogir2lL5fxgT+aGdQt1FD0OBJl3IivuczQXbzwg0f71VsW0nMR64AVx2F5qXSCYftEKlBnA8CPoiaBKJjZl9XM4BiISexAmTWuqad0JPqRMC1MStDpdYS3HjZNGmZWg==',key_name='tempest-keypair-808065593',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28a8e047fa564263971543d6342579b1',ramdisk_id='',reservation_id='r-91z09vmf',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-789715889',owner_user_name='tempest-TaggedAttachmentsTest-789715889-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81797a2a7a744fa8298b767cf469631',uuid=e22cb246-155d-48f5-9eee-bd543c0bbaf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "address": "fa:16:3e:87:07:58", "network": {"id": "b33a8d23-714f-435e-8194-0add90523af5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1175840430", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71ba39e-3a", "ovs_interfaceid": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] Converting VIF {"id": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "address": "fa:16:3e:87:07:58", "network": {"id": "b33a8d23-714f-435e-8194-0add90523af5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1175840430", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71ba39e-3a", "ovs_interfaceid": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:58,bridge_name='br-int',has_traffic_filtering=True,id=b71ba39e-3a76-4e07-971a-383990d2d6a3,network=Network(b33a8d23-714f-435e-8194-0add90523af5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71ba39e-3a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:07:58"/><model type="virtio"/><mtu size="1442"/><target dev="tapb71ba39e-3a"/></interface> {{(pid=74242) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:87:07:58"/><model type="virtio"/><mtu size="1442"/><target dev="tapb71ba39e-3a"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 20 02:06:38 user nova-compute[74242]:   <name>instance-00000007</name>
Oct 20 02:06:38 user nova-compute[74242]:   <uuid>e22cb246-155d-48f5-9eee-bd543c0bbaf1</uuid>
Oct 20 02:06:38 user nova-compute[74242]:   <metadata>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:06:38 user nova-compute[74242]:   <nova:package version="0.0.0"/>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:name>tempest-device-tagging-server-1179443261</nova:name>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:creationTime>2023-10-20 02:06:37</nova:creationTime>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:flavor name="m1.tiny">
Oct 20 02:06:38 user nova-compute[74242]:     <nova:memory>512</nova:memory>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:disk>1</nova:disk>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:swap>0</nova:swap>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:vcpus>1</nova:vcpus>
Oct 20 02:06:38 user nova-compute[74242]:   </nova:flavor>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:owner>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:user uuid="e81797a2a7a744fa8298b767cf469631">tempest-TaggedAttachmentsTest-789715889-project-member</nova:user>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:project uuid="28a8e047fa564263971543d6342579b1">tempest-TaggedAttachmentsTest-789715889</nova:project>
Oct 20 02:06:38 user nova-compute[74242]:   </nova:owner>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:ports>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:port uuid="7575478b-29e4-493e-a04f-0e3747a5c64a">
Oct 20 02:06:38 user nova-compute[74242]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 02:06:38 user nova-compute[74242]:     </nova:port>
Oct 20 02:06:38 user nova-compute[74242]:   </nova:ports>
Oct 20 02:06:38 user nova-compute[74242]: </nova:instance>
Oct 20 02:06:38 user nova-compute[74242]:   </metadata>
Oct 20 02:06:38 user nova-compute[74242]:   <memory unit='KiB'>524288</memory>
Oct 20 02:06:38 user nova-compute[74242]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 02:06:38 user nova-compute[74242]:   <vcpu placement='static'>1</vcpu>
Oct 20 02:06:38 user nova-compute[74242]:   <resource>
Oct 20 02:06:38 user nova-compute[74242]:     <partition>/machine</partition>
Oct 20 02:06:38 user nova-compute[74242]:   </resource>
Oct 20 02:06:38 user nova-compute[74242]:   <sysinfo type='smbios'>
Oct 20 02:06:38 user nova-compute[74242]:     <system>
Oct 20 02:06:38 user nova-compute[74242]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 02:06:38 user nova-compute[74242]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 02:06:38 user nova-compute[74242]:       <entry name='version'>0.0.0</entry>
Oct 20 02:06:38 user nova-compute[74242]:       <entry name='serial'>e22cb246-155d-48f5-9eee-bd543c0bbaf1</entry>
Oct 20 02:06:38 user nova-compute[74242]:       <entry name='uuid'>e22cb246-155d-48f5-9eee-bd543c0bbaf1</entry>
Oct 20 02:06:38 user nova-compute[74242]:       <entry name='family'>Virtual Machine</entry>
Oct 20 02:06:38 user nova-compute[74242]:     </system>
Oct 20 02:06:38 user nova-compute[74242]:   </sysinfo>
Oct 20 02:06:38 user nova-compute[74242]:   <os>
Oct 20 02:06:38 user nova-compute[74242]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 02:06:38 user nova-compute[74242]:     <boot dev='hd'/>
Oct 20 02:06:38 user nova-compute[74242]:     <smbios mode='sysinfo'/>
Oct 20 02:06:38 user nova-compute[74242]:   </os>
Oct 20 02:06:38 user nova-compute[74242]:   <features>
Oct 20 02:06:38 user nova-compute[74242]:     <acpi/>
Oct 20 02:06:38 user nova-compute[74242]:     <apic/>
Oct 20 02:06:38 user nova-compute[74242]:     <vmcoreinfo state='on'/>
Oct 20 02:06:38 user nova-compute[74242]:   </features>
Oct 20 02:06:38 user nova-compute[74242]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 02:06:38 user nova-compute[74242]:     <model fallback='forbid'>Nehalem</model>
Oct 20 02:06:38 user nova-compute[74242]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 02:06:38 user nova-compute[74242]:     <feature policy='require' name='vme'/>
Oct 20 02:06:38 user nova-compute[74242]:     <feature policy='require' name='x2apic'/>
Oct 20 02:06:38 user nova-compute[74242]:     <feature policy='require' name='hypervisor'/>
Oct 20 02:06:38 user nova-compute[74242]:   </cpu>
Oct 20 02:06:38 user nova-compute[74242]:   <clock offset='utc'>
Oct 20 02:06:38 user nova-compute[74242]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 02:06:38 user nova-compute[74242]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 02:06:38 user nova-compute[74242]:     <timer name='hpet' present='no'/>
Oct 20 02:06:38 user nova-compute[74242]:   </clock>
Oct 20 02:06:38 user nova-compute[74242]:   <on_poweroff>destroy</on_poweroff>
Oct 20 02:06:38 user nova-compute[74242]:   <on_reboot>restart</on_reboot>
Oct 20 02:06:38 user nova-compute[74242]:   <on_crash>destroy</on_crash>
Oct 20 02:06:38 user nova-compute[74242]:   <devices>
Oct 20 02:06:38 user nova-compute[74242]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 02:06:38 user nova-compute[74242]:     <disk type='file' device='disk'>
Oct 20 02:06:38 user nova-compute[74242]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 02:06:38 user nova-compute[74242]:       <source file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk' index='2'/>
Oct 20 02:06:38 user nova-compute[74242]:       <backingStore type='file' index='3'>
Oct 20 02:06:38 user nova-compute[74242]:         <format type='raw'/>
Oct 20 02:06:38 user nova-compute[74242]:         <source file='/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8'/>
Oct 20 02:06:38 user nova-compute[74242]:         <backingStore/>
Oct 20 02:06:38 user nova-compute[74242]:       </backingStore>
Oct 20 02:06:38 user nova-compute[74242]:       <target dev='vda' bus='virtio'/>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='virtio-disk0'/>
Oct 20 02:06:38 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </disk>
Oct 20 02:06:38 user nova-compute[74242]:     <disk type='file' device='cdrom'>
Oct 20 02:06:38 user nova-compute[74242]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 02:06:38 user nova-compute[74242]:       <source file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk.config' index='1'/>
Oct 20 02:06:38 user nova-compute[74242]:       <backingStore/>
Oct 20 02:06:38 user nova-compute[74242]:       <target dev='hda' bus='ide'/>
Oct 20 02:06:38 user nova-compute[74242]:       <readonly/>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='ide0-0-0'/>
Oct 20 02:06:38 user nova-compute[74242]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </disk>
Oct 20 02:06:38 user nova-compute[74242]:     <controller type='usb' index='0' model='none'>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='usb'/>
Oct 20 02:06:38 user nova-compute[74242]:     </controller>
Oct 20 02:06:38 user nova-compute[74242]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='pci.0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </controller>
Oct 20 02:06:38 user nova-compute[74242]:     <controller type='ide' index='0'>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='ide'/>
Oct 20 02:06:38 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 02:06:38 user nova-compute[74242]:     </controller>
Oct 20 02:06:38 user nova-compute[74242]:     <interface type='ethernet'>
Oct 20 02:06:38 user nova-compute[74242]:       <mac address='fa:16:3e:86:90:03'/>
Oct 20 02:06:38 user nova-compute[74242]:       <target dev='tap7575478b-29'/>
Oct 20 02:06:38 user nova-compute[74242]:       <model type='virtio'/>
Oct 20 02:06:38 user nova-compute[74242]:       <mtu size='1442'/>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='net0'/>
Oct 20 02:06:38 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </interface>
Oct 20 02:06:38 user nova-compute[74242]:     <serial type='pty'>
Oct 20 02:06:38 user nova-compute[74242]:       <source path='/dev/pts/6'/>
Oct 20 02:06:38 user nova-compute[74242]:       <log file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/console.log' append='off'/>
Oct 20 02:06:38 user nova-compute[74242]:       <target type='isa-serial' port='0'>
Oct 20 02:06:38 user nova-compute[74242]:         <model name='isa-serial'/>
Oct 20 02:06:38 user nova-compute[74242]:       </target>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='serial0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </serial>
Oct 20 02:06:38 user nova-compute[74242]:     <console type='pty' tty='/dev/pts/6'>
Oct 20 02:06:38 user nova-compute[74242]:       <source path='/dev/pts/6'/>
Oct 20 02:06:38 user nova-compute[74242]:       <log file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/console.log' append='off'/>
Oct 20 02:06:38 user nova-compute[74242]:       <target type='serial' port='0'/>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='serial0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </console>
Oct 20 02:06:38 user nova-compute[74242]:     <input type='mouse' bus='ps2'>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='input0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </input>
Oct 20 02:06:38 user nova-compute[74242]:     <input type='keyboard' bus='ps2'>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='input1'/>
Oct 20 02:06:38 user nova-compute[74242]:     </input>
Oct 20 02:06:38 user nova-compute[74242]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 20 02:06:38 user nova-compute[74242]:       <listen type='address' address='0.0.0.0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </graphics>
Oct 20 02:06:38 user nova-compute[74242]:     <audio id='1' type='none'/>
Oct 20 02:06:38 user nova-compute[74242]:     <video>
Oct 20 02:06:38 user nova-compute[74242]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='video0'/>
Oct 20 02:06:38 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </video>
Oct 20 02:06:38 user nova-compute[74242]:     <memballoon model='virtio'>
Oct 20 02:06:38 user nova-compute[74242]:       <stats period='10'/>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='balloon0'/>
Oct 20 02:06:38 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </memballoon>
Oct 20 02:06:38 user nova-compute[74242]:     <rng model='virtio'>
Oct 20 02:06:38 user nova-compute[74242]:       <backend model='random'>/dev/urandom</backend>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='rng0'/>
Oct 20 02:06:38 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </rng>
Oct 20 02:06:38 user nova-compute[74242]:   </devices>
Oct 20 02:06:38 user nova-compute[74242]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 02:06:38 user nova-compute[74242]:     <label>libvirt-e22cb246-155d-48f5-9eee-bd543c0bbaf1</label>
Oct 20 02:06:38 user nova-compute[74242]:     <imagelabel>libvirt-e22cb246-155d-48f5-9eee-bd543c0bbaf1</imagelabel>
Oct 20 02:06:38 user nova-compute[74242]:   </seclabel>
Oct 20 02:06:38 user nova-compute[74242]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 02:06:38 user nova-compute[74242]:     <label>+64055:+108</label>
Oct 20 02:06:38 user nova-compute[74242]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 02:06:38 user nova-compute[74242]:   </seclabel>
Oct 20 02:06:38 user nova-compute[74242]: </domain>
Oct 20 02:06:38 user nova-compute[74242]:  {{(pid=74242) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:87:07:58"/><model type="virtio"/><mtu size="1442"/><target dev="tapb71ba39e-3a"/></interface> {{(pid=74242) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:87:07:58"/><model type="virtio"/><mtu size="1442"/><target dev="tapb71ba39e-3a"/></interface>not found in domain: <domain type='kvm' id='7'>
Oct 20 02:06:38 user nova-compute[74242]:   <name>instance-00000007</name>
Oct 20 02:06:38 user nova-compute[74242]:   <uuid>e22cb246-155d-48f5-9eee-bd543c0bbaf1</uuid>
Oct 20 02:06:38 user nova-compute[74242]:   <metadata>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:06:38 user nova-compute[74242]:   <nova:package version="0.0.0"/>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:name>tempest-device-tagging-server-1179443261</nova:name>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:creationTime>2023-10-20 02:06:37</nova:creationTime>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:flavor name="m1.tiny">
Oct 20 02:06:38 user nova-compute[74242]:     <nova:memory>512</nova:memory>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:disk>1</nova:disk>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:swap>0</nova:swap>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:vcpus>1</nova:vcpus>
Oct 20 02:06:38 user nova-compute[74242]:   </nova:flavor>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:owner>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:user uuid="e81797a2a7a744fa8298b767cf469631">tempest-TaggedAttachmentsTest-789715889-project-member</nova:user>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:project uuid="28a8e047fa564263971543d6342579b1">tempest-TaggedAttachmentsTest-789715889</nova:project>
Oct 20 02:06:38 user nova-compute[74242]:   </nova:owner>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:ports>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:port uuid="7575478b-29e4-493e-a04f-0e3747a5c64a">
Oct 20 02:06:38 user nova-compute[74242]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 02:06:38 user nova-compute[74242]:     </nova:port>
Oct 20 02:06:38 user nova-compute[74242]:   </nova:ports>
Oct 20 02:06:38 user nova-compute[74242]: </nova:instance>
Oct 20 02:06:38 user nova-compute[74242]:   </metadata>
Oct 20 02:06:38 user nova-compute[74242]:   <memory unit='KiB'>524288</memory>
Oct 20 02:06:38 user nova-compute[74242]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 20 02:06:38 user nova-compute[74242]:   <vcpu placement='static'>1</vcpu>
Oct 20 02:06:38 user nova-compute[74242]:   <resource>
Oct 20 02:06:38 user nova-compute[74242]:     <partition>/machine</partition>
Oct 20 02:06:38 user nova-compute[74242]:   </resource>
Oct 20 02:06:38 user nova-compute[74242]:   <sysinfo type='smbios'>
Oct 20 02:06:38 user nova-compute[74242]:     <system>
Oct 20 02:06:38 user nova-compute[74242]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 20 02:06:38 user nova-compute[74242]:       <entry name='product'>OpenStack Nova</entry>
Oct 20 02:06:38 user nova-compute[74242]:       <entry name='version'>0.0.0</entry>
Oct 20 02:06:38 user nova-compute[74242]:       <entry name='serial'>e22cb246-155d-48f5-9eee-bd543c0bbaf1</entry>
Oct 20 02:06:38 user nova-compute[74242]:       <entry name='uuid'>e22cb246-155d-48f5-9eee-bd543c0bbaf1</entry>
Oct 20 02:06:38 user nova-compute[74242]:       <entry name='family'>Virtual Machine</entry>
Oct 20 02:06:38 user nova-compute[74242]:     </system>
Oct 20 02:06:38 user nova-compute[74242]:   </sysinfo>
Oct 20 02:06:38 user nova-compute[74242]:   <os>
Oct 20 02:06:38 user nova-compute[74242]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 20 02:06:38 user nova-compute[74242]:     <boot dev='hd'/>
Oct 20 02:06:38 user nova-compute[74242]:     <smbios mode='sysinfo'/>
Oct 20 02:06:38 user nova-compute[74242]:   </os>
Oct 20 02:06:38 user nova-compute[74242]:   <features>
Oct 20 02:06:38 user nova-compute[74242]:     <acpi/>
Oct 20 02:06:38 user nova-compute[74242]:     <apic/>
Oct 20 02:06:38 user nova-compute[74242]:     <vmcoreinfo state='on'/>
Oct 20 02:06:38 user nova-compute[74242]:   </features>
Oct 20 02:06:38 user nova-compute[74242]:   <cpu mode='custom' match='exact' check='full'>
Oct 20 02:06:38 user nova-compute[74242]:     <model fallback='forbid'>Nehalem</model>
Oct 20 02:06:38 user nova-compute[74242]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 20 02:06:38 user nova-compute[74242]:     <feature policy='require' name='vme'/>
Oct 20 02:06:38 user nova-compute[74242]:     <feature policy='require' name='x2apic'/>
Oct 20 02:06:38 user nova-compute[74242]:     <feature policy='require' name='hypervisor'/>
Oct 20 02:06:38 user nova-compute[74242]:   </cpu>
Oct 20 02:06:38 user nova-compute[74242]:   <clock offset='utc'>
Oct 20 02:06:38 user nova-compute[74242]:     <timer name='pit' tickpolicy='delay'/>
Oct 20 02:06:38 user nova-compute[74242]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 20 02:06:38 user nova-compute[74242]:     <timer name='hpet' present='no'/>
Oct 20 02:06:38 user nova-compute[74242]:   </clock>
Oct 20 02:06:38 user nova-compute[74242]:   <on_poweroff>destroy</on_poweroff>
Oct 20 02:06:38 user nova-compute[74242]:   <on_reboot>restart</on_reboot>
Oct 20 02:06:38 user nova-compute[74242]:   <on_crash>destroy</on_crash>
Oct 20 02:06:38 user nova-compute[74242]:   <devices>
Oct 20 02:06:38 user nova-compute[74242]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 20 02:06:38 user nova-compute[74242]:     <disk type='file' device='disk'>
Oct 20 02:06:38 user nova-compute[74242]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 20 02:06:38 user nova-compute[74242]:       <source file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk' index='2'/>
Oct 20 02:06:38 user nova-compute[74242]:       <backingStore type='file' index='3'>
Oct 20 02:06:38 user nova-compute[74242]:         <format type='raw'/>
Oct 20 02:06:38 user nova-compute[74242]:         <source file='/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8'/>
Oct 20 02:06:38 user nova-compute[74242]:         <backingStore/>
Oct 20 02:06:38 user nova-compute[74242]:       </backingStore>
Oct 20 02:06:38 user nova-compute[74242]:       <target dev='vda' bus='virtio'/>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='virtio-disk0'/>
Oct 20 02:06:38 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </disk>
Oct 20 02:06:38 user nova-compute[74242]:     <disk type='file' device='cdrom'>
Oct 20 02:06:38 user nova-compute[74242]:       <driver name='qemu' type='raw' cache='none'/>
Oct 20 02:06:38 user nova-compute[74242]:       <source file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/disk.config' index='1'/>
Oct 20 02:06:38 user nova-compute[74242]:       <backingStore/>
Oct 20 02:06:38 user nova-compute[74242]:       <target dev='hda' bus='ide'/>
Oct 20 02:06:38 user nova-compute[74242]:       <readonly/>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='ide0-0-0'/>
Oct 20 02:06:38 user nova-compute[74242]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </disk>
Oct 20 02:06:38 user nova-compute[74242]:     <controller type='usb' index='0' model='none'>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='usb'/>
Oct 20 02:06:38 user nova-compute[74242]:     </controller>
Oct 20 02:06:38 user nova-compute[74242]:     <controller type='pci' index='0' model='pci-root'>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='pci.0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </controller>
Oct 20 02:06:38 user nova-compute[74242]:     <controller type='ide' index='0'>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='ide'/>
Oct 20 02:06:38 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 20 02:06:38 user nova-compute[74242]:     </controller>
Oct 20 02:06:38 user nova-compute[74242]:     <interface type='ethernet'>
Oct 20 02:06:38 user nova-compute[74242]:       <mac address='fa:16:3e:86:90:03'/>
Oct 20 02:06:38 user nova-compute[74242]:       <target dev='tap7575478b-29'/>
Oct 20 02:06:38 user nova-compute[74242]:       <model type='virtio'/>
Oct 20 02:06:38 user nova-compute[74242]:       <mtu size='1442'/>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='net0'/>
Oct 20 02:06:38 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </interface>
Oct 20 02:06:38 user nova-compute[74242]:     <serial type='pty'>
Oct 20 02:06:38 user nova-compute[74242]:       <source path='/dev/pts/6'/>
Oct 20 02:06:38 user nova-compute[74242]:       <log file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/console.log' append='off'/>
Oct 20 02:06:38 user nova-compute[74242]:       <target type='isa-serial' port='0'>
Oct 20 02:06:38 user nova-compute[74242]:         <model name='isa-serial'/>
Oct 20 02:06:38 user nova-compute[74242]:       </target>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='serial0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </serial>
Oct 20 02:06:38 user nova-compute[74242]:     <console type='pty' tty='/dev/pts/6'>
Oct 20 02:06:38 user nova-compute[74242]:       <source path='/dev/pts/6'/>
Oct 20 02:06:38 user nova-compute[74242]:       <log file='/opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1/console.log' append='off'/>
Oct 20 02:06:38 user nova-compute[74242]:       <target type='serial' port='0'/>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='serial0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </console>
Oct 20 02:06:38 user nova-compute[74242]:     <input type='mouse' bus='ps2'>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='input0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </input>
Oct 20 02:06:38 user nova-compute[74242]:     <input type='keyboard' bus='ps2'>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='input1'/>
Oct 20 02:06:38 user nova-compute[74242]:     </input>
Oct 20 02:06:38 user nova-compute[74242]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Oct 20 02:06:38 user nova-compute[74242]:       <listen type='address' address='0.0.0.0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </graphics>
Oct 20 02:06:38 user nova-compute[74242]:     <audio id='1' type='none'/>
Oct 20 02:06:38 user nova-compute[74242]:     <video>
Oct 20 02:06:38 user nova-compute[74242]:       <model type='virtio' heads='1' primary='yes'/>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='video0'/>
Oct 20 02:06:38 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </video>
Oct 20 02:06:38 user nova-compute[74242]:     <memballoon model='virtio'>
Oct 20 02:06:38 user nova-compute[74242]:       <stats period='10'/>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='balloon0'/>
Oct 20 02:06:38 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </memballoon>
Oct 20 02:06:38 user nova-compute[74242]:     <rng model='virtio'>
Oct 20 02:06:38 user nova-compute[74242]:       <backend model='random'>/dev/urandom</backend>
Oct 20 02:06:38 user nova-compute[74242]:       <alias name='rng0'/>
Oct 20 02:06:38 user nova-compute[74242]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 20 02:06:38 user nova-compute[74242]:     </rng>
Oct 20 02:06:38 user nova-compute[74242]:   </devices>
Oct 20 02:06:38 user nova-compute[74242]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 20 02:06:38 user nova-compute[74242]:     <label>libvirt-e22cb246-155d-48f5-9eee-bd543c0bbaf1</label>
Oct 20 02:06:38 user nova-compute[74242]:     <imagelabel>libvirt-e22cb246-155d-48f5-9eee-bd543c0bbaf1</imagelabel>
Oct 20 02:06:38 user nova-compute[74242]:   </seclabel>
Oct 20 02:06:38 user nova-compute[74242]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 20 02:06:38 user nova-compute[74242]:     <label>+64055:+108</label>
Oct 20 02:06:38 user nova-compute[74242]:     <imagelabel>+64055:+108</imagelabel>
Oct 20 02:06:38 user nova-compute[74242]:   </seclabel>
Oct 20 02:06:38 user nova-compute[74242]: </domain>
Oct 20 02:06:38 user nova-compute[74242]:  {{(pid=74242) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 20 02:06:38 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Detaching interface fa:16:3e:87:07:58 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapb71ba39e-3a' not found.
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1179443261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1179443261',id=7,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpogir2lL5fxgT+aGdQt1FD0OBJl3IivuczQXbzwg0f71VsW0nMR64AVx2F5qXSCYftEKlBnA8CPoiaBKJjZl9XM4BiISexAmTWuqad0JPqRMC1MStDpdYS3HjZNGmZWg==',key_name='tempest-keypair-808065593',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28a8e047fa564263971543d6342579b1',ramdisk_id='',reservation_id='r-91z09vmf',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-789715889',owner_user_name='tempest-TaggedAttachmentsTest-789715889-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81797a2a7a744fa8298b767cf469631',uuid=e22cb246-155d-48f5-9eee-bd543c0bbaf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "address": "fa:16:3e:87:07:58", "network": {"id": "b33a8d23-714f-435e-8194-0add90523af5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1175840430", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71ba39e-3a", "ovs_interfaceid": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] Converting VIF {"id": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "address": "fa:16:3e:87:07:58", "network": {"id": "b33a8d23-714f-435e-8194-0add90523af5", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1175840430", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.226", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb71ba39e-3a", "ovs_interfaceid": "b71ba39e-3a76-4e07-971a-383990d2d6a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:58,bridge_name='br-int',has_traffic_filtering=True,id=b71ba39e-3a76-4e07-971a-383990d2d6a3,network=Network(b33a8d23-714f-435e-8194-0add90523af5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71ba39e-3a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG os_vif [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:58,bridge_name='br-int',has_traffic_filtering=True,id=b71ba39e-3a76-4e07-971a-383990d2d6a3,network=Network(b33a8d23-714f-435e-8194-0add90523af5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71ba39e-3a') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb71ba39e-3a, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:06:38 user nova-compute[74242]: INFO os_vif [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:07:58,bridge_name='br-int',has_traffic_filtering=True,id=b71ba39e-3a76-4e07-971a-383990d2d6a3,network=Network(b33a8d23-714f-435e-8194-0add90523af5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb71ba39e-3a')
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [req-9143f2ac-14b9-4175-9ede-6e94d4f56958 req-3fcb8dee-600b-4f91-b1f7-e4ba38706577 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:06:38 user nova-compute[74242]:   <nova:package version="0.0.0"/>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:name>tempest-device-tagging-server-1179443261</nova:name>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:creationTime>2023-10-20 02:06:38</nova:creationTime>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:flavor name="m1.tiny">
Oct 20 02:06:38 user nova-compute[74242]:     <nova:memory>512</nova:memory>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:disk>1</nova:disk>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:swap>0</nova:swap>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:vcpus>1</nova:vcpus>
Oct 20 02:06:38 user nova-compute[74242]:   </nova:flavor>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:owner>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:user uuid="e81797a2a7a744fa8298b767cf469631">tempest-TaggedAttachmentsTest-789715889-project-member</nova:user>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:project uuid="28a8e047fa564263971543d6342579b1">tempest-TaggedAttachmentsTest-789715889</nova:project>
Oct 20 02:06:38 user nova-compute[74242]:   </nova:owner>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:06:38 user nova-compute[74242]:   <nova:ports>
Oct 20 02:06:38 user nova-compute[74242]:     <nova:port uuid="7575478b-29e4-493e-a04f-0e3747a5c64a">
Oct 20 02:06:38 user nova-compute[74242]:       <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 02:06:38 user nova-compute[74242]:     </nova:port>
Oct 20 02:06:38 user nova-compute[74242]:   </nova:ports>
Oct 20 02:06:38 user nova-compute[74242]: </nova:instance>
Oct 20 02:06:38 user nova-compute[74242]:  {{(pid=74242) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 20 02:06:38 user nova-compute[74242]: INFO nova.network.neutron [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Port b71ba39e-3a76-4e07-971a-383990d2d6a3 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Oct 20 02:06:38 user nova-compute[74242]: DEBUG nova.network.neutron [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Updating instance_info_cache with network_info: [{"id": "7575478b-29e4-493e-a04f-0e3747a5c64a", "address": "fa:16:3e:86:90:03", "network": {"id": "bba69f21-fd72-478c-8f16-a8fcd9b41e96", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1592153998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7575478b-29", "ovs_interfaceid": "7575478b-29e4-493e-a04f-0e3747a5c64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:06:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Releasing lock "refresh_cache-e22cb246-155d-48f5-9eee-bd543c0bbaf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:06:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-277b5c01-f67d-44f8-af4c-86f64a8dfc1f tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "interface-e22cb246-155d-48f5-9eee-bd543c0bbaf1-b71ba39e-3a76-4e07-971a-383990d2d6a3" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.564s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-5d0fc850-9036-4fd3-a244-cb876c354a42 req-09fde16e-e2d7-4b44-bb22-205a2811418e service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received event volume-reimaged-6e79478c-34db-431c-86df-ffa42a493f68 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5d0fc850-9036-4fd3-a244-cb876c354a42 req-09fde16e-e2d7-4b44-bb22-205a2811418e service nova] Acquiring lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5d0fc850-9036-4fd3-a244-cb876c354a42 req-09fde16e-e2d7-4b44-bb22-205a2811418e service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5d0fc850-9036-4fd3-a244-cb876c354a42 req-09fde16e-e2d7-4b44-bb22-205a2811418e service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-5d0fc850-9036-4fd3-a244-cb876c354a42 req-09fde16e-e2d7-4b44-bb22-205a2811418e service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Processing event volume-reimaged-6e79478c-34db-431c-86df-ffa42a493f68 {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10871}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Instance event wait completed in 29 seconds for volume-reimaged {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:06:42 user nova-compute[74242]: INFO nova.virt.block_device [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Booting with volume 6e79478c-34db-431c-86df-ffa42a493f68 at /dev/vda
Oct 20 02:06:42 user nova-compute[74242]: DEBUG os_brick.utils [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbbcb0d-a1b4-48ff-a233-a7006f59ea75]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad39e457-b755-4172-88e9-ed77c6846291]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8057b3c5-7b8f-4b29-b791-300d41cb12ac]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ff3549-3b8c-41de-87b6-5d637233c25d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:06:42 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:06:42 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0581618c-78be-4a83-9ebb-f721398cde20]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG os_brick.utils [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Updating existing volume attachment record: 30c9bf4f-b934-49e4-a062-53b8947daed3 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:06:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "1e23c60d-f373-431e-952e-600b9b5d6ea2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "1e23c60d-f373-431e-952e-600b9b5d6ea2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "1e23c60d-f373-431e-952e-600b9b5d6ea2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "1e23c60d-f373-431e-952e-600b9b5d6ea2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "1e23c60d-f373-431e-952e-600b9b5d6ea2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:47 user nova-compute[74242]: INFO nova.compute.manager [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Terminating instance
Oct 20 02:06:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-d053c06e-b6bf-4e81-83f3-6a520d641136 req-79bac0eb-1330-40bd-a149-9c243f084b95 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Received event network-vif-unplugged-0f970626-ca00-4d2c-a588-4d5c703fdad4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d053c06e-b6bf-4e81-83f3-6a520d641136 req-79bac0eb-1330-40bd-a149-9c243f084b95 service nova] Acquiring lock "1e23c60d-f373-431e-952e-600b9b5d6ea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d053c06e-b6bf-4e81-83f3-6a520d641136 req-79bac0eb-1330-40bd-a149-9c243f084b95 service nova] Lock "1e23c60d-f373-431e-952e-600b9b5d6ea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d053c06e-b6bf-4e81-83f3-6a520d641136 req-79bac0eb-1330-40bd-a149-9c243f084b95 service nova] Lock "1e23c60d-f373-431e-952e-600b9b5d6ea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-d053c06e-b6bf-4e81-83f3-6a520d641136 req-79bac0eb-1330-40bd-a149-9c243f084b95 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] No waiting events found dispatching network-vif-unplugged-0f970626-ca00-4d2c-a588-4d5c703fdad4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-d053c06e-b6bf-4e81-83f3-6a520d641136 req-79bac0eb-1330-40bd-a149-9c243f084b95 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Received event network-vif-unplugged-0f970626-ca00-4d2c-a588-4d5c703fdad4 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Instance destroyed successfully.
Oct 20 02:06:48 user nova-compute[74242]: DEBUG nova.objects.instance [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lazy-loading 'resources' on Instance uuid 1e23c60d-f373-431e-952e-600b9b5d6ea2 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:04:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1650234974',display_name='tempest-TestVolumeBootPattern-server-1650234974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1650234974',id=11,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:05:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-bfi8uxz6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:05:28Z,user_data=None,user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=1e23c60d-f373-431e-952e-600b9b5d6ea2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "address": "fa:16:3e:26:60:91", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f970626-ca", "ovs_interfaceid": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "address": "fa:16:3e:26:60:91", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f970626-ca", "ovs_interfaceid": "0f970626-ca00-4d2c-a588-4d5c703fdad4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:60:91,bridge_name='br-int',has_traffic_filtering=True,id=0f970626-ca00-4d2c-a588-4d5c703fdad4,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f970626-ca') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_vif [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:60:91,bridge_name='br-int',has_traffic_filtering=True,id=0f970626-ca00-4d2c-a588-4d5c703fdad4,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f970626-ca') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f970626-ca, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e71952a-2fbe-4b40-9e55-21d12db86175) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:48 user nova-compute[74242]: INFO os_vif [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:60:91,bridge_name='br-int',has_traffic_filtering=True,id=0f970626-ca00-4d2c-a588-4d5c703fdad4,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f970626-ca')
Oct 20 02:06:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'UVvcwhTn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:06:48 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bff007-5d41-40c8-a3fe-4ac3e4a1f075]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:06:48 user nova-compute[74242]: No targets found.
Oct 20 02:06:48 user nova-compute[74242]: iSNS:
Oct 20 02:06:48 user nova-compute[74242]: No targets found.
Oct 20 02:06:48 user nova-compute[74242]: STATIC:
Oct 20 02:06:48 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd
Oct 20 02:06:48 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:06:48 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:06:48 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e
Oct 20 02:06:48 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:06:48 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:06:48 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7
Oct 20 02:06:48 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:06:48 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:06:48 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8
Oct 20 02:06:48 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:06:48 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:06:48 user nova-compute[74242]: FIRMWARE:
Oct 20 02:06:48 user nova-compute[74242]: No targets found.
Oct 20 02:06:48 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:06:48 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:06:48 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.057s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bd41cc-da56-4924-8448-146bf14b8393]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb18aed-249f-45bc-80cf-83ac888063ae]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:06:48 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:48 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:06:48 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:06:48 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:06:48 user nova-compute[74242]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 (non-flash)
Oct 20 02:06:48 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:06:48 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:06:48 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d0299480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7'): ({'sde'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Removing single pathed devices sde {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6067a1-f5bb-49a5-bdc2-96996f35f68a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8da39b08-0362-4f32-a55f-3aa4130a85a9]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flushing IO for device /dev/sde {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[07195cf9-969a-40aa-844d-d223b3bf268b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.051s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6896c42-817a-4a74-bb08-c4bdee79dfb3]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_9419e2bb', '/dev/disk/by-id/scsi-23634313930376530', '/dev/disk/by-id/scsi-1SCST_BIO9419e2bb-641907e0342b81ee') {{(pid=85329) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[363b015f-d0df-48ed-95d5-850c7fe008e0]: (4, None) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[386cf658-c9c3-4a6e-b1ec-3c7bf36d1066]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fcb7e79-9acd-47b7-b2c0-7a6c501d5005]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7, portal: 172.16.0.220,3260]
Oct 20 02:06:49 user nova-compute[74242]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7, portal: 172.16.0.220,3260] successful.
Oct 20 02:06:49 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:06:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52b084a0-3032-4c29-846e-066ece9918c7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:06:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f9aa33-4113-488f-8869-e6312cdf397b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:06:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:06:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:06:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== disconnect_volume: return (414ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:06:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:06:49 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Deleting instance files /opt/stack/data/nova/instances/1e23c60d-f373-431e-952e-600b9b5d6ea2_del
Oct 20 02:06:49 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Deletion of /opt/stack/data/nova/instances/1e23c60d-f373-431e-952e-600b9b5d6ea2_del complete
Oct 20 02:06:49 user nova-compute[74242]: INFO nova.compute.manager [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Took 1.51 seconds to destroy the instance on the hypervisor.
Oct 20 02:06:49 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:06:49 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:06:49 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:06:49 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:06:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-10bffa55-54b2-4758-9300-767765d45de7 req-86f61d87-3d68-44f7-b1ba-1a4427708cf1 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Received event network-vif-deleted-0f970626-ca00-4d2c-a588-4d5c703fdad4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:49 user nova-compute[74242]: INFO nova.compute.manager [req-10bffa55-54b2-4758-9300-767765d45de7 req-86f61d87-3d68-44f7-b1ba-1a4427708cf1 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Neutron deleted interface 0f970626-ca00-4d2c-a588-4d5c703fdad4; detaching it from the instance and deleting it from the info cache
Oct 20 02:06:49 user nova-compute[74242]: DEBUG nova.network.neutron [req-10bffa55-54b2-4758-9300-767765d45de7 req-86f61d87-3d68-44f7-b1ba-1a4427708cf1 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:06:49 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Took 0.49 seconds to deallocate network for instance.
Oct 20 02:06:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-10bffa55-54b2-4758-9300-767765d45de7 req-86f61d87-3d68-44f7-b1ba-1a4427708cf1 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Detach interface failed, port_id=0f970626-ca00-4d2c-a588-4d5c703fdad4, reason: Instance 1e23c60d-f373-431e-952e-600b9b5d6ea2 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:06:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-6fd8386f-ec62-4491-8729-67ca9b3775c5 req-9bbfa5c3-b7e3-461a-985a-9ee2cf7238f7 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Received event network-vif-plugged-0f970626-ca00-4d2c-a588-4d5c703fdad4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:06:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6fd8386f-ec62-4491-8729-67ca9b3775c5 req-9bbfa5c3-b7e3-461a-985a-9ee2cf7238f7 service nova] Acquiring lock "1e23c60d-f373-431e-952e-600b9b5d6ea2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6fd8386f-ec62-4491-8729-67ca9b3775c5 req-9bbfa5c3-b7e3-461a-985a-9ee2cf7238f7 service nova] Lock "1e23c60d-f373-431e-952e-600b9b5d6ea2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6fd8386f-ec62-4491-8729-67ca9b3775c5 req-9bbfa5c3-b7e3-461a-985a-9ee2cf7238f7 service nova] Lock "1e23c60d-f373-431e-952e-600b9b5d6ea2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-6fd8386f-ec62-4491-8729-67ca9b3775c5 req-9bbfa5c3-b7e3-461a-985a-9ee2cf7238f7 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] No waiting events found dispatching network-vif-plugged-0f970626-ca00-4d2c-a588-4d5c703fdad4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:06:50 user nova-compute[74242]: WARNING nova.compute.manager [req-6fd8386f-ec62-4491-8729-67ca9b3775c5 req-9bbfa5c3-b7e3-461a-985a-9ee2cf7238f7 service nova] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Received unexpected event network-vif-plugged-0f970626-ca00-4d2c-a588-4d5c703fdad4 for instance with vm_state active and task_state deleting.
Oct 20 02:06:50 user nova-compute[74242]: INFO nova.compute.manager [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Took 1.03 seconds to detach 1 volumes for instance.
Oct 20 02:06:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 1e23c60d-f373-431e-952e-600b9b5d6ea2] Deleting volume: 52b084a0-3032-4c29-846e-066ece9918c7 {{(pid=74242) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 02:06:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:06:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:06:51 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:06:51 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:06:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:51 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Deleted allocations for instance 1e23c60d-f373-431e-952e-600b9b5d6ea2
Oct 20 02:06:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2912f46e-5971-4109-9211-d8882849890c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "1e23c60d-f373-431e-952e-600b9b5d6ea2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.949s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:06:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:06:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:07:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Creating image(s)
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Ensure instance console log exists: /opt/stack/data/nova/instances/5cea10bc-ac5a-48b0-b6b7-7db8f520339d/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Start _get_guest_xml network_info=[{"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '30c9bf4f-b934-49e4-a062-53b8947daed3', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkyiaYHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5cea10bc-ac5a-48b0-b6b7-7db8f520339d', 'attached_at': '', 'detached_at': '', 'volume_id': '6e79478c-34db-431c-86df-ffa42a493f68', 'serial': '6e79478c-34db-431c-86df-ffa42a493f68'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:07:02 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 02:07:02 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.objects.instance [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5cea10bc-ac5a-48b0-b6b7-7db8f520339d {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkyiaYHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:07:02 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:07:02 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:07:02 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f066f47-57ff-4120-85c9-63d850cdd462]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:07:02 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d95eba-4c96-445c-9105-e8c5ccba893e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68] added
Oct 20 02:07:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e617ac5-53dd-4538-9e49-3a64f1eead0d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6782ee95-8a6f-4114-8731-12a6bd615eab]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bkyiaYHc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bkyiaYHc" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f2c2512-fff1-4338-aed3-65da7b138360]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bkyiaYHc'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[520c0158-ce46-4ee1-8529-da92c522f376]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bd7236-efef-4dac-b967-b6ba353404b9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:07:02 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:07:02 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:07:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:07:02 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:07:02 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:07:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0541a874-4ef2-4d2e-a30a-d64ceabcbe8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260]
Oct 20 02:07:02 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260] successful.
Oct 20 02:07:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[75416f34-8722-4d61-a980-254879d672c6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd0af32-8fb1-4aaa-85c6-cc9825bcc3ff]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:07:02 user nova-compute[74242]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:07:02 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:07:02 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:07:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:07:02 user nova-compute[74242]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:07:02 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:07:02 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:07:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79afc6d-f9a8-470e-b7c4-202378e4c7c1]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:07:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkyiaYHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26238343835356461', 'path': '/dev/sde'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238343835356461', 'path': '/dev/sde'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T02:04:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-188573106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1398678858',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByq2xkP/vLfwqbivLj0KOupEkRC+NVhYdkJQ+o9Ygk0jtRSmlqIS+Xl5BP30YNRKfmP8HR4R+7hEidAzKb1ATRlMuwuTOJ2xjm20F8owUQAX54yM4FHVtvIf38i+rcUgw==',key_name='tempest-keypair-522194978',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:04:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='647e5ec77b024268af7209c8a0b73380',ramdisk_id='',reservation_id='r-sntnqamj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-320668090',owner_user_name='tempest-ServerActionsV293TestJSON-320668090-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:06:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67ba274f41b04cbaa4cbfd77948bb7e6',uuid=5cea10bc-ac5a-48b0-b6b7-7db8f520339d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Converting VIF {"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=5fe0eca0-44d0-43d0-acc4-b34fa7126eaf,network=Network(ba22ead9-82b0-4d2e-82d8-851d65f25ab1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe0eca0-44') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:07:03 user nova-compute[74242]:   <uuid>5cea10bc-ac5a-48b0-b6b7-7db8f520339d</uuid>
Oct 20 02:07:03 user nova-compute[74242]:   <name>instance-0000000a</name>
Oct 20 02:07:03 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:07:03 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:07:03 user nova-compute[74242]:   <metadata>
Oct 20 02:07:03 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:07:03 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:07:03 user nova-compute[74242]:       <nova:name>tempest-ServerActionsV293TestJSON-server-188573106</nova:name>
Oct 20 02:07:03 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:07:02</nova:creationTime>
Oct 20 02:07:03 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:07:03 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:07:03 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:07:03 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:07:03 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:07:03 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:07:03 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:07:03 user nova-compute[74242]:       <nova:owner>
Oct 20 02:07:03 user nova-compute[74242]:         <nova:user uuid="67ba274f41b04cbaa4cbfd77948bb7e6">tempest-ServerActionsV293TestJSON-320668090-project-member</nova:user>
Oct 20 02:07:03 user nova-compute[74242]:         <nova:project uuid="647e5ec77b024268af7209c8a0b73380">tempest-ServerActionsV293TestJSON-320668090</nova:project>
Oct 20 02:07:03 user nova-compute[74242]:       </nova:owner>
Oct 20 02:07:03 user nova-compute[74242]:       <nova:ports>
Oct 20 02:07:03 user nova-compute[74242]:         <nova:port uuid="5fe0eca0-44d0-43d0-acc4-b34fa7126eaf">
Oct 20 02:07:03 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 02:07:03 user nova-compute[74242]:         </nova:port>
Oct 20 02:07:03 user nova-compute[74242]:       </nova:ports>
Oct 20 02:07:03 user nova-compute[74242]:     </nova:instance>
Oct 20 02:07:03 user nova-compute[74242]:   </metadata>
Oct 20 02:07:03 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:07:03 user nova-compute[74242]:     <system>
Oct 20 02:07:03 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:07:03 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:07:03 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:07:03 user nova-compute[74242]:       <entry name="serial">5cea10bc-ac5a-48b0-b6b7-7db8f520339d</entry>
Oct 20 02:07:03 user nova-compute[74242]:       <entry name="uuid">5cea10bc-ac5a-48b0-b6b7-7db8f520339d</entry>
Oct 20 02:07:03 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:07:03 user nova-compute[74242]:     </system>
Oct 20 02:07:03 user nova-compute[74242]:   </sysinfo>
Oct 20 02:07:03 user nova-compute[74242]:   <os>
Oct 20 02:07:03 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:07:03 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:07:03 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:07:03 user nova-compute[74242]:   </os>
Oct 20 02:07:03 user nova-compute[74242]:   <features>
Oct 20 02:07:03 user nova-compute[74242]:     <acpi/>
Oct 20 02:07:03 user nova-compute[74242]:     <apic/>
Oct 20 02:07:03 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:07:03 user nova-compute[74242]:   </features>
Oct 20 02:07:03 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:07:03 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:07:03 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:07:03 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:07:03 user nova-compute[74242]:   </clock>
Oct 20 02:07:03 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:07:03 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:07:03 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:07:03 user nova-compute[74242]:   </cpu>
Oct 20 02:07:03 user nova-compute[74242]:   <devices>
Oct 20 02:07:03 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:07:03 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:07:03 user nova-compute[74242]:       <source dev="/dev/sde"/>
Oct 20 02:07:03 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:07:03 user nova-compute[74242]:       <serial>6e79478c-34db-431c-86df-ffa42a493f68</serial>
Oct 20 02:07:03 user nova-compute[74242]:     </disk>
Oct 20 02:07:03 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:07:03 user nova-compute[74242]:       <mac address="fa:16:3e:ac:50:3a"/>
Oct 20 02:07:03 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:07:03 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:07:03 user nova-compute[74242]:       <target dev="tap5fe0eca0-44"/>
Oct 20 02:07:03 user nova-compute[74242]:     </interface>
Oct 20 02:07:03 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:07:03 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/5cea10bc-ac5a-48b0-b6b7-7db8f520339d/console.log" append="off"/>
Oct 20 02:07:03 user nova-compute[74242]:     </serial>
Oct 20 02:07:03 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:07:03 user nova-compute[74242]:     <video>
Oct 20 02:07:03 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:07:03 user nova-compute[74242]:     </video>
Oct 20 02:07:03 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:07:03 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:07:03 user nova-compute[74242]:     </rng>
Oct 20 02:07:03 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:07:03 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:07:03 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:07:03 user nova-compute[74242]:     </memballoon>
Oct 20 02:07:03 user nova-compute[74242]:   </devices>
Oct 20 02:07:03 user nova-compute[74242]: </domain>
Oct 20 02:07:03 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T02:04:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-188573106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1398678858',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByq2xkP/vLfwqbivLj0KOupEkRC+NVhYdkJQ+o9Ygk0jtRSmlqIS+Xl5BP30YNRKfmP8HR4R+7hEidAzKb1ATRlMuwuTOJ2xjm20F8owUQAX54yM4FHVtvIf38i+rcUgw==',key_name='tempest-keypair-522194978',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:04:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='647e5ec77b024268af7209c8a0b73380',ramdisk_id='',reservation_id='r-sntnqamj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-320668090',owner_user_name='tempest-ServerActionsV293TestJSON-320668090-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:06:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67ba274f41b04cbaa4cbfd77948bb7e6',uuid=5cea10bc-ac5a-48b0-b6b7-7db8f520339d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Converting VIF {"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=5fe0eca0-44d0-43d0-acc4-b34fa7126eaf,network=Network(ba22ead9-82b0-4d2e-82d8-851d65f25ab1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe0eca0-44') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG os_vif [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=5fe0eca0-44d0-43d0-acc4-b34fa7126eaf,network=Network(ba22ead9-82b0-4d2e-82d8-851d65f25ab1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe0eca0-44') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d05f2b9-f783-59ec-bff5-83c9c83bad4d', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5fe0eca0-44, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5fe0eca0-44, col_values=(('qos', UUID('c016ad96-2d22-4b7a-b1a9-052f89944c3f')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5fe0eca0-44, col_values=(('external_ids', {'iface-id': '5fe0eca0-44d0-43d0-acc4-b34fa7126eaf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:50:3a', 'vm-uuid': '5cea10bc-ac5a-48b0-b6b7-7db8f520339d'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:03 user nova-compute[74242]: INFO os_vif [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=5fe0eca0-44d0-43d0-acc4-b34fa7126eaf,network=Network(ba22ead9-82b0-4d2e-82d8-851d65f25ab1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe0eca0-44')
Oct 20 02:07:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:07:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] No VIF found with MAC fa:16:3e:ac:50:3a, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:07:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-e4e7883e-3c58-4a04-a479-6b0141841d50 req-a71d00b9-c591-439f-974c-c79a56474fde service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received event network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e4e7883e-3c58-4a04-a479-6b0141841d50 req-a71d00b9-c591-439f-974c-c79a56474fde service nova] Acquiring lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e4e7883e-3c58-4a04-a479-6b0141841d50 req-a71d00b9-c591-439f-974c-c79a56474fde service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e4e7883e-3c58-4a04-a479-6b0141841d50 req-a71d00b9-c591-439f-974c-c79a56474fde service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-e4e7883e-3c58-4a04-a479-6b0141841d50 req-a71d00b9-c591-439f-974c-c79a56474fde service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] No waiting events found dispatching network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:07:05 user nova-compute[74242]: WARNING nova.compute.manager [req-e4e7883e-3c58-4a04-a479-6b0141841d50 req-a71d00b9-c591-439f-974c-c79a56474fde service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received unexpected event network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf for instance with vm_state active and task_state rebuild_spawning.
Oct 20 02:07:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG nova.compute.manager [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:07:07 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Instance spawned successfully.
Oct 20 02:07:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG nova.compute.manager [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-3a865f26-674d-4c01-86b1-57229b2af16e req-df781ca1-23f3-46ff-a17b-1a28cac243ed service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received event network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3a865f26-674d-4c01-86b1-57229b2af16e req-df781ca1-23f3-46ff-a17b-1a28cac243ed service nova] Acquiring lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3a865f26-674d-4c01-86b1-57229b2af16e req-df781ca1-23f3-46ff-a17b-1a28cac243ed service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3a865f26-674d-4c01-86b1-57229b2af16e req-df781ca1-23f3-46ff-a17b-1a28cac243ed service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-3a865f26-674d-4c01-86b1-57229b2af16e req-df781ca1-23f3-46ff-a17b-1a28cac243ed service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] No waiting events found dispatching network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:07:07 user nova-compute[74242]: WARNING nova.compute.manager [req-3a865f26-674d-4c01-86b1-57229b2af16e req-df781ca1-23f3-46ff-a17b-1a28cac243ed service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received unexpected event network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf for instance with vm_state active and task_state rebuild_spawning.
Oct 20 02:07:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:07 user nova-compute[74242]: DEBUG nova.objects.instance [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74242) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 20 02:07:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5d0fc850-9036-4fd3-a244-cb876c354a42 tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.097s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:08 user nova-compute[74242]: INFO nova.compute.manager [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Terminating instance
Oct 20 02:07:08 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:07:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:09 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Instance destroyed successfully.
Oct 20 02:07:09 user nova-compute[74242]: DEBUG nova.objects.instance [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lazy-loading 'resources' on Instance uuid e22cb246-155d-48f5-9eee-bd543c0bbaf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:07:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:03:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1179443261',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1179443261',id=7,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpogir2lL5fxgT+aGdQt1FD0OBJl3IivuczQXbzwg0f71VsW0nMR64AVx2F5qXSCYftEKlBnA8CPoiaBKJjZl9XM4BiISexAmTWuqad0JPqRMC1MStDpdYS3HjZNGmZWg==',key_name='tempest-keypair-808065593',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:03:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28a8e047fa564263971543d6342579b1',ramdisk_id='',reservation_id='r-91z09vmf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-789715889',owner_user_name='tempest-TaggedAttachmentsTest-789715889-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:03:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e81797a2a7a744fa8298b767cf469631',uuid=e22cb246-155d-48f5-9eee-bd543c0bbaf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7575478b-29e4-493e-a04f-0e3747a5c64a", "address": "fa:16:3e:86:90:03", "network": {"id": "bba69f21-fd72-478c-8f16-a8fcd9b41e96", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1592153998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7575478b-29", "ovs_interfaceid": "7575478b-29e4-493e-a04f-0e3747a5c64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:07:09 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Converting VIF {"id": "7575478b-29e4-493e-a04f-0e3747a5c64a", "address": "fa:16:3e:86:90:03", "network": {"id": "bba69f21-fd72-478c-8f16-a8fcd9b41e96", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1592153998-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28a8e047fa564263971543d6342579b1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7575478b-29", "ovs_interfaceid": "7575478b-29e4-493e-a04f-0e3747a5c64a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:07:09 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:86:90:03,bridge_name='br-int',has_traffic_filtering=True,id=7575478b-29e4-493e-a04f-0e3747a5c64a,network=Network(bba69f21-fd72-478c-8f16-a8fcd9b41e96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7575478b-29') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:07:09 user nova-compute[74242]: DEBUG os_vif [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:90:03,bridge_name='br-int',has_traffic_filtering=True,id=7575478b-29e4-493e-a04f-0e3747a5c64a,network=Network(bba69f21-fd72-478c-8f16-a8fcd9b41e96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7575478b-29') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:07:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7575478b-29, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5677534d-628a-45b2-9c0c-167cde3e98d9) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:09 user nova-compute[74242]: INFO os_vif [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:86:90:03,bridge_name='br-int',has_traffic_filtering=True,id=7575478b-29e4-493e-a04f-0e3747a5c64a,network=Network(bba69f21-fd72-478c-8f16-a8fcd9b41e96),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7575478b-29')
Oct 20 02:07:09 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Deleting instance files /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1_del
Oct 20 02:07:09 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Deletion of /opt/stack/data/nova/instances/e22cb246-155d-48f5-9eee-bd543c0bbaf1_del complete
Oct 20 02:07:09 user nova-compute[74242]: INFO nova.compute.manager [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Took 0.96 seconds to destroy the instance on the hypervisor.
Oct 20 02:07:09 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:07:09 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:07:09 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:07:10 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:10 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Took 0.96 seconds to deallocate network for instance.
Oct 20 02:07:10 user nova-compute[74242]: DEBUG nova.compute.manager [req-c4f7ae01-96aa-4ca2-9cd6-55f4ac8df306 req-bada1dfe-5480-453f-bd32-c28f8849d9b0 service nova] [instance: e22cb246-155d-48f5-9eee-bd543c0bbaf1] Received event network-vif-deleted-7575478b-29e4-493e-a04f-0e3747a5c64a {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:10 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:07:10 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:07:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:11 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Deleted allocations for instance e22cb246-155d-48f5-9eee-bd543c0bbaf1
Oct 20 02:07:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e15b6220-93f6-46ae-b324-bca69ee79cbd tempest-TaggedAttachmentsTest-789715889 tempest-TaggedAttachmentsTest-789715889-project-member] Lock "e22cb246-155d-48f5-9eee-bd543c0bbaf1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.646s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:14 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'pci_requests' on Instance uuid 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:07:14 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'numa_topology' on Instance uuid 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:07:14 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:07:14 user nova-compute[74242]: INFO nova.compute.claims [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Claim successful on node user
Oct 20 02:07:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:14 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:07:14 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:07:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.502s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:14 user nova-compute[74242]: INFO nova.network.neutron [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updating port daaa523c-866b-4afd-9e64-cd87cb820350 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 02:07:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:07:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquired lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:07:16 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:07:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-78ea59f2-5d7c-4285-96f5-54fcb3f64e57 req-56b738c5-2a9f-404f-82d9-ee3c71193377 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-changed-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-78ea59f2-5d7c-4285-96f5-54fcb3f64e57 req-56b738c5-2a9f-404f-82d9-ee3c71193377 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Refreshing instance network info cache due to event network-changed-daaa523c-866b-4afd-9e64-cd87cb820350. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:07:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-78ea59f2-5d7c-4285-96f5-54fcb3f64e57 req-56b738c5-2a9f-404f-82d9-ee3c71193377 service nova] Acquiring lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:07:17 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updating instance_info_cache with network_info: [{"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Releasing lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:07:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:07:17 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Creating image(s)
Oct 20 02:07:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "/opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "/opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "/opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:17 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'trusted_certs' on Instance uuid 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:07:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-78ea59f2-5d7c-4285-96f5-54fcb3f64e57 req-56b738c5-2a9f-404f-82d9-ee3c71193377 service nova] Acquired lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:07:17 user nova-compute[74242]: DEBUG nova.network.neutron [req-78ea59f2-5d7c-4285-96f5-54fcb3f64e57 req-56b738c5-2a9f-404f-82d9-ee3c71193377 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Refreshing network info cache for port daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:07:17 user nova-compute[74242]: DEBUG nova.objects.base [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Object Instance<90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:07:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "a8fb73c1717975941a7f1b33af14be6461efceb3" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "a8fb73c1717975941a7f1b33af14be6461efceb3" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3.part --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3.part --force-share --output=json" returned: 0 in 0.200s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:18 user nova-compute[74242]: DEBUG nova.virt.images [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] 1c6c8df7-4a35-476d-86a1-7cd5b38e82fc was qcow2, converting to raw {{(pid=74242) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 02:07:18 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:07:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3.part /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3.converted {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:19 user nova-compute[74242]: DEBUG nova.network.neutron [req-78ea59f2-5d7c-4285-96f5-54fcb3f64e57 req-56b738c5-2a9f-404f-82d9-ee3c71193377 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updated VIF entry in instance network info cache for port daaa523c-866b-4afd-9e64-cd87cb820350. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:07:19 user nova-compute[74242]: DEBUG nova.network.neutron [req-78ea59f2-5d7c-4285-96f5-54fcb3f64e57 req-56b738c5-2a9f-404f-82d9-ee3c71193377 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updating instance_info_cache with network_info: [{"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-78ea59f2-5d7c-4285-96f5-54fcb3f64e57 req-56b738c5-2a9f-404f-82d9-ee3c71193377 service nova] Releasing lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:07:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3.part /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3.converted" returned: 0 in 0.773s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3.converted --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3.converted --force-share --output=json" returned: 0 in 0.264s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "a8fb73c1717975941a7f1b33af14be6461efceb3" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.568s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3 --force-share --output=json" returned: 0 in 0.241s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "a8fb73c1717975941a7f1b33af14be6461efceb3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "a8fb73c1717975941a7f1b33af14be6461efceb3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3 --force-share --output=json" returned: 0 in 0.227s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3,backing_fmt=raw /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3,backing_fmt=raw /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk 1073741824" returned: 0 in 0.064s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "a8fb73c1717975941a7f1b33af14be6461efceb3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3 --force-share --output=json" returned: 0 in 0.214s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:20 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'migration_context' on Instance uuid 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:07:20 user nova-compute[74242]: DEBUG nova.objects.base [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Object Instance<90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:07:20 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Rebasing disk image.
Oct 20 02:07:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.264s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 -F raw /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 -F raw /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk" returned: 0 in 2.946s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Ensure instance console log exists: /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Start _get_guest_xml network_info=[{"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='f998db302c0aea46b9af65a556658492',container_format='bare',created_at=2023-10-20T02:04:30Z,direct_url=<?>,disk_format='qcow2',id=1c6c8df7-4a35-476d-86a1-7cd5b38e82fc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-566546331-shelved',owner='a7a2695b5ad341e0afd133522f680bf9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T02:04:36Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'attachment_id': '7a99e7dc-62ea-4070-919d-712d9d7106ec', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVBGliZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36', 'attached_at': '', 'detached_at': '', 'volume_id': '069f2fdc-94b6-4546-8e3e-58bc608d7ba3', 'serial': '069f2fdc-94b6-4546-8e3e-58bc608d7ba3'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:07:23 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:07:23 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f998db302c0aea46b9af65a556658492',container_format='bare',created_at=2023-10-20T02:04:30Z,direct_url=<?>,disk_format='qcow2',id=1c6c8df7-4a35-476d-86a1-7cd5b38e82fc,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-566546331-shelved',owner='a7a2695b5ad341e0afd133522f680bf9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T02:04:36Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'vcpu_model' on Instance uuid 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.objects.base [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Object Instance<90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVBGliZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:07:23 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:07:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:07:23 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:07:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:07:23 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:07:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260" returned: 21 in 0.051s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0de2845-fdce-4e18-a598-bf936e27134d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:07:23 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a76b32e2-b445-4d72-bb40-7812992f9fe7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3] added
Oct 20 02:07:24 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.093s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b538403-afff-430a-a753-d4ee1440da9f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.122s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f95e32-55c6-404b-92a1-73dde0aaa7dd]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVBGliZf {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pVBGliZf" returned: 0 in 0.075s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[de2e336d-8794-4709-b355-699187b283cc]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pVBGliZf'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb74bcc-1a56-44bb-97ba-b390c79f0e50]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3029d4b-d041-4b40-a156-7c6647c6b6f5]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:07:24 user nova-compute[74242]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:07:24 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:07:24 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:07:24 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:07:24 user nova-compute[74242]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:07:24 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:07:24 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:07:24 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:07:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --login" returned: 0 in 1.078s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[926286a9-ada1-47d7-88fd-038553232816]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3, portal: 172.16.0.220,3260]
Oct 20 02:07:25 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3, portal: 172.16.0.220,3260] successful.
Oct 20 02:07:25 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b9ce4e-c821-4a60-9a02-19fdcff8f06c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9d9f37-06a8-4c1d-a350-da1a1bf8cac4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:07:25 user nova-compute[74242]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:07:25 user nova-compute[74242]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:07:25 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:07:25 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:07:25 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:07:25 user nova-compute[74242]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:07:25 user nova-compute[74242]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:07:25 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:07:25 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:07:25 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.810s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.041s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6cb6f9-6f90-4e43-b673-282444b5a7ee]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:07:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVBGliZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.877s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] <== connect_volume: return (2879ms) {'type': 'block', 'scsi_wwn': '23661643363373535', 'path': '/dev/sdf'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23661643363373535', 'path': '/dev/sdf'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T02:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-566546331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-566546331',id=2,image_ref='1c6c8df7-4a35-476d-86a1-7cd5b38e82fc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-869078676',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:02:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a7a2695b5ad341e0afd133522f680bf9',ramdisk_id='',reservation_id='r-0l3toedx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-750275147',owner_user_name='tempest-AttachVolumeShelveTestJSON-750275147-project-member',shelved_at='2023-10-20T02:04:36.096598',shelved_host='user',shelved_image_id='1c6c8df7-4a35-476d-86a1-7cd5b38e82fc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:06:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d6645596e24f24a216d2b4e7809073',uuid=90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converting VIF {"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=daaa523c-866b-4afd-9e64-cd87cb820350,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaaa523c-86') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'pci_devices' on Instance uuid 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG nova.objects.base [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Object Instance<90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:07:26 user nova-compute[74242]:   <uuid>90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36</uuid>
Oct 20 02:07:26 user nova-compute[74242]:   <name>instance-00000002</name>
Oct 20 02:07:26 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:07:26 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:07:26 user nova-compute[74242]:   <metadata>
Oct 20 02:07:26 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:07:26 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:07:26 user nova-compute[74242]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-566546331</nova:name>
Oct 20 02:07:26 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:07:23</nova:creationTime>
Oct 20 02:07:26 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:07:26 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:07:26 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:07:26 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:07:26 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:07:26 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:07:26 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:07:26 user nova-compute[74242]:       <nova:owner>
Oct 20 02:07:26 user nova-compute[74242]:         <nova:user uuid="a3d6645596e24f24a216d2b4e7809073">tempest-AttachVolumeShelveTestJSON-750275147-project-member</nova:user>
Oct 20 02:07:26 user nova-compute[74242]:         <nova:project uuid="a7a2695b5ad341e0afd133522f680bf9">tempest-AttachVolumeShelveTestJSON-750275147</nova:project>
Oct 20 02:07:26 user nova-compute[74242]:       </nova:owner>
Oct 20 02:07:26 user nova-compute[74242]:       <nova:root type="image" uuid="1c6c8df7-4a35-476d-86a1-7cd5b38e82fc"/>
Oct 20 02:07:26 user nova-compute[74242]:       <nova:ports>
Oct 20 02:07:26 user nova-compute[74242]:         <nova:port uuid="daaa523c-866b-4afd-9e64-cd87cb820350">
Oct 20 02:07:26 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 02:07:26 user nova-compute[74242]:         </nova:port>
Oct 20 02:07:26 user nova-compute[74242]:       </nova:ports>
Oct 20 02:07:26 user nova-compute[74242]:     </nova:instance>
Oct 20 02:07:26 user nova-compute[74242]:   </metadata>
Oct 20 02:07:26 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:07:26 user nova-compute[74242]:     <system>
Oct 20 02:07:26 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:07:26 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:07:26 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:07:26 user nova-compute[74242]:       <entry name="serial">90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36</entry>
Oct 20 02:07:26 user nova-compute[74242]:       <entry name="uuid">90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36</entry>
Oct 20 02:07:26 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:07:26 user nova-compute[74242]:     </system>
Oct 20 02:07:26 user nova-compute[74242]:   </sysinfo>
Oct 20 02:07:26 user nova-compute[74242]:   <os>
Oct 20 02:07:26 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:07:26 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:07:26 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:07:26 user nova-compute[74242]:   </os>
Oct 20 02:07:26 user nova-compute[74242]:   <features>
Oct 20 02:07:26 user nova-compute[74242]:     <acpi/>
Oct 20 02:07:26 user nova-compute[74242]:     <apic/>
Oct 20 02:07:26 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:07:26 user nova-compute[74242]:   </features>
Oct 20 02:07:26 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:07:26 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:07:26 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:07:26 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:07:26 user nova-compute[74242]:   </clock>
Oct 20 02:07:26 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:07:26 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:07:26 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:07:26 user nova-compute[74242]:   </cpu>
Oct 20 02:07:26 user nova-compute[74242]:   <devices>
Oct 20 02:07:26 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:07:26 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:07:26 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk"/>
Oct 20 02:07:26 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:07:26 user nova-compute[74242]:     </disk>
Oct 20 02:07:26 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:07:26 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:07:26 user nova-compute[74242]:       <source dev="/dev/sdf"/>
Oct 20 02:07:26 user nova-compute[74242]:       <target dev="vdc" bus="virtio"/>
Oct 20 02:07:26 user nova-compute[74242]:       <serial>069f2fdc-94b6-4546-8e3e-58bc608d7ba3</serial>
Oct 20 02:07:26 user nova-compute[74242]:     </disk>
Oct 20 02:07:26 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:07:26 user nova-compute[74242]:       <mac address="fa:16:3e:0b:d9:3e"/>
Oct 20 02:07:26 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:07:26 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:07:26 user nova-compute[74242]:       <target dev="tapdaaa523c-86"/>
Oct 20 02:07:26 user nova-compute[74242]:     </interface>
Oct 20 02:07:26 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:07:26 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/console.log" append="off"/>
Oct 20 02:07:26 user nova-compute[74242]:     </serial>
Oct 20 02:07:26 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:07:26 user nova-compute[74242]:     <video>
Oct 20 02:07:26 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:07:26 user nova-compute[74242]:     </video>
Oct 20 02:07:26 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:07:26 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:07:26 user nova-compute[74242]:     </rng>
Oct 20 02:07:26 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:07:26 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:07:26 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:07:26 user nova-compute[74242]:     </memballoon>
Oct 20 02:07:26 user nova-compute[74242]:   </devices>
Oct 20 02:07:26 user nova-compute[74242]: </domain>
Oct 20 02:07:26 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T02:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-566546331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-566546331',id=2,image_ref='1c6c8df7-4a35-476d-86a1-7cd5b38e82fc',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-869078676',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:02:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a7a2695b5ad341e0afd133522f680bf9',ramdisk_id='',reservation_id='r-0l3toedx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-750275147',owner_user_name='tempest-AttachVolumeShelveTestJSON-750275147-project-member',shelved_at='2023-10-20T02:04:36.096598',shelved_host='user',shelved_image_id='1c6c8df7-4a35-476d-86a1-7cd5b38e82fc'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:06:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d6645596e24f24a216d2b4e7809073',uuid=90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converting VIF {"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=daaa523c-866b-4afd-9e64-cd87cb820350,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaaa523c-86') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG os_vif [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=daaa523c-866b-4afd-9e64-cd87cb820350,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaaa523c-86') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab94ebc7-4152-5d54-9c79-ddea077da419', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdaaa523c-86, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdaaa523c-86, col_values=(('qos', UUID('6b7edb92-81f6-46f1-85c3-9b0600a20744')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdaaa523c-86, col_values=(('external_ids', {'iface-id': 'daaa523c-866b-4afd-9e64-cd87cb820350', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:d9:3e', 'vm-uuid': '90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:07:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:26 user nova-compute[74242]: INFO os_vif [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=daaa523c-866b-4afd-9e64-cd87cb820350,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaaa523c-86')
Oct 20 02:07:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:07:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:07:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] No VIF found with MAC fa:16:3e:0b:d9:3e, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:07:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-9472c4a6-0f25-4020-ad5a-5b3b9851b66e req-1f83c090-6299-4ec9-b302-2086cda31fe8 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9472c4a6-0f25-4020-ad5a-5b3b9851b66e req-1f83c090-6299-4ec9-b302-2086cda31fe8 service nova] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9472c4a6-0f25-4020-ad5a-5b3b9851b66e req-1f83c090-6299-4ec9-b302-2086cda31fe8 service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9472c4a6-0f25-4020-ad5a-5b3b9851b66e req-1f83c090-6299-4ec9-b302-2086cda31fe8 service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-9472c4a6-0f25-4020-ad5a-5b3b9851b66e req-1f83c090-6299-4ec9-b302-2086cda31fe8 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] No waiting events found dispatching network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:07:28 user nova-compute[74242]: WARNING nova.compute.manager [req-9472c4a6-0f25-4020-ad5a-5b3b9851b66e req-1f83c090-6299-4ec9-b302-2086cda31fe8 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received unexpected event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 02:07:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:29 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:07:29 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:07:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:07:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:07:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-af9f3d52-79f0-4ce0-9b14-3373b30c2b26" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:07:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-af9f3d52-79f0-4ce0-9b14-3373b30c2b26" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:07:29 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:07:29 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid af9f3d52-79f0-4ce0-9b14-3373b30c2b26 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Updating instance_info_cache with network_info: [{"id": "b98a0d98-dfbf-4307-a04b-23d585652343", "address": "fa:16:3e:83:01:9b", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a0d98-df", "ovs_interfaceid": "b98a0d98-dfbf-4307-a04b-23d585652343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-af9f3d52-79f0-4ce0-9b14-3373b30c2b26" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-41c9eae8-fd9d-4590-b50c-c8eca865c3a8 req-f2fdbd6b-c030-4b1a-a499-19430cf9a6aa service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-41c9eae8-fd9d-4590-b50c-c8eca865c3a8 req-f2fdbd6b-c030-4b1a-a499-19430cf9a6aa service nova] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-41c9eae8-fd9d-4590-b50c-c8eca865c3a8 req-f2fdbd6b-c030-4b1a-a499-19430cf9a6aa service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-41c9eae8-fd9d-4590-b50c-c8eca865c3a8 req-f2fdbd6b-c030-4b1a-a499-19430cf9a6aa service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-41c9eae8-fd9d-4590-b50c-c8eca865c3a8 req-f2fdbd6b-c030-4b1a-a499-19430cf9a6aa service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] No waiting events found dispatching network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:07:30 user nova-compute[74242]: WARNING nova.compute.manager [req-41c9eae8-fd9d-4590-b50c-c8eca865c3a8 req-f2fdbd6b-c030-4b1a-a499-19430cf9a6aa service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received unexpected event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 02:07:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:07:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:07:31 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Instance spawned successfully.
Oct 20 02:07:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:07:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:07:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8f879f74-b603-41d1-a2f2-1077e6d47ecb tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 68.734s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:07:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:07:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:07:32 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:07:32 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:07:32 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8021MB free_disk=25.386219024658203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:07:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance af9f3d52-79f0-4ce0-9b14-3373b30c2b26 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 5cea10bc-ac5a-48b0-b6b7-7db8f520339d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance a77f802c-7ee6-4596-ac65-221e2a6bb533 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c909c918-59a9-42fe-99fe-72431ba43443 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.645s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:07:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:34 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:07:34 user nova-compute[74242]: INFO nova.compute.claims [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Claim successful on node user
Oct 20 02:07:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:34 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:07:34 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:07:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:07:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:07:34 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:07:34 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:07:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:07:34 user nova-compute[74242]: INFO nova.virt.block_device [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Booting with volume bbb8694b-1d43-40e0-bacf-3b6217a16f5d at /dev/vda
Oct 20 02:07:34 user nova-compute[74242]: DEBUG nova.policy [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a1d648d2ff70456aaaa6f6cbeec5c565', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62401f86776f46bdba398c876de8a575', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG os_brick.utils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c5c232-5f85-4339-8df9-46fb50aaa719]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b564d143-92a2-4395-96e5-773f03926be1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2279c334-588d-417a-adc2-81ff2a5e2305]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[23412a26-046c-4b7c-b726-323cdd8224da]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:07:35 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:07:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af01066-4919-4c9e-ada6-716e536ab2e9]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG os_brick.utils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] <== get_connector_properties: return (167ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updating existing volume attachment record: bff419ea-afec-4fc0-99e8-2045bf67b6b9 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:35 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Successfully created port: a1593d20-a266-4958-ba9d-6f03899e6195 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:07:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Successfully created port: 4025d0ae-da49-4ae1-93ca-5fb17863f713 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:07:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Successfully created port: d69d4eef-6af5-4d1d-8e7e-49a60dc36111 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:07:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:38 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Successfully created port: a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:07:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:39 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Successfully created port: a3751e3f-044b-44fc-94ab-9e54484b46cc {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:07:40 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Successfully updated port: a1593d20-a266-4958-ba9d-6f03899e6195 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:07:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-ce033ace-4fcf-4648-998f-74ed17dae322 req-fb75cf84-37a0-42b5-93e0-e928c92e7250 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-changed-a1593d20-a266-4958-ba9d-6f03899e6195 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-ce033ace-4fcf-4648-998f-74ed17dae322 req-fb75cf84-37a0-42b5-93e0-e928c92e7250 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing instance network info cache due to event network-changed-a1593d20-a266-4958-ba9d-6f03899e6195. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:07:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ce033ace-4fcf-4648-998f-74ed17dae322 req-fb75cf84-37a0-42b5-93e0-e928c92e7250 service nova] Acquiring lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:07:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ce033ace-4fcf-4648-998f-74ed17dae322 req-fb75cf84-37a0-42b5-93e0-e928c92e7250 service nova] Acquired lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:07:40 user nova-compute[74242]: DEBUG nova.network.neutron [req-ce033ace-4fcf-4648-998f-74ed17dae322 req-fb75cf84-37a0-42b5-93e0-e928c92e7250 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing network info cache for port a1593d20-a266-4958-ba9d-6f03899e6195 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:07:40 user nova-compute[74242]: DEBUG nova.network.neutron [req-ce033ace-4fcf-4648-998f-74ed17dae322 req-fb75cf84-37a0-42b5-93e0-e928c92e7250 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:07:41 user nova-compute[74242]: DEBUG nova.network.neutron [req-ce033ace-4fcf-4648-998f-74ed17dae322 req-fb75cf84-37a0-42b5-93e0-e928c92e7250 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ce033ace-4fcf-4648-998f-74ed17dae322 req-fb75cf84-37a0-42b5-93e0-e928c92e7250 service nova] Releasing lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:07:41 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Successfully updated port: 17f0118a-3e44-4d76-b03a-b06790728aec {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:07:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "7e101002-a175-40fe-b5ca-04a58610f60d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "7e101002-a175-40fe-b5ca-04a58610f60d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:41 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:07:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:41 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:07:41 user nova-compute[74242]: INFO nova.compute.claims [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Claim successful on node user
Oct 20 02:07:42 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.455s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:07:42 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:07:42 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Successfully updated port: 0a777aac-0d50-4036-823d-017f94a044b1 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG nova.policy [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5770dbda6dd84c99ada813b97a477f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c5bff2faf14b7887d0fa959c6e91ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:07:42 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Creating image(s)
Oct 20 02:07:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "/opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "/opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-changed-17f0118a-3e44-4d76-b03a-b06790728aec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing instance network info cache due to event network-changed-17f0118a-3e44-4d76-b03a-b06790728aec. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] Acquiring lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] Acquired lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG nova.network.neutron [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing network info cache for port 17f0118a-3e44-4d76-b03a-b06790728aec {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG nova.network.neutron [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.206s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG nova.network.neutron [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.235s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] Releasing lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG nova.compute.manager [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-changed-0a777aac-0d50-4036-823d-017f94a044b1 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG nova.compute.manager [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing instance network info cache due to event network-changed-0a777aac-0d50-4036-823d-017f94a044b1. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] Acquiring lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] Acquired lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG nova.network.neutron [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing network info cache for port 0a777aac-0d50-4036-823d-017f94a044b1 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk 1073741824" returned: 0 in 0.087s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG nova.network.neutron [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.197s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG nova.network.neutron [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-eaf5e863-1848-48af-b242-15191245e6e6 req-30ee2154-b9c7-42a5-8299-079e8acfa81b service nova] Releasing lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Cannot resize image /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Ensure instance console log exists: /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Successfully created port: 4f154d45-5d20-4df0-bb42-5977772a98c4 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:07:43 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Successfully updated port: 4025d0ae-da49-4ae1-93ca-5fb17863f713 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquiring lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:07:44 user nova-compute[74242]: INFO nova.compute.claims [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Claim successful on node user
Oct 20 02:07:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-35f929ad-d289-430f-ad1e-c65e4540edb8 req-0e3555e4-0340-4ac2-8da9-f1c8781df4c7 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-changed-4025d0ae-da49-4ae1-93ca-5fb17863f713 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-35f929ad-d289-430f-ad1e-c65e4540edb8 req-0e3555e4-0340-4ac2-8da9-f1c8781df4c7 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing instance network info cache due to event network-changed-4025d0ae-da49-4ae1-93ca-5fb17863f713. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-35f929ad-d289-430f-ad1e-c65e4540edb8 req-0e3555e4-0340-4ac2-8da9-f1c8781df4c7 service nova] Acquiring lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-35f929ad-d289-430f-ad1e-c65e4540edb8 req-0e3555e4-0340-4ac2-8da9-f1c8781df4c7 service nova] Acquired lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG nova.network.neutron [req-35f929ad-d289-430f-ad1e-c65e4540edb8 req-0e3555e4-0340-4ac2-8da9-f1c8781df4c7 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing network info cache for port 4025d0ae-da49-4ae1-93ca-5fb17863f713 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG nova.network.neutron [req-35f929ad-d289-430f-ad1e-c65e4540edb8 req-0e3555e4-0340-4ac2-8da9-f1c8781df4c7 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG nova.compute.manager [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG nova.network.neutron [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:07:45 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:07:45 user nova-compute[74242]: DEBUG nova.compute.manager [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG nova.network.neutron [req-35f929ad-d289-430f-ad1e-c65e4540edb8 req-0e3555e4-0340-4ac2-8da9-f1c8781df4c7 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG nova.policy [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce225357cc264fc98967e471723bd062', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '589aa4f746cf410cba8fd345ed6f830f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-35f929ad-d289-430f-ad1e-c65e4540edb8 req-0e3555e4-0340-4ac2-8da9-f1c8781df4c7 service nova] Releasing lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG nova.compute.manager [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:07:45 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Creating image(s)
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquiring lock "/opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "/opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "/opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.204s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Successfully updated port: 4f154d45-5d20-4df0-bb42-5977772a98c4 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Successfully updated port: d69d4eef-6af5-4d1d-8e7e-49a60dc36111 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "refresh_cache-7e101002-a175-40fe-b5ca-04a58610f60d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquired lock "refresh_cache-7e101002-a175-40fe-b5ca-04a58610f60d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.224s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk 1073741824" returned: 0 in 0.057s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:45 user nova-compute[74242]: DEBUG nova.network.neutron [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Successfully created port: 853cfa70-26ff-4bd6-ab16-8f13128cee00 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.198s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Checking if we can resize image /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Cannot resize image /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Ensure instance console log exists: /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Updating instance_info_cache with network_info: [{"id": "4f154d45-5d20-4df0-bb42-5977772a98c4", "address": "fa:16:3e:72:d7:10", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f154d45-5d", "ovs_interfaceid": "4f154d45-5d20-4df0-bb42-5977772a98c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Releasing lock "refresh_cache-7e101002-a175-40fe-b5ca-04a58610f60d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Instance network_info: |[{"id": "4f154d45-5d20-4df0-bb42-5977772a98c4", "address": "fa:16:3e:72:d7:10", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f154d45-5d", "ovs_interfaceid": "4f154d45-5d20-4df0-bb42-5977772a98c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Start _get_guest_xml network_info=[{"id": "4f154d45-5d20-4df0-bb42-5977772a98c4", "address": "fa:16:3e:72:d7:10", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f154d45-5d", "ovs_interfaceid": "4f154d45-5d20-4df0-bb42-5977772a98c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:07:46 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:07:46 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1239626496',display_name='tempest-VolumesAdminNegativeTest-server-1239626496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1239626496',id=15,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGvhfoDRrK1BvTrWtEDoX3vJSABvTjZwKKBLIjGFj1+h82G4MnBbBJp+Hl1unm+kewyEi+fjbEGNA4rzeG8nR0aWFbZSe9NsmTf1yEvetOOwHVu+vYk4cwUGfHrRcAuDw==',key_name='tempest-keypair-314473153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3c5bff2faf14b7887d0fa959c6e91ab',ramdisk_id='',reservation_id='r-kzdkf9tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1678070801',owner_user_name='tempest-VolumesAdminNegativeTest-1678070801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5770dbda6dd84c99ada813b97a477f8a',uuid=7e101002-a175-40fe-b5ca-04a58610f60d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f154d45-5d20-4df0-bb42-5977772a98c4", "address": "fa:16:3e:72:d7:10", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f154d45-5d", "ovs_interfaceid": "4f154d45-5d20-4df0-bb42-5977772a98c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Converting VIF {"id": "4f154d45-5d20-4df0-bb42-5977772a98c4", "address": "fa:16:3e:72:d7:10", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f154d45-5d", "ovs_interfaceid": "4f154d45-5d20-4df0-bb42-5977772a98c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:d7:10,bridge_name='br-int',has_traffic_filtering=True,id=4f154d45-5d20-4df0-bb42-5977772a98c4,network=Network(a476089f-e2c5-41a8-8c01-0bfd9c9e280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f154d45-5d') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e101002-a175-40fe-b5ca-04a58610f60d {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:07:46 user nova-compute[74242]:   <uuid>7e101002-a175-40fe-b5ca-04a58610f60d</uuid>
Oct 20 02:07:46 user nova-compute[74242]:   <name>instance-0000000f</name>
Oct 20 02:07:46 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:07:46 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:07:46 user nova-compute[74242]:   <metadata>
Oct 20 02:07:46 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:07:46 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:07:46 user nova-compute[74242]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1239626496</nova:name>
Oct 20 02:07:46 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:07:46</nova:creationTime>
Oct 20 02:07:46 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:07:46 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:07:46 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:07:46 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:07:46 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:07:46 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:07:46 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:07:46 user nova-compute[74242]:       <nova:owner>
Oct 20 02:07:46 user nova-compute[74242]:         <nova:user uuid="5770dbda6dd84c99ada813b97a477f8a">tempest-VolumesAdminNegativeTest-1678070801-project-member</nova:user>
Oct 20 02:07:46 user nova-compute[74242]:         <nova:project uuid="e3c5bff2faf14b7887d0fa959c6e91ab">tempest-VolumesAdminNegativeTest-1678070801</nova:project>
Oct 20 02:07:46 user nova-compute[74242]:       </nova:owner>
Oct 20 02:07:46 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:07:46 user nova-compute[74242]:       <nova:ports>
Oct 20 02:07:46 user nova-compute[74242]:         <nova:port uuid="4f154d45-5d20-4df0-bb42-5977772a98c4">
Oct 20 02:07:46 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 02:07:46 user nova-compute[74242]:         </nova:port>
Oct 20 02:07:46 user nova-compute[74242]:       </nova:ports>
Oct 20 02:07:46 user nova-compute[74242]:     </nova:instance>
Oct 20 02:07:46 user nova-compute[74242]:   </metadata>
Oct 20 02:07:46 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:07:46 user nova-compute[74242]:     <system>
Oct 20 02:07:46 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:07:46 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:07:46 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:07:46 user nova-compute[74242]:       <entry name="serial">7e101002-a175-40fe-b5ca-04a58610f60d</entry>
Oct 20 02:07:46 user nova-compute[74242]:       <entry name="uuid">7e101002-a175-40fe-b5ca-04a58610f60d</entry>
Oct 20 02:07:46 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:07:46 user nova-compute[74242]:     </system>
Oct 20 02:07:46 user nova-compute[74242]:   </sysinfo>
Oct 20 02:07:46 user nova-compute[74242]:   <os>
Oct 20 02:07:46 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:07:46 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:07:46 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:07:46 user nova-compute[74242]:   </os>
Oct 20 02:07:46 user nova-compute[74242]:   <features>
Oct 20 02:07:46 user nova-compute[74242]:     <acpi/>
Oct 20 02:07:46 user nova-compute[74242]:     <apic/>
Oct 20 02:07:46 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:07:46 user nova-compute[74242]:   </features>
Oct 20 02:07:46 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:07:46 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:07:46 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:07:46 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:07:46 user nova-compute[74242]:   </clock>
Oct 20 02:07:46 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:07:46 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:07:46 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:07:46 user nova-compute[74242]:   </cpu>
Oct 20 02:07:46 user nova-compute[74242]:   <devices>
Oct 20 02:07:46 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:07:46 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:07:46 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk"/>
Oct 20 02:07:46 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:07:46 user nova-compute[74242]:     </disk>
Oct 20 02:07:46 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:07:46 user nova-compute[74242]:       <mac address="fa:16:3e:72:d7:10"/>
Oct 20 02:07:46 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:07:46 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:07:46 user nova-compute[74242]:       <target dev="tap4f154d45-5d"/>
Oct 20 02:07:46 user nova-compute[74242]:     </interface>
Oct 20 02:07:46 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:07:46 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/console.log" append="off"/>
Oct 20 02:07:46 user nova-compute[74242]:     </serial>
Oct 20 02:07:46 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:07:46 user nova-compute[74242]:     <video>
Oct 20 02:07:46 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:07:46 user nova-compute[74242]:     </video>
Oct 20 02:07:46 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:07:46 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:07:46 user nova-compute[74242]:     </rng>
Oct 20 02:07:46 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:07:46 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:07:46 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:07:46 user nova-compute[74242]:     </memballoon>
Oct 20 02:07:46 user nova-compute[74242]:   </devices>
Oct 20 02:07:46 user nova-compute[74242]: </domain>
Oct 20 02:07:46 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1239626496',display_name='tempest-VolumesAdminNegativeTest-server-1239626496',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1239626496',id=15,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGvhfoDRrK1BvTrWtEDoX3vJSABvTjZwKKBLIjGFj1+h82G4MnBbBJp+Hl1unm+kewyEi+fjbEGNA4rzeG8nR0aWFbZSe9NsmTf1yEvetOOwHVu+vYk4cwUGfHrRcAuDw==',key_name='tempest-keypair-314473153',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3c5bff2faf14b7887d0fa959c6e91ab',ramdisk_id='',reservation_id='r-kzdkf9tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1678070801',owner_user_name='tempest-VolumesAdminNegativeTest-1678070801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5770dbda6dd84c99ada813b97a477f8a',uuid=7e101002-a175-40fe-b5ca-04a58610f60d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4f154d45-5d20-4df0-bb42-5977772a98c4", "address": "fa:16:3e:72:d7:10", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f154d45-5d", "ovs_interfaceid": "4f154d45-5d20-4df0-bb42-5977772a98c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Converting VIF {"id": "4f154d45-5d20-4df0-bb42-5977772a98c4", "address": "fa:16:3e:72:d7:10", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f154d45-5d", "ovs_interfaceid": "4f154d45-5d20-4df0-bb42-5977772a98c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:d7:10,bridge_name='br-int',has_traffic_filtering=True,id=4f154d45-5d20-4df0-bb42-5977772a98c4,network=Network(a476089f-e2c5-41a8-8c01-0bfd9c9e280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f154d45-5d') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG os_vif [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:d7:10,bridge_name='br-int',has_traffic_filtering=True,id=4f154d45-5d20-4df0-bb42-5977772a98c4,network=Network(a476089f-e2c5-41a8-8c01-0bfd9c9e280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f154d45-5d') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4852ca12-2f15-5c2d-927c-c02075512ae3', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4f154d45-5d, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4f154d45-5d, col_values=(('qos', UUID('48e16996-770f-472b-8acc-f2a818086c09')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4f154d45-5d, col_values=(('external_ids', {'iface-id': '4f154d45-5d20-4df0-bb42-5977772a98c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:d7:10', 'vm-uuid': '7e101002-a175-40fe-b5ca-04a58610f60d'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:46 user nova-compute[74242]: INFO os_vif [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:d7:10,bridge_name='br-int',has_traffic_filtering=True,id=4f154d45-5d20-4df0-bb42-5977772a98c4,network=Network(a476089f-e2c5-41a8-8c01-0bfd9c9e280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f154d45-5d')
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] No VIF found with MAC fa:16:3e:72:d7:10, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Received event network-changed-4f154d45-5d20-4df0-bb42-5977772a98c4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Refreshing instance network info cache due to event network-changed-4f154d45-5d20-4df0-bb42-5977772a98c4. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] Acquiring lock "refresh_cache-7e101002-a175-40fe-b5ca-04a58610f60d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] Acquired lock "refresh_cache-7e101002-a175-40fe-b5ca-04a58610f60d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.network.neutron [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Refreshing network info cache for port 4f154d45-5d20-4df0-bb42-5977772a98c4 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:07:46 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Successfully updated port: a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Successfully updated port: 853cfa70-26ff-4bd6-ab16-8f13128cee00 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquiring lock "refresh_cache-72003d17-9292-4bdd-acfc-0d3f7e40df80" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquired lock "refresh_cache-72003d17-9292-4bdd-acfc-0d3f7e40df80" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-06f23417-86f7-4f47-8e45-d9946d8f17ce req-7b938789-da61-4750-ac3c-755265ebd8ef service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Received event network-changed-853cfa70-26ff-4bd6-ab16-8f13128cee00 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-06f23417-86f7-4f47-8e45-d9946d8f17ce req-7b938789-da61-4750-ac3c-755265ebd8ef service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Refreshing instance network info cache due to event network-changed-853cfa70-26ff-4bd6-ab16-8f13128cee00. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-06f23417-86f7-4f47-8e45-d9946d8f17ce req-7b938789-da61-4750-ac3c-755265ebd8ef service nova] Acquiring lock "refresh_cache-72003d17-9292-4bdd-acfc-0d3f7e40df80" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Updating instance_info_cache with network_info: [{"id": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "address": "fa:16:3e:53:fc:43", "network": {"id": "35a08d69-02ac-4f3a-8a8c-6a8b41c2679a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2043622955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "589aa4f746cf410cba8fd345ed6f830f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853cfa70-26", "ovs_interfaceid": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Releasing lock "refresh_cache-72003d17-9292-4bdd-acfc-0d3f7e40df80" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Instance network_info: |[{"id": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "address": "fa:16:3e:53:fc:43", "network": {"id": "35a08d69-02ac-4f3a-8a8c-6a8b41c2679a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2043622955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "589aa4f746cf410cba8fd345ed6f830f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853cfa70-26", "ovs_interfaceid": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-06f23417-86f7-4f47-8e45-d9946d8f17ce req-7b938789-da61-4750-ac3c-755265ebd8ef service nova] Acquired lock "refresh_cache-72003d17-9292-4bdd-acfc-0d3f7e40df80" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.network.neutron [req-06f23417-86f7-4f47-8e45-d9946d8f17ce req-7b938789-da61-4750-ac3c-755265ebd8ef service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Refreshing network info cache for port 853cfa70-26ff-4bd6-ab16-8f13128cee00 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Start _get_guest_xml network_info=[{"id": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "address": "fa:16:3e:53:fc:43", "network": {"id": "35a08d69-02ac-4f3a-8a8c-6a8b41c2679a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2043622955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "589aa4f746cf410cba8fd345ed6f830f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853cfa70-26", "ovs_interfaceid": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:07:47 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:07:47 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:07:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1518845441',display_name='tempest-TestVolumeSwap-server-1518845441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1518845441',id=16,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRMCcr8pkD89dGCKHlom+trNG9Up+Q4tKzAORb8vXkUcu0CLz8K4FH9IjKehFG/yTFo+9Sy4G3x3LMKzbVZA94aMIdLlj/Hi7GZEKoi6w/NlozMEFcqlPqtx0ugMVyJHg==',key_name='tempest-keypair-1369080920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='589aa4f746cf410cba8fd345ed6f830f',ramdisk_id='',reservation_id='r-xo9kaa92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1722680199',owner_user_name='tempest-TestVolumeSwap-1722680199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce225357cc264fc98967e471723bd062',uuid=72003d17-9292-4bdd-acfc-0d3f7e40df80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "address": "fa:16:3e:53:fc:43", "network": {"id": "35a08d69-02ac-4f3a-8a8c-6a8b41c2679a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2043622955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "589aa4f746cf410cba8fd345ed6f830f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853cfa70-26", "ovs_interfaceid": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Converting VIF {"id": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "address": "fa:16:3e:53:fc:43", "network": {"id": "35a08d69-02ac-4f3a-8a8c-6a8b41c2679a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2043622955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "589aa4f746cf410cba8fd345ed6f830f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853cfa70-26", "ovs_interfaceid": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:fc:43,bridge_name='br-int',has_traffic_filtering=True,id=853cfa70-26ff-4bd6-ab16-8f13128cee00,network=Network(35a08d69-02ac-4f3a-8a8c-6a8b41c2679a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853cfa70-26') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.objects.instance [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lazy-loading 'pci_devices' on Instance uuid 72003d17-9292-4bdd-acfc-0d3f7e40df80 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.network.neutron [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Updated VIF entry in instance network info cache for port 4f154d45-5d20-4df0-bb42-5977772a98c4. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.network.neutron [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Updating instance_info_cache with network_info: [{"id": "4f154d45-5d20-4df0-bb42-5977772a98c4", "address": "fa:16:3e:72:d7:10", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f154d45-5d", "ovs_interfaceid": "4f154d45-5d20-4df0-bb42-5977772a98c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:07:47 user nova-compute[74242]:   <uuid>72003d17-9292-4bdd-acfc-0d3f7e40df80</uuid>
Oct 20 02:07:47 user nova-compute[74242]:   <name>instance-00000010</name>
Oct 20 02:07:47 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:07:47 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:07:47 user nova-compute[74242]:   <metadata>
Oct 20 02:07:47 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:07:47 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:07:47 user nova-compute[74242]:       <nova:name>tempest-TestVolumeSwap-server-1518845441</nova:name>
Oct 20 02:07:47 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:07:47</nova:creationTime>
Oct 20 02:07:47 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:07:47 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:07:47 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:07:47 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:07:47 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:07:47 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:07:47 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:07:47 user nova-compute[74242]:       <nova:owner>
Oct 20 02:07:47 user nova-compute[74242]:         <nova:user uuid="ce225357cc264fc98967e471723bd062">tempest-TestVolumeSwap-1722680199-project-member</nova:user>
Oct 20 02:07:47 user nova-compute[74242]:         <nova:project uuid="589aa4f746cf410cba8fd345ed6f830f">tempest-TestVolumeSwap-1722680199</nova:project>
Oct 20 02:07:47 user nova-compute[74242]:       </nova:owner>
Oct 20 02:07:47 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:07:47 user nova-compute[74242]:       <nova:ports>
Oct 20 02:07:47 user nova-compute[74242]:         <nova:port uuid="853cfa70-26ff-4bd6-ab16-8f13128cee00">
Oct 20 02:07:47 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 02:07:47 user nova-compute[74242]:         </nova:port>
Oct 20 02:07:47 user nova-compute[74242]:       </nova:ports>
Oct 20 02:07:47 user nova-compute[74242]:     </nova:instance>
Oct 20 02:07:47 user nova-compute[74242]:   </metadata>
Oct 20 02:07:47 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:07:47 user nova-compute[74242]:     <system>
Oct 20 02:07:47 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:07:47 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:07:47 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:07:47 user nova-compute[74242]:       <entry name="serial">72003d17-9292-4bdd-acfc-0d3f7e40df80</entry>
Oct 20 02:07:47 user nova-compute[74242]:       <entry name="uuid">72003d17-9292-4bdd-acfc-0d3f7e40df80</entry>
Oct 20 02:07:47 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:07:47 user nova-compute[74242]:     </system>
Oct 20 02:07:47 user nova-compute[74242]:   </sysinfo>
Oct 20 02:07:47 user nova-compute[74242]:   <os>
Oct 20 02:07:47 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:07:47 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:07:47 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:07:47 user nova-compute[74242]:   </os>
Oct 20 02:07:47 user nova-compute[74242]:   <features>
Oct 20 02:07:47 user nova-compute[74242]:     <acpi/>
Oct 20 02:07:47 user nova-compute[74242]:     <apic/>
Oct 20 02:07:47 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:07:47 user nova-compute[74242]:   </features>
Oct 20 02:07:47 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:07:47 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:07:47 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:07:47 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:07:47 user nova-compute[74242]:   </clock>
Oct 20 02:07:47 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:07:47 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:07:47 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:07:47 user nova-compute[74242]:   </cpu>
Oct 20 02:07:47 user nova-compute[74242]:   <devices>
Oct 20 02:07:47 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:07:47 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:07:47 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk"/>
Oct 20 02:07:47 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:07:47 user nova-compute[74242]:     </disk>
Oct 20 02:07:47 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:07:47 user nova-compute[74242]:       <mac address="fa:16:3e:53:fc:43"/>
Oct 20 02:07:47 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:07:47 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:07:47 user nova-compute[74242]:       <target dev="tap853cfa70-26"/>
Oct 20 02:07:47 user nova-compute[74242]:     </interface>
Oct 20 02:07:47 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:07:47 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/console.log" append="off"/>
Oct 20 02:07:47 user nova-compute[74242]:     </serial>
Oct 20 02:07:47 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:07:47 user nova-compute[74242]:     <video>
Oct 20 02:07:47 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:07:47 user nova-compute[74242]:     </video>
Oct 20 02:07:47 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:07:47 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:07:47 user nova-compute[74242]:     </rng>
Oct 20 02:07:47 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:07:47 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:07:47 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:07:47 user nova-compute[74242]:     </memballoon>
Oct 20 02:07:47 user nova-compute[74242]:   </devices>
Oct 20 02:07:47 user nova-compute[74242]: </domain>
Oct 20 02:07:47 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:07:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1518845441',display_name='tempest-TestVolumeSwap-server-1518845441',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1518845441',id=16,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRMCcr8pkD89dGCKHlom+trNG9Up+Q4tKzAORb8vXkUcu0CLz8K4FH9IjKehFG/yTFo+9Sy4G3x3LMKzbVZA94aMIdLlj/Hi7GZEKoi6w/NlozMEFcqlPqtx0ugMVyJHg==',key_name='tempest-keypair-1369080920',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='589aa4f746cf410cba8fd345ed6f830f',ramdisk_id='',reservation_id='r-xo9kaa92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1722680199',owner_user_name='tempest-TestVolumeSwap-1722680199-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce225357cc264fc98967e471723bd062',uuid=72003d17-9292-4bdd-acfc-0d3f7e40df80,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "address": "fa:16:3e:53:fc:43", "network": {"id": "35a08d69-02ac-4f3a-8a8c-6a8b41c2679a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2043622955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "589aa4f746cf410cba8fd345ed6f830f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853cfa70-26", "ovs_interfaceid": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Converting VIF {"id": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "address": "fa:16:3e:53:fc:43", "network": {"id": "35a08d69-02ac-4f3a-8a8c-6a8b41c2679a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2043622955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "589aa4f746cf410cba8fd345ed6f830f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853cfa70-26", "ovs_interfaceid": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:fc:43,bridge_name='br-int',has_traffic_filtering=True,id=853cfa70-26ff-4bd6-ab16-8f13128cee00,network=Network(35a08d69-02ac-4f3a-8a8c-6a8b41c2679a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853cfa70-26') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG os_vif [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:fc:43,bridge_name='br-int',has_traffic_filtering=True,id=853cfa70-26ff-4bd6-ab16-8f13128cee00,network=Network(35a08d69-02ac-4f3a-8a8c-6a8b41c2679a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853cfa70-26') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2ecef982-613d-5777-b0e3-f4cf89947102', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] Releasing lock "refresh_cache-7e101002-a175-40fe-b5ca-04a58610f60d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-changed-d69d4eef-6af5-4d1d-8e7e-49a60dc36111 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing instance network info cache due to event network-changed-d69d4eef-6af5-4d1d-8e7e-49a60dc36111. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] Acquiring lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] Acquired lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.network.neutron [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing network info cache for port d69d4eef-6af5-4d1d-8e7e-49a60dc36111 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap853cfa70-26, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap853cfa70-26, col_values=(('qos', UUID('d8e846b6-16f0-4284-89ff-a3bae17605cc')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap853cfa70-26, col_values=(('external_ids', {'iface-id': '853cfa70-26ff-4bd6-ab16-8f13128cee00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:fc:43', 'vm-uuid': '72003d17-9292-4bdd-acfc-0d3f7e40df80'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:47 user nova-compute[74242]: INFO os_vif [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:fc:43,bridge_name='br-int',has_traffic_filtering=True,id=853cfa70-26ff-4bd6-ab16-8f13128cee00,network=Network(35a08d69-02ac-4f3a-8a8c-6a8b41c2679a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853cfa70-26')
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] No VIF found with MAC fa:16:3e:53:fc:43, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:07:47 user nova-compute[74242]: DEBUG nova.network.neutron [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:07:48 user nova-compute[74242]: DEBUG nova.network.neutron [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:48 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Successfully updated port: a3751e3f-044b-44fc-94ab-9e54484b46cc {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:07:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-973e1efa-1f17-4acd-9132-f9fc1b17d384 req-a27808f5-7ed2-4bbd-8b6c-ea245a4f6332 service nova] Releasing lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:07:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:07:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquired lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:07:48 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:07:48 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:07:48 user nova-compute[74242]: DEBUG nova.network.neutron [req-06f23417-86f7-4f47-8e45-d9946d8f17ce req-7b938789-da61-4750-ac3c-755265ebd8ef service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Updated VIF entry in instance network info cache for port 853cfa70-26ff-4bd6-ab16-8f13128cee00. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:07:48 user nova-compute[74242]: DEBUG nova.network.neutron [req-06f23417-86f7-4f47-8e45-d9946d8f17ce req-7b938789-da61-4750-ac3c-755265ebd8ef service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Updating instance_info_cache with network_info: [{"id": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "address": "fa:16:3e:53:fc:43", "network": {"id": "35a08d69-02ac-4f3a-8a8c-6a8b41c2679a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2043622955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "589aa4f746cf410cba8fd345ed6f830f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853cfa70-26", "ovs_interfaceid": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-06f23417-86f7-4f47-8e45-d9946d8f17ce req-7b938789-da61-4750-ac3c-755265ebd8ef service nova] Releasing lock "refresh_cache-72003d17-9292-4bdd-acfc-0d3f7e40df80" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:07:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-changed-a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing instance network info cache due to event network-changed-a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:07:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] Acquiring lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:07:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-c0700e54-6554-4d75-b2a3-2d94c92e7d31 req-25865d78-9458-4c6b-8507-fab62c22476d service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Received event network-vif-plugged-853cfa70-26ff-4bd6-ab16-8f13128cee00 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c0700e54-6554-4d75-b2a3-2d94c92e7d31 req-25865d78-9458-4c6b-8507-fab62c22476d service nova] Acquiring lock "72003d17-9292-4bdd-acfc-0d3f7e40df80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c0700e54-6554-4d75-b2a3-2d94c92e7d31 req-25865d78-9458-4c6b-8507-fab62c22476d service nova] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c0700e54-6554-4d75-b2a3-2d94c92e7d31 req-25865d78-9458-4c6b-8507-fab62c22476d service nova] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-c0700e54-6554-4d75-b2a3-2d94c92e7d31 req-25865d78-9458-4c6b-8507-fab62c22476d service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] No waiting events found dispatching network-vif-plugged-853cfa70-26ff-4bd6-ab16-8f13128cee00 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:07:50 user nova-compute[74242]: WARNING nova.compute.manager [req-c0700e54-6554-4d75-b2a3-2d94c92e7d31 req-25865d78-9458-4c6b-8507-fab62c22476d service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Received unexpected event network-vif-plugged-853cfa70-26ff-4bd6-ab16-8f13128cee00 for instance with vm_state building and task_state spawning.
Oct 20 02:07:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:50 user nova-compute[74242]: DEBUG nova.network.neutron [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updating instance_info_cache with network_info: [{"id": "a1593d20-a266-4958-ba9d-6f03899e6195", "address": "fa:16:3e:03:a4:17", "network": {"id": "35f39b1c-01dd-4269-bb70-ee2df8e0f279", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1724814878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1593d20-a2", "ovs_interfaceid": "a1593d20-a266-4958-ba9d-6f03899e6195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17f0118a-3e44-4d76-b03a-b06790728aec", "address": "fa:16:3e:b2:ee:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17f0118a-3e", "ovs_interfaceid": "17f0118a-3e44-4d76-b03a-b06790728aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a777aac-0d50-4036-823d-017f94a044b1", "address": "fa:16:3e:6f:b4:ee", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a777aac-0d", "ovs_interfaceid": "0a777aac-0d50-4036-823d-017f94a044b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "address": "fa:16:3e:af:aa:49", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4025d0ae-da", "ovs_interfaceid": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "address": "fa:16:3e:af:36:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69d4eef-6a", "ovs_interfaceid": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "address": "fa:16:3e:48:0b:b9", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c9e8a9-b1", "ovs_interfaceid": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "address": "fa:16:3e:c5:2f:3d", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3751e3f-04", "ovs_interfaceid": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Releasing lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:07:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Instance network_info: |[{"id": "a1593d20-a266-4958-ba9d-6f03899e6195", "address": "fa:16:3e:03:a4:17", "network": {"id": "35f39b1c-01dd-4269-bb70-ee2df8e0f279", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1724814878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1593d20-a2", "ovs_interfaceid": "a1593d20-a266-4958-ba9d-6f03899e6195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17f0118a-3e44-4d76-b03a-b06790728aec", "address": "fa:16:3e:b2:ee:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17f0118a-3e", "ovs_interfaceid": "17f0118a-3e44-4d76-b03a-b06790728aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a777aac-0d50-4036-823d-017f94a044b1", "address": "fa:16:3e:6f:b4:ee", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a777aac-0d", "ovs_interfaceid": "0a777aac-0d50-4036-823d-017f94a044b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "address": "fa:16:3e:af:aa:49", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4025d0ae-da", "ovs_interfaceid": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "address": "fa:16:3e:af:36:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69d4eef-6a", "ovs_interfaceid": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "address": "fa:16:3e:48:0b:b9", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c9e8a9-b1", "ovs_interfaceid": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "address": "fa:16:3e:c5:2f:3d", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3751e3f-04", "ovs_interfaceid": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:07:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] Acquired lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:07:50 user nova-compute[74242]: DEBUG nova.network.neutron [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing network info cache for port a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-5a23f9a5-c264-4f52-860d-f65f2ab541ed req-0fedbe1a-7f76-49d1-aafd-accf53f55d01 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Received event network-vif-plugged-4f154d45-5d20-4df0-bb42-5977772a98c4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5a23f9a5-c264-4f52-860d-f65f2ab541ed req-0fedbe1a-7f76-49d1-aafd-accf53f55d01 service nova] Acquiring lock "7e101002-a175-40fe-b5ca-04a58610f60d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5a23f9a5-c264-4f52-860d-f65f2ab541ed req-0fedbe1a-7f76-49d1-aafd-accf53f55d01 service nova] Lock "7e101002-a175-40fe-b5ca-04a58610f60d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5a23f9a5-c264-4f52-860d-f65f2ab541ed req-0fedbe1a-7f76-49d1-aafd-accf53f55d01 service nova] Lock "7e101002-a175-40fe-b5ca-04a58610f60d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-5a23f9a5-c264-4f52-860d-f65f2ab541ed req-0fedbe1a-7f76-49d1-aafd-accf53f55d01 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] No waiting events found dispatching network-vif-plugged-4f154d45-5d20-4df0-bb42-5977772a98c4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:07:51 user nova-compute[74242]: WARNING nova.compute.manager [req-5a23f9a5-c264-4f52-860d-f65f2ab541ed req-0fedbe1a-7f76-49d1-aafd-accf53f55d01 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Received unexpected event network-vif-plugged-4f154d45-5d20-4df0-bb42-5977772a98c4 for instance with vm_state building and task_state spawning.
Oct 20 02:07:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-5a23f9a5-c264-4f52-860d-f65f2ab541ed req-0fedbe1a-7f76-49d1-aafd-accf53f55d01 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Received event network-vif-plugged-4f154d45-5d20-4df0-bb42-5977772a98c4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5a23f9a5-c264-4f52-860d-f65f2ab541ed req-0fedbe1a-7f76-49d1-aafd-accf53f55d01 service nova] Acquiring lock "7e101002-a175-40fe-b5ca-04a58610f60d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5a23f9a5-c264-4f52-860d-f65f2ab541ed req-0fedbe1a-7f76-49d1-aafd-accf53f55d01 service nova] Lock "7e101002-a175-40fe-b5ca-04a58610f60d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5a23f9a5-c264-4f52-860d-f65f2ab541ed req-0fedbe1a-7f76-49d1-aafd-accf53f55d01 service nova] Lock "7e101002-a175-40fe-b5ca-04a58610f60d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-5a23f9a5-c264-4f52-860d-f65f2ab541ed req-0fedbe1a-7f76-49d1-aafd-accf53f55d01 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] No waiting events found dispatching network-vif-plugged-4f154d45-5d20-4df0-bb42-5977772a98c4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:07:51 user nova-compute[74242]: WARNING nova.compute.manager [req-5a23f9a5-c264-4f52-860d-f65f2ab541ed req-0fedbe1a-7f76-49d1-aafd-accf53f55d01 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Received unexpected event network-vif-plugged-4f154d45-5d20-4df0-bb42-5977772a98c4 for instance with vm_state building and task_state spawning.
Oct 20 02:07:51 user nova-compute[74242]: DEBUG nova.network.neutron [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updated VIF entry in instance network info cache for port a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG nova.network.neutron [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updating instance_info_cache with network_info: [{"id": "a1593d20-a266-4958-ba9d-6f03899e6195", "address": "fa:16:3e:03:a4:17", "network": {"id": "35f39b1c-01dd-4269-bb70-ee2df8e0f279", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1724814878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1593d20-a2", "ovs_interfaceid": "a1593d20-a266-4958-ba9d-6f03899e6195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17f0118a-3e44-4d76-b03a-b06790728aec", "address": "fa:16:3e:b2:ee:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17f0118a-3e", "ovs_interfaceid": "17f0118a-3e44-4d76-b03a-b06790728aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a777aac-0d50-4036-823d-017f94a044b1", "address": "fa:16:3e:6f:b4:ee", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a777aac-0d", "ovs_interfaceid": "0a777aac-0d50-4036-823d-017f94a044b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "address": "fa:16:3e:af:aa:49", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4025d0ae-da", "ovs_interfaceid": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "address": "fa:16:3e:af:36:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69d4eef-6a", "ovs_interfaceid": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "address": "fa:16:3e:48:0b:b9", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c9e8a9-b1", "ovs_interfaceid": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "address": "fa:16:3e:c5:2f:3d", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3751e3f-04", "ovs_interfaceid": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] Releasing lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-changed-a3751e3f-044b-44fc-94ab-9e54484b46cc {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing instance network info cache due to event network-changed-a3751e3f-044b-44fc-94ab-9e54484b46cc. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] Acquiring lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] Acquired lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG nova.network.neutron [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing network info cache for port a3751e3f-044b-44fc-94ab-9e54484b46cc {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG nova.network.neutron [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updated VIF entry in instance network info cache for port a3751e3f-044b-44fc-94ab-9e54484b46cc. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG nova.network.neutron [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updating instance_info_cache with network_info: [{"id": "a1593d20-a266-4958-ba9d-6f03899e6195", "address": "fa:16:3e:03:a4:17", "network": {"id": "35f39b1c-01dd-4269-bb70-ee2df8e0f279", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1724814878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1593d20-a2", "ovs_interfaceid": "a1593d20-a266-4958-ba9d-6f03899e6195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17f0118a-3e44-4d76-b03a-b06790728aec", "address": "fa:16:3e:b2:ee:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17f0118a-3e", "ovs_interfaceid": "17f0118a-3e44-4d76-b03a-b06790728aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a777aac-0d50-4036-823d-017f94a044b1", "address": "fa:16:3e:6f:b4:ee", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a777aac-0d", "ovs_interfaceid": "0a777aac-0d50-4036-823d-017f94a044b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "address": "fa:16:3e:af:aa:49", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4025d0ae-da", "ovs_interfaceid": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "address": "fa:16:3e:af:36:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69d4eef-6a", "ovs_interfaceid": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "address": "fa:16:3e:48:0b:b9", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c9e8a9-b1", "ovs_interfaceid": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "address": "fa:16:3e:c5:2f:3d", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3751e3f-04", "ovs_interfaceid": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:07:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-00685f45-3931-47fb-9f93-d86e37abb74f req-8b62b9d6-2f9e-432c-8dff-b528cfbe4571 service nova] Releasing lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:07:52 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Instance spawned successfully.
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.compute.manager [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-fd73ee47-aeaf-41c1-8b17-2143c85270e2 req-731eb75f-ba08-42fc-bbc7-c7958db71ab5 service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Received event network-vif-plugged-853cfa70-26ff-4bd6-ab16-8f13128cee00 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fd73ee47-aeaf-41c1-8b17-2143c85270e2 req-731eb75f-ba08-42fc-bbc7-c7958db71ab5 service nova] Acquiring lock "72003d17-9292-4bdd-acfc-0d3f7e40df80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fd73ee47-aeaf-41c1-8b17-2143c85270e2 req-731eb75f-ba08-42fc-bbc7-c7958db71ab5 service nova] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fd73ee47-aeaf-41c1-8b17-2143c85270e2 req-731eb75f-ba08-42fc-bbc7-c7958db71ab5 service nova] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-fd73ee47-aeaf-41c1-8b17-2143c85270e2 req-731eb75f-ba08-42fc-bbc7-c7958db71ab5 service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] No waiting events found dispatching network-vif-plugged-853cfa70-26ff-4bd6-ab16-8f13128cee00 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:07:52 user nova-compute[74242]: WARNING nova.compute.manager [req-fd73ee47-aeaf-41c1-8b17-2143c85270e2 req-731eb75f-ba08-42fc-bbc7-c7958db71ab5 service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Received unexpected event network-vif-plugged-853cfa70-26ff-4bd6-ab16-8f13128cee00 for instance with vm_state building and task_state spawning.
Oct 20 02:07:52 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Instance spawned successfully.
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:07:52 user nova-compute[74242]: INFO nova.compute.manager [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Took 9.84 seconds to spawn the instance on the hypervisor.
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:07:52 user nova-compute[74242]: INFO nova.compute.manager [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Took 7.33 seconds to spawn the instance on the hypervisor.
Oct 20 02:07:52 user nova-compute[74242]: DEBUG nova.compute.manager [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:07:52 user nova-compute[74242]: INFO nova.compute.manager [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Took 10.70 seconds to build instance.
Oct 20 02:07:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1f26dfc2-880b-4125-9512-53c16c069f55 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "7e101002-a175-40fe-b5ca-04a58610f60d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.803s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:52 user nova-compute[74242]: INFO nova.compute.manager [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Took 8.25 seconds to build instance.
Oct 20 02:07:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-88e23d66-87cf-4213-bf4c-96cc6363ebe6 tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.367s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:07:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:07:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-2530d01b-abc7-431b-9593-de8976a49308 req-38d67897-f44c-4981-9b76-ca6831a97d70 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-changed-c809bd71-9a30-4d1c-9884-b2881cd21f70 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-2530d01b-abc7-431b-9593-de8976a49308 req-38d67897-f44c-4981-9b76-ca6831a97d70 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing instance network info cache due to event network-changed-c809bd71-9a30-4d1c-9884-b2881cd21f70. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:08:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2530d01b-abc7-431b-9593-de8976a49308 req-38d67897-f44c-4981-9b76-ca6831a97d70 service nova] Acquiring lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:08:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2530d01b-abc7-431b-9593-de8976a49308 req-38d67897-f44c-4981-9b76-ca6831a97d70 service nova] Acquired lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:08:00 user nova-compute[74242]: DEBUG nova.network.neutron [req-2530d01b-abc7-431b-9593-de8976a49308 req-38d67897-f44c-4981-9b76-ca6831a97d70 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Refreshing network info cache for port c809bd71-9a30-4d1c-9884-b2881cd21f70 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:08:01 user nova-compute[74242]: DEBUG nova.network.neutron [req-2530d01b-abc7-431b-9593-de8976a49308 req-38d67897-f44c-4981-9b76-ca6831a97d70 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updated VIF entry in instance network info cache for port c809bd71-9a30-4d1c-9884-b2881cd21f70. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:08:01 user nova-compute[74242]: DEBUG nova.network.neutron [req-2530d01b-abc7-431b-9593-de8976a49308 req-38d67897-f44c-4981-9b76-ca6831a97d70 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updating instance_info_cache with network_info: [{"id": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "address": "fa:16:3e:1b:f2:1f", "network": {"id": "b7bde1f3-dede-4765-9ea9-d294203c607f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2003879386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc809bd71-9a", "ovs_interfaceid": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2de0cc37-2422-461f-8a4a-3b77033ce618", "address": "fa:16:3e:bc:54:72", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de0cc37-24", "ovs_interfaceid": "2de0cc37-2422-461f-8a4a-3b77033ce618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "address": "fa:16:3e:bf:06:d5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87632b36-c7", "ovs_interfaceid": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67449c80-5905-4656-9c55-45460e214374", "address": "fa:16:3e:6e:a7:08", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67449c80-59", "ovs_interfaceid": "67449c80-5905-4656-9c55-45460e214374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "address": "fa:16:3e:81:03:b5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebac74b9-c5", "ovs_interfaceid": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "address": "fa:16:3e:79:9b:bb", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e47a50-c8", "ovs_interfaceid": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "address": "fa:16:3e:57:89:56", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd45e11fc-f0", "ovs_interfaceid": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:08:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2530d01b-abc7-431b-9593-de8976a49308 req-38d67897-f44c-4981-9b76-ca6831a97d70 service nova] Releasing lock "refresh_cache-a77f802c-7ee6-4596-ac65-221e2a6bb533" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:08:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:03 user nova-compute[74242]: INFO nova.compute.manager [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Terminating instance
Oct 20 02:08:03 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG nova.compute.manager [req-c86e38ef-2929-435a-84af-48fb43ec7e22 req-344d6068-8b8b-4212-af61-619aa173f9c9 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-unplugged-2de0cc37-2422-461f-8a4a-3b77033ce618 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c86e38ef-2929-435a-84af-48fb43ec7e22 req-344d6068-8b8b-4212-af61-619aa173f9c9 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c86e38ef-2929-435a-84af-48fb43ec7e22 req-344d6068-8b8b-4212-af61-619aa173f9c9 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c86e38ef-2929-435a-84af-48fb43ec7e22 req-344d6068-8b8b-4212-af61-619aa173f9c9 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG nova.compute.manager [req-c86e38ef-2929-435a-84af-48fb43ec7e22 req-344d6068-8b8b-4212-af61-619aa173f9c9 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-unplugged-2de0cc37-2422-461f-8a4a-3b77033ce618 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG nova.compute.manager [req-c86e38ef-2929-435a-84af-48fb43ec7e22 req-344d6068-8b8b-4212-af61-619aa173f9c9 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-unplugged-2de0cc37-2422-461f-8a4a-3b77033ce618 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG nova.compute.manager [req-7485cacf-05cb-4d38-ab24-7caf9f7d9403 req-78aa8ac5-e7b5-4666-953d-04aaff21ff6a service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-unplugged-c809bd71-9a30-4d1c-9884-b2881cd21f70 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7485cacf-05cb-4d38-ab24-7caf9f7d9403 req-78aa8ac5-e7b5-4666-953d-04aaff21ff6a service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7485cacf-05cb-4d38-ab24-7caf9f7d9403 req-78aa8ac5-e7b5-4666-953d-04aaff21ff6a service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7485cacf-05cb-4d38-ab24-7caf9f7d9403 req-78aa8ac5-e7b5-4666-953d-04aaff21ff6a service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG nova.compute.manager [req-7485cacf-05cb-4d38-ab24-7caf9f7d9403 req-78aa8ac5-e7b5-4666-953d-04aaff21ff6a service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-unplugged-c809bd71-9a30-4d1c-9884-b2881cd21f70 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG nova.compute.manager [req-7485cacf-05cb-4d38-ab24-7caf9f7d9403 req-78aa8ac5-e7b5-4666-953d-04aaff21ff6a service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-unplugged-c809bd71-9a30-4d1c-9884-b2881cd21f70 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG nova.compute.manager [req-5fde51fd-92b9-479d-8dad-27a5f4858aa5 req-27fac98a-38bd-4312-acc8-4f60116f6324 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-unplugged-87632b36-c7fb-47e4-a792-cf94f02ac6f3 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5fde51fd-92b9-479d-8dad-27a5f4858aa5 req-27fac98a-38bd-4312-acc8-4f60116f6324 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5fde51fd-92b9-479d-8dad-27a5f4858aa5 req-27fac98a-38bd-4312-acc8-4f60116f6324 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5fde51fd-92b9-479d-8dad-27a5f4858aa5 req-27fac98a-38bd-4312-acc8-4f60116f6324 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG nova.compute.manager [req-5fde51fd-92b9-479d-8dad-27a5f4858aa5 req-27fac98a-38bd-4312-acc8-4f60116f6324 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-unplugged-87632b36-c7fb-47e4-a792-cf94f02ac6f3 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG nova.compute.manager [req-5fde51fd-92b9-479d-8dad-27a5f4858aa5 req-27fac98a-38bd-4312-acc8-4f60116f6324 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-unplugged-87632b36-c7fb-47e4-a792-cf94f02ac6f3 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:05 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Instance destroyed successfully.
Oct 20 02:08:05 user nova-compute[74242]: DEBUG nova.objects.instance [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lazy-loading 'resources' on Instance uuid a77f802c-7ee6-4596-ac65-221e2a6bb533 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:06:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "address": "fa:16:3e:1b:f2:1f", "network": {"id": "b7bde1f3-dede-4765-9ea9-d294203c607f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2003879386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc809bd71-9a", "ovs_interfaceid": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "address": "fa:16:3e:1b:f2:1f", "network": {"id": "b7bde1f3-dede-4765-9ea9-d294203c607f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2003879386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc809bd71-9a", "ovs_interfaceid": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:f2:1f,bridge_name='br-int',has_traffic_filtering=True,id=c809bd71-9a30-4d1c-9884-b2881cd21f70,network=Network(b7bde1f3-dede-4765-9ea9-d294203c607f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc809bd71-9a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG os_vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:f2:1f,bridge_name='br-int',has_traffic_filtering=True,id=c809bd71-9a30-4d1c-9884-b2881cd21f70,network=Network(b7bde1f3-dede-4765-9ea9-d294203c607f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc809bd71-9a') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc809bd71-9a, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e13417e5-a294-4b75-8df2-b9bebb3fea42) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:05 user nova-compute[74242]: INFO os_vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1b:f2:1f,bridge_name='br-int',has_traffic_filtering=True,id=c809bd71-9a30-4d1c-9884-b2881cd21f70,network=Network(b7bde1f3-dede-4765-9ea9-d294203c607f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc809bd71-9a')
Oct 20 02:08:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:06:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2de0cc37-2422-461f-8a4a-3b77033ce618", "address": "fa:16:3e:bc:54:72", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de0cc37-24", "ovs_interfaceid": "2de0cc37-2422-461f-8a4a-3b77033ce618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "2de0cc37-2422-461f-8a4a-3b77033ce618", "address": "fa:16:3e:bc:54:72", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de0cc37-24", "ovs_interfaceid": "2de0cc37-2422-461f-8a4a-3b77033ce618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:54:72,bridge_name='br-int',has_traffic_filtering=True,id=2de0cc37-2422-461f-8a4a-3b77033ce618,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2de0cc37-24') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG os_vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:54:72,bridge_name='br-int',has_traffic_filtering=True,id=2de0cc37-2422-461f-8a4a-3b77033ce618,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2de0cc37-24') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2de0cc37-24, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-2de0cc37-2422-461f-8a4a-3b77033ce618 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-2de0cc37-2422-461f-8a4a-3b77033ce618 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:05 user nova-compute[74242]: WARNING nova.compute.manager [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-2de0cc37-2422-461f-8a4a-3b77033ce618 for instance with vm_state active and task_state deleting.
Oct 20 02:08:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-unplugged-f5e47a50-c8fb-46e8-9f8b-54470f96061e {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-unplugged-f5e47a50-c8fb-46e8-9f8b-54470f96061e {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-unplugged-f5e47a50-c8fb-46e8-9f8b-54470f96061e for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-f5e47a50-c8fb-46e8-9f8b-54470f96061e {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-f5e47a50-c8fb-46e8-9f8b-54470f96061e {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:05 user nova-compute[74242]: WARNING nova.compute.manager [req-036807be-36ac-4c19-8f1a-ed992b035726 req-112040d0-8dc0-494c-9e45-406c04312d06 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-f5e47a50-c8fb-46e8-9f8b-54470f96061e for instance with vm_state active and task_state deleting.
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cd29748e-b4d9-42be-9462-0023362bcab8) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-f7cef796-9f17-4cd2-96b5-e531ebc48078 req-c36ce9c9-4652-4b9d-849d-9190cb6c6330 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-c809bd71-9a30-4d1c-9884-b2881cd21f70 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f7cef796-9f17-4cd2-96b5-e531ebc48078 req-c36ce9c9-4652-4b9d-849d-9190cb6c6330 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f7cef796-9f17-4cd2-96b5-e531ebc48078 req-c36ce9c9-4652-4b9d-849d-9190cb6c6330 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f7cef796-9f17-4cd2-96b5-e531ebc48078 req-c36ce9c9-4652-4b9d-849d-9190cb6c6330 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-f7cef796-9f17-4cd2-96b5-e531ebc48078 req-c36ce9c9-4652-4b9d-849d-9190cb6c6330 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-c809bd71-9a30-4d1c-9884-b2881cd21f70 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:06 user nova-compute[74242]: WARNING nova.compute.manager [req-f7cef796-9f17-4cd2-96b5-e531ebc48078 req-c36ce9c9-4652-4b9d-849d-9190cb6c6330 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-c809bd71-9a30-4d1c-9884-b2881cd21f70 for instance with vm_state active and task_state deleting.
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: INFO os_vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:54:72,bridge_name='br-int',has_traffic_filtering=True,id=2de0cc37-2422-461f-8a4a-3b77033ce618,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap2de0cc37-24')
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:06:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "address": "fa:16:3e:bf:06:d5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87632b36-c7", "ovs_interfaceid": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "address": "fa:16:3e:bf:06:d5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87632b36-c7", "ovs_interfaceid": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bf:06:d5,bridge_name='br-int',has_traffic_filtering=True,id=87632b36-c7fb-47e4-a792-cf94f02ac6f3,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap87632b36-c7') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:06:d5,bridge_name='br-int',has_traffic_filtering=True,id=87632b36-c7fb-47e4-a792-cf94f02ac6f3,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap87632b36-c7') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap87632b36-c7, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-87632b36-c7fb-47e4-a792-cf94f02ac6f3 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-87632b36-c7fb-47e4-a792-cf94f02ac6f3 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:06 user nova-compute[74242]: WARNING nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-87632b36-c7fb-47e4-a792-cf94f02ac6f3 for instance with vm_state active and task_state deleting.
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-unplugged-67449c80-5905-4656-9c55-45460e214374 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-unplugged-67449c80-5905-4656-9c55-45460e214374 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-unplugged-67449c80-5905-4656-9c55-45460e214374 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-67449c80-5905-4656-9c55-45460e214374 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-67449c80-5905-4656-9c55-45460e214374 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:06 user nova-compute[74242]: WARNING nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-67449c80-5905-4656-9c55-45460e214374 for instance with vm_state active and task_state deleting.
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-unplugged-ebac74b9-c5ad-48b8-8b0a-370831dbd710 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-unplugged-ebac74b9-c5ad-48b8-8b0a-370831dbd710 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-unplugged-ebac74b9-c5ad-48b8-8b0a-370831dbd710 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-ebac74b9-c5ad-48b8-8b0a-370831dbd710 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-ebac74b9-c5ad-48b8-8b0a-370831dbd710 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:06 user nova-compute[74242]: WARNING nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-ebac74b9-c5ad-48b8-8b0a-370831dbd710 for instance with vm_state active and task_state deleting.
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-unplugged-d45e11fc-f0b3-4bd3-92d3-9508adbcd839 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-unplugged-d45e11fc-f0b3-4bd3-92d3-9508adbcd839 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-unplugged-d45e11fc-f0b3-4bd3-92d3-9508adbcd839 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-plugged-d45e11fc-f0b3-4bd3-92d3-9508adbcd839 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Acquiring lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] No waiting events found dispatching network-vif-plugged-d45e11fc-f0b3-4bd3-92d3-9508adbcd839 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:06 user nova-compute[74242]: WARNING nova.compute.manager [req-a8e13038-e836-4e7d-b76b-54618d926264 req-6f0cf70c-05a7-40fb-a835-68a440b32864 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received unexpected event network-vif-plugged-d45e11fc-f0b3-4bd3-92d3-9508adbcd839 for instance with vm_state active and task_state deleting.
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=337e25eb-d209-4a99-8630-d6aafb191ec3) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: INFO os_vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bf:06:d5,bridge_name='br-int',has_traffic_filtering=True,id=87632b36-c7fb-47e4-a792-cf94f02ac6f3,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap87632b36-c7')
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:06:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "67449c80-5905-4656-9c55-45460e214374", "address": "fa:16:3e:6e:a7:08", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67449c80-59", "ovs_interfaceid": "67449c80-5905-4656-9c55-45460e214374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "67449c80-5905-4656-9c55-45460e214374", "address": "fa:16:3e:6e:a7:08", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67449c80-59", "ovs_interfaceid": "67449c80-5905-4656-9c55-45460e214374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a7:08,bridge_name='br-int',has_traffic_filtering=True,id=67449c80-5905-4656-9c55-45460e214374,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67449c80-59') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a7:08,bridge_name='br-int',has_traffic_filtering=True,id=67449c80-5905-4656-9c55-45460e214374,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67449c80-59') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap67449c80-59, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f9be2622-c243-497d-8250-9887f83a5fda) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: INFO os_vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:a7:08,bridge_name='br-int',has_traffic_filtering=True,id=67449c80-5905-4656-9c55-45460e214374,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap67449c80-59')
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:06:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "address": "fa:16:3e:81:03:b5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebac74b9-c5", "ovs_interfaceid": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "address": "fa:16:3e:81:03:b5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebac74b9-c5", "ovs_interfaceid": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:81:03:b5,bridge_name='br-int',has_traffic_filtering=True,id=ebac74b9-c5ad-48b8-8b0a-370831dbd710,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebac74b9-c5') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:03:b5,bridge_name='br-int',has_traffic_filtering=True,id=ebac74b9-c5ad-48b8-8b0a-370831dbd710,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebac74b9-c5') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebac74b9-c5, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9a8e815f-adb5-4876-acb8-fbac92734e09) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: INFO os_vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:81:03:b5,bridge_name='br-int',has_traffic_filtering=True,id=ebac74b9-c5ad-48b8-8b0a-370831dbd710,network=Network(ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapebac74b9-c5')
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:06:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "address": "fa:16:3e:79:9b:bb", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e47a50-c8", "ovs_interfaceid": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "address": "fa:16:3e:79:9b:bb", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5e47a50-c8", "ovs_interfaceid": "f5e47a50-c8fb-46e8-9f8b-54470f96061e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:9b:bb,bridge_name='br-int',has_traffic_filtering=True,id=f5e47a50-c8fb-46e8-9f8b-54470f96061e,network=Network(14d6a553-2afd-4f57-9332-8107fa123909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e47a50-c8') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:9b:bb,bridge_name='br-int',has_traffic_filtering=True,id=f5e47a50-c8fb-46e8-9f8b-54470f96061e,network=Network(14d6a553-2afd-4f57-9332-8107fa123909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e47a50-c8') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5e47a50-c8, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cf619f6f-a25c-4cc4-9326-43785a55cfec) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: INFO os_vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:9b:bb,bridge_name='br-int',has_traffic_filtering=True,id=f5e47a50-c8fb-46e8-9f8b-54470f96061e,network=Network(14d6a553-2afd-4f57-9332-8107fa123909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5e47a50-c8')
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:05:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-718064377',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-718064377',id=12,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG42E99dYuOFF4Si7hwkm0LUzUUP1p26AerSGQM7RhFIXIVjNtHPztR8OG5QdjOpckYfDjE/7nK2UF9eTPAxV80ju+Nv6Q9GiwtRJ/f0P8UGJeswcPmrFbeLaliiGy1iYw==',key_name='tempest-keypair-1499360251',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:06:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='934523cf034040e2bc013e8469759699',ramdisk_id='',reservation_id='r-j7ghcfhd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1060458579',owner_user_name='tempest-TaggedBootDevicesTest-1060458579-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:06:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1691c4936b8d40a4a316785d7b19f2d0',uuid=a77f802c-7ee6-4596-ac65-221e2a6bb533,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "address": "fa:16:3e:57:89:56", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd45e11fc-f0", "ovs_interfaceid": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converting VIF {"id": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "address": "fa:16:3e:57:89:56", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd45e11fc-f0", "ovs_interfaceid": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:89:56,bridge_name='br-int',has_traffic_filtering=True,id=d45e11fc-f0b3-4bd3-92d3-9508adbcd839,network=Network(14d6a553-2afd-4f57-9332-8107fa123909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd45e11fc-f0') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:89:56,bridge_name='br-int',has_traffic_filtering=True,id=d45e11fc-f0b3-4bd3-92d3-9508adbcd839,network=Network(14d6a553-2afd-4f57-9332-8107fa123909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd45e11fc-f0') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd45e11fc-f0, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a2559b5-e0be-4aef-b99f-6a867c944d76) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:06 user nova-compute[74242]: INFO os_vif [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:89:56,bridge_name='br-int',has_traffic_filtering=True,id=d45e11fc-f0b3-4bd3-92d3-9508adbcd839,network=Network(14d6a553-2afd-4f57-9332-8107fa123909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd45e11fc-f0')
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fqPCvVjc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:08:06 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d6e4b2-10d4-4ab3-8235-84ba185f59d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:08:06 user nova-compute[74242]: No targets found.
Oct 20 02:08:06 user nova-compute[74242]: iSNS:
Oct 20 02:08:06 user nova-compute[74242]: No targets found.
Oct 20 02:08:06 user nova-compute[74242]: STATIC:
Oct 20 02:08:06 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3
Oct 20 02:08:06 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:08:06 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:08:06 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd
Oct 20 02:08:06 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:08:06 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:08:06 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e
Oct 20 02:08:06 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:08:06 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:08:06 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68
Oct 20 02:08:06 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:08:06 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:08:06 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8
Oct 20 02:08:06 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:08:06 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:08:06 user nova-compute[74242]: FIRMWARE:
Oct 20 02:08:06 user nova-compute[74242]: No targets found.
Oct 20 02:08:06 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:08:06 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:08:06 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c40de290-0974-469b-9ab0-07f6ee4e5b4a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[86c17472-070d-451a-a946-b2983818d284]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:08:06 user nova-compute[74242]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:08:06 user nova-compute[74242]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:08:06 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:08:06 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:08:06 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:08:06 user nova-compute[74242]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:08:06 user nova-compute[74242]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:08:06 user nova-compute[74242]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e (non-flash)
Oct 20 02:08:06 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:08:06 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b84d6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e'): ({'sdb'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Removing single pathed devices sdb {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[771dbc3d-872a-4bbf-9a26-021ae35d2be8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a08cc0-b4c5-488d-abc1-59e04e4c200e]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Flushing IO for device /dev/sdb {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aee22fb-459c-4795-8d7e-dac9c3a7a162]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad25ddaf-26c3-417f-a663-c94581f0f993]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef1da3b-3f35-4ea7-a859-45bf708b4b08]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c817a6a1-ef31-4612-8160-9574412fc795]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e, portal: 172.16.0.220,3260]
Oct 20 02:08:06 user nova-compute[74242]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e, portal: 172.16.0.220,3260] successful.
Oct 20 02:08:06 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:90ae876e-4e5a-4a4a-8bb0-e98910d1c67e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4389bb83-ef18-41c5-b18c-3cb50dd918a3]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] <== disconnect_volume: return (354ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'naQdeiBL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:08:06 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[135af51b-6baf-48f7-99c9-fe9efd0f0a04]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:08:06 user nova-compute[74242]: No targets found.
Oct 20 02:08:06 user nova-compute[74242]: iSNS:
Oct 20 02:08:06 user nova-compute[74242]: No targets found.
Oct 20 02:08:06 user nova-compute[74242]: STATIC:
Oct 20 02:08:06 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3
Oct 20 02:08:06 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:08:06 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:08:06 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd
Oct 20 02:08:06 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:08:06 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:08:06 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68
Oct 20 02:08:06 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:08:06 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:08:06 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8
Oct 20 02:08:06 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:08:06 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:08:06 user nova-compute[74242]: FIRMWARE:
Oct 20 02:08:06 user nova-compute[74242]: No targets found.
Oct 20 02:08:06 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:08:06 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:08:06 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf890a8-28f0-48b2-9b85-baa0f2cc1575]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4799ea-33c6-457d-8860-4525146784fa]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:08:06 user nova-compute[74242]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:08:06 user nova-compute[74242]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:08:06 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:08:06 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:08:06 user nova-compute[74242]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:08:06 user nova-compute[74242]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:08:06 user nova-compute[74242]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd (non-flash)
Oct 20 02:08:06 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b84d6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd'): ({'sdc'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Removing single pathed devices sdc {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f7dd14-3ca4-446b-b829-b60d8c7acb1a]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c467a466-15b1-4786-9065-c8bfe0e1b22b]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Flushing IO for device /dev/sdc {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d631727-ff22-4d39-8bf3-d83220cbbcee]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:08:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5343e97-eb9c-4c66-a308-60934de5d8e1]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a642ad-9fb2-4bd3-bc66-915c41d4f861]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f7bf10-c181-49de-9087-1afe16cefb59]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd, portal: 172.16.0.220,3260]
Oct 20 02:08:07 user nova-compute[74242]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd, portal: 172.16.0.220,3260] successful.
Oct 20 02:08:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f690cba-01ce-436f-80c3-20a1c9f0d8cd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f151bc-2c60-4981-9b1b-e661c79216db]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] <== disconnect_volume: return (353ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hcLatbwj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:08:07 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3aa0dc-c6bc-40e0-b186-d8ae8aab1b7f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:08:07 user nova-compute[74242]: No targets found.
Oct 20 02:08:07 user nova-compute[74242]: iSNS:
Oct 20 02:08:07 user nova-compute[74242]: No targets found.
Oct 20 02:08:07 user nova-compute[74242]: STATIC:
Oct 20 02:08:07 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3
Oct 20 02:08:07 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:08:07 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:08:07 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68
Oct 20 02:08:07 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:08:07 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:08:07 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8
Oct 20 02:08:07 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:08:07 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:08:07 user nova-compute[74242]: FIRMWARE:
Oct 20 02:08:07 user nova-compute[74242]: No targets found.
Oct 20 02:08:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:08:07 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:08:07 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[539c101c-fd03-4330-aa20-428ac5bc1e10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c87e253-cf17-43ce-a3f3-fa576cb367ea]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:08:07 user nova-compute[74242]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:08:07 user nova-compute[74242]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:08:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 (non-flash)
Oct 20 02:08:07 user nova-compute[74242]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:08:07 user nova-compute[74242]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:08:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b84d6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8'): ({'sdd'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Removing single pathed devices sdd {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c159f01-a41b-4e74-835c-8ddd7db5961c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b3a788-4c07-4870-a675-82ee710ff9a0]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Flushing IO for device /dev/sdd {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d6eb0e-8ade-4219-b19f-eb1a60937b81]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5891f70f-cf30-426e-9972-64f7eda90dec]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b7b1f7-7f9c-419d-b477-02a4f88482d9]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b0deda9-bf0e-4467-8cd3-893cff4cdf30]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8, portal: 172.16.0.220,3260]
Oct 20 02:08:07 user nova-compute[74242]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8, portal: 172.16.0.220,3260] successful.
Oct 20 02:08:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e065c065-f373-44f2-a086-d493ba3a0bd8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.046s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbdac9f7-2935-4bc1-bc01-b1399267784a]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] <== disconnect_volume: return (356ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:08:07 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Deleting instance files /opt/stack/data/nova/instances/a77f802c-7ee6-4596-ac65-221e2a6bb533_del
Oct 20 02:08:07 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Deletion of /opt/stack/data/nova/instances/a77f802c-7ee6-4596-ac65-221e2a6bb533_del complete
Oct 20 02:08:07 user nova-compute[74242]: INFO nova.compute.manager [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Took 4.36 seconds to destroy the instance on the hypervisor.
Oct 20 02:08:07 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:08:07 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:08:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:09 user nova-compute[74242]: DEBUG nova.compute.manager [req-701be71b-2b50-4e34-ada3-491d90e5c602 req-4af6e72a-ec9a-4eb7-9365-228290f72830 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-deleted-f5e47a50-c8fb-46e8-9f8b-54470f96061e {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:09 user nova-compute[74242]: INFO nova.compute.manager [req-701be71b-2b50-4e34-ada3-491d90e5c602 req-4af6e72a-ec9a-4eb7-9365-228290f72830 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Neutron deleted interface f5e47a50-c8fb-46e8-9f8b-54470f96061e; detaching it from the instance and deleting it from the info cache
Oct 20 02:08:09 user nova-compute[74242]: DEBUG nova.network.neutron [req-701be71b-2b50-4e34-ada3-491d90e5c602 req-4af6e72a-ec9a-4eb7-9365-228290f72830 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updating instance_info_cache with network_info: [{"id": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "address": "fa:16:3e:1b:f2:1f", "network": {"id": "b7bde1f3-dede-4765-9ea9-d294203c607f", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2003879386-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.11", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc809bd71-9a", "ovs_interfaceid": "c809bd71-9a30-4d1c-9884-b2881cd21f70", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2de0cc37-2422-461f-8a4a-3b77033ce618", "address": "fa:16:3e:bc:54:72", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.79", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2de0cc37-24", "ovs_interfaceid": "2de0cc37-2422-461f-8a4a-3b77033ce618", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "address": "fa:16:3e:bf:06:d5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap87632b36-c7", "ovs_interfaceid": "87632b36-c7fb-47e4-a792-cf94f02ac6f3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "67449c80-5905-4656-9c55-45460e214374", "address": "fa:16:3e:6e:a7:08", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.240", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap67449c80-59", "ovs_interfaceid": "67449c80-5905-4656-9c55-45460e214374", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "address": "fa:16:3e:81:03:b5", "network": {"id": "ac681f7e-35c4-4df7-8d15-4a3fa2f0ce5a", "bridge": "br-int", "label": "tempest-device-tagging-net1-130797112", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.216", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapebac74b9-c5", "ovs_interfaceid": "ebac74b9-c5ad-48b8-8b0a-370831dbd710", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "address": "fa:16:3e:57:89:56", "network": {"id": "14d6a553-2afd-4f57-9332-8107fa123909", "bridge": "br-int", "label": "tempest-device-tagging-net2-763465204", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "934523cf034040e2bc013e8469759699", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd45e11fc-f0", "ovs_interfaceid": "d45e11fc-f0b3-4bd3-92d3-9508adbcd839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:08:09 user nova-compute[74242]: DEBUG nova.compute.manager [req-701be71b-2b50-4e34-ada3-491d90e5c602 req-4af6e72a-ec9a-4eb7-9365-228290f72830 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Detach interface failed, port_id=f5e47a50-c8fb-46e8-9f8b-54470f96061e, reason: Instance a77f802c-7ee6-4596-ac65-221e2a6bb533 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:08:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:11 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:08:11 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Took 3.75 seconds to deallocate network for instance.
Oct 20 02:08:11 user nova-compute[74242]: DEBUG nova.compute.manager [req-98cd060b-8953-445d-99cf-5bd7ffe2a9ab req-086a2858-198e-4379-bbfb-807ffd225926 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-deleted-d45e11fc-f0b3-4bd3-92d3-9508adbcd839 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:11 user nova-compute[74242]: DEBUG nova.compute.manager [req-98cd060b-8953-445d-99cf-5bd7ffe2a9ab req-086a2858-198e-4379-bbfb-807ffd225926 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-deleted-67449c80-5905-4656-9c55-45460e214374 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:11 user nova-compute[74242]: DEBUG nova.compute.manager [req-98cd060b-8953-445d-99cf-5bd7ffe2a9ab req-086a2858-198e-4379-bbfb-807ffd225926 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-deleted-c809bd71-9a30-4d1c-9884-b2881cd21f70 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:11 user nova-compute[74242]: DEBUG nova.compute.manager [req-98cd060b-8953-445d-99cf-5bd7ffe2a9ab req-086a2858-198e-4379-bbfb-807ffd225926 service nova] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Received event network-vif-deleted-ebac74b9-c5ad-48b8-8b0a-370831dbd710 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:14 user nova-compute[74242]: INFO nova.compute.manager [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] [instance: a77f802c-7ee6-4596-ac65-221e2a6bb533] Took 2.66 seconds to detach 3 volumes for instance.
Oct 20 02:08:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:14 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:08:14 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:08:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.450s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:14 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Deleted allocations for instance a77f802c-7ee6-4596-ac65-221e2a6bb533
Oct 20 02:08:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b603b8ab-57a0-4a90-a231-6923dc8ad1eb tempest-TaggedBootDevicesTest-1060458579 tempest-TaggedBootDevicesTest-1060458579-project-member] Lock "a77f802c-7ee6-4596-ac65-221e2a6bb533" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.461s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:18 user nova-compute[74242]: DEBUG nova.compute.manager [req-9b2de12e-4ec1-48dd-b638-323b1842da42 req-92e7c27e-2256-4678-87d2-76d6aa742285 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received event network-changed-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:18 user nova-compute[74242]: DEBUG nova.compute.manager [req-9b2de12e-4ec1-48dd-b638-323b1842da42 req-92e7c27e-2256-4678-87d2-76d6aa742285 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Refreshing instance network info cache due to event network-changed-c358f4c8-2f05-4449-af69-dd6108ecf241. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:08:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9b2de12e-4ec1-48dd-b638-323b1842da42 req-92e7c27e-2256-4678-87d2-76d6aa742285 service nova] Acquiring lock "refresh_cache-c909c918-59a9-42fe-99fe-72431ba43443" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:08:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9b2de12e-4ec1-48dd-b638-323b1842da42 req-92e7c27e-2256-4678-87d2-76d6aa742285 service nova] Acquired lock "refresh_cache-c909c918-59a9-42fe-99fe-72431ba43443" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:08:18 user nova-compute[74242]: DEBUG nova.network.neutron [req-9b2de12e-4ec1-48dd-b638-323b1842da42 req-92e7c27e-2256-4678-87d2-76d6aa742285 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Refreshing network info cache for port c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG nova.network.neutron [req-9b2de12e-4ec1-48dd-b638-323b1842da42 req-92e7c27e-2256-4678-87d2-76d6aa742285 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Updated VIF entry in instance network info cache for port c358f4c8-2f05-4449-af69-dd6108ecf241. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG nova.network.neutron [req-9b2de12e-4ec1-48dd-b638-323b1842da42 req-92e7c27e-2256-4678-87d2-76d6aa742285 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Updating instance_info_cache with network_info: [{"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9b2de12e-4ec1-48dd-b638-323b1842da42 req-92e7c27e-2256-4678-87d2-76d6aa742285 service nova] Releasing lock "refresh_cache-c909c918-59a9-42fe-99fe-72431ba43443" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "c909c918-59a9-42fe-99fe-72431ba43443" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "c909c918-59a9-42fe-99fe-72431ba43443" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG nova.objects.instance [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lazy-loading 'flavor' on Instance uuid c909c918-59a9-42fe-99fe-72431ba43443 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "c909c918-59a9-42fe-99fe-72431ba43443" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "c909c918-59a9-42fe-99fe-72431ba43443" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "c909c918-59a9-42fe-99fe-72431ba43443" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:19 user nova-compute[74242]: INFO nova.compute.manager [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Attaching volume 4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 to /dev/vdb
Oct 20 02:08:19 user nova-compute[74242]: DEBUG os_brick.utils [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[51318e4e-f8ef-4270-8a2a-b15f1f46a7dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[50db879c-90d7-4162-80b1-0cde100b1f9d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec04cbe-fffe-415b-a4ee-51414c3295f1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[59a2cca2-5c16-49af-bee5-f69c9e5a4b57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:08:19 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:08:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b989592-d094-4dc4-af01-e725022ec6f1]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG os_brick.utils [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:08:19 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Updating existing volume attachment record: e103310b-e3ae-4fbf-a2e4-3af3f325550f {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:08:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:22 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:08:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:08:25 user nova-compute[74242]: INFO nova.virt.block_device [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Booting with volume 6e34d0dc-134e-4e91-84e6-d16394881d1c at /dev/vdb
Oct 20 02:08:25 user nova-compute[74242]: DEBUG os_brick.utils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e816966-1bf7-423c-82fd-18c6d9db00da]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[af62c77f-4a86-453f-a634-fa3da15df029]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[014a825f-ba1d-4c11-8270-bb595d2f9899]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa39aa5a-b4a9-4377-9431-bc2ef8c414b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:08:25 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:08:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cbced9a-05be-45e2-9232-65fc50966e97]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG os_brick.utils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:08:25 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updating existing volume attachment record: 3061271c-eb0c-4078-a32d-0baf4e257def {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:08:26 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updating instance_info_cache with network_info: [{"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:08:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:08:26 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:08:26 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:08:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:28 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:08:28 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:08:28 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 02:08:28 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] There are 0 instances to clean {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 02:08:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:29 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:08:29 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:08:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "07377280-e3f5-4edd-9501-678dcde42ef3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "07377280-e3f5-4edd-9501-678dcde42ef3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:08:30 user nova-compute[74242]: INFO nova.compute.claims [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Claim successful on node user
Oct 20 02:08:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Refreshing inventories for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Updating ProviderTree inventory for provider 07b40460-b6ac-48c1-8447-e1778d50b26e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Updating inventory in ProviderTree for provider 07b40460-b6ac-48c1-8447-e1778d50b26e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Refreshing aggregate associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, aggregates: None {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Refreshing trait associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:08:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.858s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:31 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:08:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG nova.policy [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00ea297f598040fbb338b9ab2e1a1d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e137c75824d7429585ddd2245f86a6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:08:31 user nova-compute[74242]: INFO nova.virt.block_device [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Booting with volume d4e016a8-0b88-4927-b8eb-7b746a8f1566 at /dev/vda
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG os_brick.utils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[40094957-d527-4f48-a4d1-db54165cc9f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3525800-7bcf-4410-acd4-cb7ac3e63567]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[14bde46d-8ee7-4b70-a710-444095104bd6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b684e4bc-9f49-40fb-97fc-0c220152ea81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:08:32 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2944e9-d4b6-48cf-9114-4d8786fc73c5]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "9701b02d-0874-45f9-a599-8c1809f234c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "9701b02d-0874-45f9-a599-8c1809f234c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG os_brick.utils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Updating existing volume attachment record: 2335752d-5e3d-4fbb-98e2-155e91347a87 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:08:32 user nova-compute[74242]: INFO nova.compute.claims [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Claim successful on node user
Oct 20 02:08:32 user nova-compute[74242]: DEBUG nova.network.neutron [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Successfully created port: 350f4931-f460-4a25-a6b4-dd924304f1fa {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.618s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:08:33 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.network.neutron [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Successfully updated port: 350f4931-f460-4a25-a6b4-dd924304f1fa {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "refresh_cache-07377280-e3f5-4edd-9501-678dcde42ef3" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquired lock "refresh_cache-07377280-e3f5-4edd-9501-678dcde42ef3" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.network.neutron [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.policy [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3069dcf63864aa08f632601c3a849c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74cc27f49384dc78190bd5d9ed7fab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-cf69aa1b-13ef-45fa-889b-9f2340fb5e7d req-9e2975e3-9144-4dc5-828d-c70dc9149f4e service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Received event network-changed-350f4931-f460-4a25-a6b4-dd924304f1fa {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-cf69aa1b-13ef-45fa-889b-9f2340fb5e7d req-9e2975e3-9144-4dc5-828d-c70dc9149f4e service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Refreshing instance network info cache due to event network-changed-350f4931-f460-4a25-a6b4-dd924304f1fa. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cf69aa1b-13ef-45fa-889b-9f2340fb5e7d req-9e2975e3-9144-4dc5-828d-c70dc9149f4e service nova] Acquiring lock "refresh_cache-07377280-e3f5-4edd-9501-678dcde42ef3" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.network.neutron [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:08:33 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Creating image(s)
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "/opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "/opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "/opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:33 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:08:33 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7758MB free_disk=25.403003692626953GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance af9f3d52-79f0-4ce0-9b14-3373b30c2b26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 5cea10bc-ac5a-48b0-b6b7-7db8f520339d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c909c918-59a9-42fe-99fe-72431ba43443 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 626bb196-0e5e-4dfd-8ead-57306c828b13 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7e101002-a175-40fe-b5ca-04a58610f60d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 72003d17-9292-4bdd-acfc-0d3f7e40df80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 07377280-e3f5-4edd-9501-678dcde42ef3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 9701b02d-0874-45f9-a599-8c1809f234c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.network.neutron [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Updating instance_info_cache with network_info: [{"id": "350f4931-f460-4a25-a6b4-dd924304f1fa", "address": "fa:16:3e:4f:12:07", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f4931-f4", "ovs_interfaceid": "350f4931-f460-4a25-a6b4-dd924304f1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Releasing lock "refresh_cache-07377280-e3f5-4edd-9501-678dcde42ef3" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Instance network_info: |[{"id": "350f4931-f460-4a25-a6b4-dd924304f1fa", "address": "fa:16:3e:4f:12:07", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f4931-f4", "ovs_interfaceid": "350f4931-f460-4a25-a6b4-dd924304f1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cf69aa1b-13ef-45fa-889b-9f2340fb5e7d req-9e2975e3-9144-4dc5-828d-c70dc9149f4e service nova] Acquired lock "refresh_cache-07377280-e3f5-4edd-9501-678dcde42ef3" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG nova.network.neutron [req-cf69aa1b-13ef-45fa-889b-9f2340fb5e7d req-9e2975e3-9144-4dc5-828d-c70dc9149f4e service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Refreshing network info cache for port 350f4931-f460-4a25-a6b4-dd924304f1fa {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.178s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk 1073741824" returned: 0 in 0.056s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.238s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Successfully created port: 43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.704s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74242) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Cannot resize image /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Ensure instance console log exists: /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG nova.network.neutron [req-cf69aa1b-13ef-45fa-889b-9f2340fb5e7d req-9e2975e3-9144-4dc5-828d-c70dc9149f4e service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Updated VIF entry in instance network info cache for port 350f4931-f460-4a25-a6b4-dd924304f1fa. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG nova.network.neutron [req-cf69aa1b-13ef-45fa-889b-9f2340fb5e7d req-9e2975e3-9144-4dc5-828d-c70dc9149f4e service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Updating instance_info_cache with network_info: [{"id": "350f4931-f460-4a25-a6b4-dd924304f1fa", "address": "fa:16:3e:4f:12:07", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f4931-f4", "ovs_interfaceid": "350f4931-f460-4a25-a6b4-dd924304f1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:08:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cf69aa1b-13ef-45fa-889b-9f2340fb5e7d req-9e2975e3-9144-4dc5-828d-c70dc9149f4e service nova] Releasing lock "refresh_cache-07377280-e3f5-4edd-9501-678dcde42ef3" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Successfully updated port: 43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "refresh_cache-9701b02d-0874-45f9-a599-8c1809f234c4" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquired lock "refresh_cache-9701b02d-0874-45f9-a599-8c1809f234c4" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-dc9e8bf4-5bb2-49d6-85f6-b93a2b5a0b3e req-6023976a-5b6b-420c-9e1e-2b57b731194c service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Received event network-changed-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-dc9e8bf4-5bb2-49d6-85f6-b93a2b5a0b3e req-6023976a-5b6b-420c-9e1e-2b57b731194c service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Refreshing instance network info cache due to event network-changed-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dc9e8bf4-5bb2-49d6-85f6-b93a2b5a0b3e req-6023976a-5b6b-420c-9e1e-2b57b731194c service nova] Acquiring lock "refresh_cache-9701b02d-0874-45f9-a599-8c1809f234c4" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Updating instance_info_cache with network_info: [{"id": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "address": "fa:16:3e:e1:15:28", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e139d5-eb", "ovs_interfaceid": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Releasing lock "refresh_cache-9701b02d-0874-45f9-a599-8c1809f234c4" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Instance network_info: |[{"id": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "address": "fa:16:3e:e1:15:28", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e139d5-eb", "ovs_interfaceid": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dc9e8bf4-5bb2-49d6-85f6-b93a2b5a0b3e req-6023976a-5b6b-420c-9e1e-2b57b731194c service nova] Acquired lock "refresh_cache-9701b02d-0874-45f9-a599-8c1809f234c4" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.network.neutron [req-dc9e8bf4-5bb2-49d6-85f6-b93a2b5a0b3e req-6023976a-5b6b-420c-9e1e-2b57b731194c service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Refreshing network info cache for port 43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Start _get_guest_xml network_info=[{"id": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "address": "fa:16:3e:e1:15:28", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e139d5-eb", "ovs_interfaceid": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:08:35 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:08:35 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-63314056',display_name='tempest-AttachVolumeNegativeTest-server-63314056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-63314056',id=18,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVvyBGciRCF5fdmnYrWGYf7HiyXj14nRIrjn/qDT8dE6QmmwdELLokrSQV3HZ69aNjb7Mc190xXKFoZzBdV9yqR3oa1xG3SwLr8v5ik6tErR5erIFmdaPKYsScJT/pM5Q==',key_name='tempest-keypair-1358821306',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e74cc27f49384dc78190bd5d9ed7fab9',ramdisk_id='',reservation_id='r-wh6jvh6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1292543897',owner_user_name='tempest-AttachVolumeNegativeTest-1292543897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3069dcf63864aa08f632601c3a849c5',uuid=9701b02d-0874-45f9-a599-8c1809f234c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "address": "fa:16:3e:e1:15:28", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e139d5-eb", "ovs_interfaceid": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converting VIF {"id": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "address": "fa:16:3e:e1:15:28", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e139d5-eb", "ovs_interfaceid": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:15:28,bridge_name='br-int',has_traffic_filtering=True,id=43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e139d5-eb') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lazy-loading 'pci_devices' on Instance uuid 9701b02d-0874-45f9-a599-8c1809f234c4 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:08:35 user nova-compute[74242]:   <uuid>9701b02d-0874-45f9-a599-8c1809f234c4</uuid>
Oct 20 02:08:35 user nova-compute[74242]:   <name>instance-00000012</name>
Oct 20 02:08:35 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:08:35 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:08:35 user nova-compute[74242]:   <metadata>
Oct 20 02:08:35 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:08:35 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:08:35 user nova-compute[74242]:       <nova:name>tempest-AttachVolumeNegativeTest-server-63314056</nova:name>
Oct 20 02:08:35 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:08:35</nova:creationTime>
Oct 20 02:08:35 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:08:35 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:08:35 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:08:35 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:08:35 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:08:35 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:08:35 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:08:35 user nova-compute[74242]:       <nova:owner>
Oct 20 02:08:35 user nova-compute[74242]:         <nova:user uuid="d3069dcf63864aa08f632601c3a849c5">tempest-AttachVolumeNegativeTest-1292543897-project-member</nova:user>
Oct 20 02:08:35 user nova-compute[74242]:         <nova:project uuid="e74cc27f49384dc78190bd5d9ed7fab9">tempest-AttachVolumeNegativeTest-1292543897</nova:project>
Oct 20 02:08:35 user nova-compute[74242]:       </nova:owner>
Oct 20 02:08:35 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:08:35 user nova-compute[74242]:       <nova:ports>
Oct 20 02:08:35 user nova-compute[74242]:         <nova:port uuid="43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb">
Oct 20 02:08:35 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 02:08:35 user nova-compute[74242]:         </nova:port>
Oct 20 02:08:35 user nova-compute[74242]:       </nova:ports>
Oct 20 02:08:35 user nova-compute[74242]:     </nova:instance>
Oct 20 02:08:35 user nova-compute[74242]:   </metadata>
Oct 20 02:08:35 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:08:35 user nova-compute[74242]:     <system>
Oct 20 02:08:35 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:08:35 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:08:35 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:08:35 user nova-compute[74242]:       <entry name="serial">9701b02d-0874-45f9-a599-8c1809f234c4</entry>
Oct 20 02:08:35 user nova-compute[74242]:       <entry name="uuid">9701b02d-0874-45f9-a599-8c1809f234c4</entry>
Oct 20 02:08:35 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:08:35 user nova-compute[74242]:     </system>
Oct 20 02:08:35 user nova-compute[74242]:   </sysinfo>
Oct 20 02:08:35 user nova-compute[74242]:   <os>
Oct 20 02:08:35 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:08:35 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:08:35 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:08:35 user nova-compute[74242]:   </os>
Oct 20 02:08:35 user nova-compute[74242]:   <features>
Oct 20 02:08:35 user nova-compute[74242]:     <acpi/>
Oct 20 02:08:35 user nova-compute[74242]:     <apic/>
Oct 20 02:08:35 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:08:35 user nova-compute[74242]:   </features>
Oct 20 02:08:35 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:08:35 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:08:35 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:08:35 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:08:35 user nova-compute[74242]:   </clock>
Oct 20 02:08:35 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:08:35 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:08:35 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:08:35 user nova-compute[74242]:   </cpu>
Oct 20 02:08:35 user nova-compute[74242]:   <devices>
Oct 20 02:08:35 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:08:35 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:08:35 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk"/>
Oct 20 02:08:35 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:08:35 user nova-compute[74242]:     </disk>
Oct 20 02:08:35 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:08:35 user nova-compute[74242]:       <mac address="fa:16:3e:e1:15:28"/>
Oct 20 02:08:35 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:08:35 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:08:35 user nova-compute[74242]:       <target dev="tap43e139d5-eb"/>
Oct 20 02:08:35 user nova-compute[74242]:     </interface>
Oct 20 02:08:35 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:08:35 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/console.log" append="off"/>
Oct 20 02:08:35 user nova-compute[74242]:     </serial>
Oct 20 02:08:35 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:08:35 user nova-compute[74242]:     <video>
Oct 20 02:08:35 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:08:35 user nova-compute[74242]:     </video>
Oct 20 02:08:35 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:08:35 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:08:35 user nova-compute[74242]:     </rng>
Oct 20 02:08:35 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:08:35 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:08:35 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:08:35 user nova-compute[74242]:     </memballoon>
Oct 20 02:08:35 user nova-compute[74242]:   </devices>
Oct 20 02:08:35 user nova-compute[74242]: </domain>
Oct 20 02:08:35 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-63314056',display_name='tempest-AttachVolumeNegativeTest-server-63314056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-63314056',id=18,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVvyBGciRCF5fdmnYrWGYf7HiyXj14nRIrjn/qDT8dE6QmmwdELLokrSQV3HZ69aNjb7Mc190xXKFoZzBdV9yqR3oa1xG3SwLr8v5ik6tErR5erIFmdaPKYsScJT/pM5Q==',key_name='tempest-keypair-1358821306',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e74cc27f49384dc78190bd5d9ed7fab9',ramdisk_id='',reservation_id='r-wh6jvh6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1292543897',owner_user_name='tempest-AttachVolumeNegativeTest-1292543897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:08:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3069dcf63864aa08f632601c3a849c5',uuid=9701b02d-0874-45f9-a599-8c1809f234c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "address": "fa:16:3e:e1:15:28", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e139d5-eb", "ovs_interfaceid": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converting VIF {"id": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "address": "fa:16:3e:e1:15:28", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e139d5-eb", "ovs_interfaceid": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:15:28,bridge_name='br-int',has_traffic_filtering=True,id=43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e139d5-eb') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG os_vif [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:15:28,bridge_name='br-int',has_traffic_filtering=True,id=43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e139d5-eb') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1e1940fe-a7b9-5257-9ba5-2164273005b7', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43e139d5-eb, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43e139d5-eb, col_values=(('qos', UUID('3507b63a-b37a-494c-938d-f3498a9400ab')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43e139d5-eb, col_values=(('external_ids', {'iface-id': '43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:15:28', 'vm-uuid': '9701b02d-0874-45f9-a599-8c1809f234c4'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:35 user nova-compute[74242]: INFO os_vif [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:15:28,bridge_name='br-int',has_traffic_filtering=True,id=43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e139d5-eb')
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] No VIF found with MAC fa:16:3e:e1:15:28, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.network.neutron [req-dc9e8bf4-5bb2-49d6-85f6-b93a2b5a0b3e req-6023976a-5b6b-420c-9e1e-2b57b731194c service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Updated VIF entry in instance network info cache for port 43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG nova.network.neutron [req-dc9e8bf4-5bb2-49d6-85f6-b93a2b5a0b3e req-6023976a-5b6b-420c-9e1e-2b57b731194c service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Updating instance_info_cache with network_info: [{"id": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "address": "fa:16:3e:e1:15:28", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e139d5-eb", "ovs_interfaceid": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:08:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dc9e8bf4-5bb2-49d6-85f6-b93a2b5a0b3e req-6023976a-5b6b-420c-9e1e-2b57b731194c service nova] Releasing lock "refresh_cache-9701b02d-0874-45f9-a599-8c1809f234c4" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:08:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-10de1806-fb28-4493-ae48-0e4945ebb47b req-23e5e33e-fdc8-4bc5-b881-bb28b8573981 service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Received event network-vif-plugged-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-10de1806-fb28-4493-ae48-0e4945ebb47b req-23e5e33e-fdc8-4bc5-b881-bb28b8573981 service nova] Acquiring lock "9701b02d-0874-45f9-a599-8c1809f234c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-10de1806-fb28-4493-ae48-0e4945ebb47b req-23e5e33e-fdc8-4bc5-b881-bb28b8573981 service nova] Lock "9701b02d-0874-45f9-a599-8c1809f234c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-10de1806-fb28-4493-ae48-0e4945ebb47b req-23e5e33e-fdc8-4bc5-b881-bb28b8573981 service nova] Lock "9701b02d-0874-45f9-a599-8c1809f234c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-10de1806-fb28-4493-ae48-0e4945ebb47b req-23e5e33e-fdc8-4bc5-b881-bb28b8573981 service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] No waiting events found dispatching network-vif-plugged-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:37 user nova-compute[74242]: WARNING nova.compute.manager [req-10de1806-fb28-4493-ae48-0e4945ebb47b req-23e5e33e-fdc8-4bc5-b881-bb28b8573981 service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Received unexpected event network-vif-plugged-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb for instance with vm_state building and task_state spawning.
Oct 20 02:08:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-bc3ca46d-057d-41c2-825b-7f1bd62a486d req-d5480aac-2538-46c9-be55-2ad95d73024c service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Received event network-vif-plugged-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bc3ca46d-057d-41c2-825b-7f1bd62a486d req-d5480aac-2538-46c9-be55-2ad95d73024c service nova] Acquiring lock "9701b02d-0874-45f9-a599-8c1809f234c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bc3ca46d-057d-41c2-825b-7f1bd62a486d req-d5480aac-2538-46c9-be55-2ad95d73024c service nova] Lock "9701b02d-0874-45f9-a599-8c1809f234c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bc3ca46d-057d-41c2-825b-7f1bd62a486d req-d5480aac-2538-46c9-be55-2ad95d73024c service nova] Lock "9701b02d-0874-45f9-a599-8c1809f234c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-bc3ca46d-057d-41c2-825b-7f1bd62a486d req-d5480aac-2538-46c9-be55-2ad95d73024c service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] No waiting events found dispatching network-vif-plugged-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:39 user nova-compute[74242]: WARNING nova.compute.manager [req-bc3ca46d-057d-41c2-825b-7f1bd62a486d req-d5480aac-2538-46c9-be55-2ad95d73024c service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Received unexpected event network-vif-plugged-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb for instance with vm_state building and task_state spawning.
Oct 20 02:08:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:08:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:08:39 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Instance spawned successfully.
Oct 20 02:08:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:08:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:08:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:08:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:08:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:08:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:08:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:08:39 user nova-compute[74242]: INFO nova.compute.manager [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Took 6.22 seconds to spawn the instance on the hypervisor.
Oct 20 02:08:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:08:39 user nova-compute[74242]: INFO nova.compute.manager [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Took 7.66 seconds to build instance.
Oct 20 02:08:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8bc94ac4-1a7b-4bc9-8c0d-10db0147bfbc tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "9701b02d-0874-45f9-a599-8c1809f234c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.864s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:08:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:08:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:08:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:08:51 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Creating image(s)
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Ensure instance console log exists: /opt/stack/data/nova/instances/07377280-e3f5-4edd-9501-678dcde42ef3/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Start _get_guest_xml network_info=[{"id": "350f4931-f460-4a25-a6b4-dd924304f1fa", "address": "fa:16:3e:4f:12:07", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f4931-f4", "ovs_interfaceid": "350f4931-f460-4a25-a6b4-dd924304f1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '2335752d-5e3d-4fbb-98e2-155e91347a87', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdPNHECz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '07377280-e3f5-4edd-9501-678dcde42ef3', 'attached_at': '', 'detached_at': '', 'volume_id': 'd4e016a8-0b88-4927-b8eb-7b746a8f1566', 'serial': 'd4e016a8-0b88-4927-b8eb-7b746a8f1566'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:08:51 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:08:51 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdPNHECz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:08:51 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:08:51 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:08:51 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260" returned: 21 in 0.029s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a22a740-9164-4696-9b96-9541db0410e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:08:51 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b21cb13-1347-45b3-a1d4-71db94a09a4e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566] added
Oct 20 02:08:51 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef4f5bb-778f-4ab3-a722-13e10e0a279b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[063a17ac-b5a4-4d45-bbfc-c81300286c85]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdPNHECz {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZdPNHECz" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fffffe13-ed05-4023-99b1-f1e2b99328f1]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZdPNHECz'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d674dc-f560-4654-869a-6f4699eea12c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ba10ca-4350-4ced-8db5-60bceb135e37]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:08:51 user nova-compute[74242]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:08:51 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:08:51 user nova-compute[74242]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:08:51 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a676176-e313-418c-a9a9-060535964f0f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566, portal: 172.16.0.220,3260]
Oct 20 02:08:51 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566, portal: 172.16.0.220,3260] successful.
Oct 20 02:08:51 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfcf5acc-8a85-43c5-934e-c43463755558]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2d7981-08eb-4a42-ac49-77e5d20f3bdd]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:08:51 user nova-compute[74242]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:08:51 user nova-compute[74242]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:08:51 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:08:51 user nova-compute[74242]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:08:51 user nova-compute[74242]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:08:51 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ea7f2f-325b-4e96-b8d3-158b7b3e9206]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdPNHECz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:08:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.395s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== connect_volume: return (1397ms) {'type': 'block', 'scsi_wwn': '23930363565656264', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930363565656264', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-634314520',display_name='tempest-TestVolumeBootPattern-volume-backed-server-634314520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-634314520',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOefACBNESIhBRfSc7v2UAdeZB/MUSdCyw436HH1ifDOPynC/IoShbLLSPIKB0UaN+tUuO6lVl0IuEPAeoFrxYCSiHp843fLX1kqum07o6bC6HrKCMhnTJ2YcC4nvEDEQ==',key_name='tempest-keypair-1754181026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-qfxq3s8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:08:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=07377280-e3f5-4edd-9501-678dcde42ef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "350f4931-f460-4a25-a6b4-dd924304f1fa", "address": "fa:16:3e:4f:12:07", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f4931-f4", "ovs_interfaceid": "350f4931-f460-4a25-a6b4-dd924304f1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "350f4931-f460-4a25-a6b4-dd924304f1fa", "address": "fa:16:3e:4f:12:07", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f4931-f4", "ovs_interfaceid": "350f4931-f460-4a25-a6b4-dd924304f1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:12:07,bridge_name='br-int',has_traffic_filtering=True,id=350f4931-f460-4a25-a6b4-dd924304f1fa,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350f4931-f4') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG nova.objects.instance [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lazy-loading 'pci_devices' on Instance uuid 07377280-e3f5-4edd-9501-678dcde42ef3 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:08:52 user nova-compute[74242]:   <uuid>07377280-e3f5-4edd-9501-678dcde42ef3</uuid>
Oct 20 02:08:52 user nova-compute[74242]:   <name>instance-00000011</name>
Oct 20 02:08:52 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:08:52 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:08:52 user nova-compute[74242]:   <metadata>
Oct 20 02:08:52 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:08:52 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:08:52 user nova-compute[74242]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-634314520</nova:name>
Oct 20 02:08:52 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:08:51</nova:creationTime>
Oct 20 02:08:52 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:08:52 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:08:52 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:08:52 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:08:52 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:08:52 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:08:52 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:08:52 user nova-compute[74242]:       <nova:owner>
Oct 20 02:08:52 user nova-compute[74242]:         <nova:user uuid="00ea297f598040fbb338b9ab2e1a1d3a">tempest-TestVolumeBootPattern-882774340-project-member</nova:user>
Oct 20 02:08:52 user nova-compute[74242]:         <nova:project uuid="e137c75824d7429585ddd2245f86a6d0">tempest-TestVolumeBootPattern-882774340</nova:project>
Oct 20 02:08:52 user nova-compute[74242]:       </nova:owner>
Oct 20 02:08:52 user nova-compute[74242]:       <nova:ports>
Oct 20 02:08:52 user nova-compute[74242]:         <nova:port uuid="350f4931-f460-4a25-a6b4-dd924304f1fa">
Oct 20 02:08:52 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 02:08:52 user nova-compute[74242]:         </nova:port>
Oct 20 02:08:52 user nova-compute[74242]:       </nova:ports>
Oct 20 02:08:52 user nova-compute[74242]:     </nova:instance>
Oct 20 02:08:52 user nova-compute[74242]:   </metadata>
Oct 20 02:08:52 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:08:52 user nova-compute[74242]:     <system>
Oct 20 02:08:52 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:08:52 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:08:52 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:08:52 user nova-compute[74242]:       <entry name="serial">07377280-e3f5-4edd-9501-678dcde42ef3</entry>
Oct 20 02:08:52 user nova-compute[74242]:       <entry name="uuid">07377280-e3f5-4edd-9501-678dcde42ef3</entry>
Oct 20 02:08:52 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:08:52 user nova-compute[74242]:     </system>
Oct 20 02:08:52 user nova-compute[74242]:   </sysinfo>
Oct 20 02:08:52 user nova-compute[74242]:   <os>
Oct 20 02:08:52 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:08:52 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:08:52 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:08:52 user nova-compute[74242]:   </os>
Oct 20 02:08:52 user nova-compute[74242]:   <features>
Oct 20 02:08:52 user nova-compute[74242]:     <acpi/>
Oct 20 02:08:52 user nova-compute[74242]:     <apic/>
Oct 20 02:08:52 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:08:52 user nova-compute[74242]:   </features>
Oct 20 02:08:52 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:08:52 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:08:52 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:08:52 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:08:52 user nova-compute[74242]:   </clock>
Oct 20 02:08:52 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:08:52 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:08:52 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:08:52 user nova-compute[74242]:   </cpu>
Oct 20 02:08:52 user nova-compute[74242]:   <devices>
Oct 20 02:08:52 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:08:52 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:08:52 user nova-compute[74242]:       <source dev="/dev/sdb"/>
Oct 20 02:08:52 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:08:52 user nova-compute[74242]:       <serial>d4e016a8-0b88-4927-b8eb-7b746a8f1566</serial>
Oct 20 02:08:52 user nova-compute[74242]:     </disk>
Oct 20 02:08:52 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:08:52 user nova-compute[74242]:       <mac address="fa:16:3e:4f:12:07"/>
Oct 20 02:08:52 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:08:52 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:08:52 user nova-compute[74242]:       <target dev="tap350f4931-f4"/>
Oct 20 02:08:52 user nova-compute[74242]:     </interface>
Oct 20 02:08:52 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:08:52 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/07377280-e3f5-4edd-9501-678dcde42ef3/console.log" append="off"/>
Oct 20 02:08:52 user nova-compute[74242]:     </serial>
Oct 20 02:08:52 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:08:52 user nova-compute[74242]:     <video>
Oct 20 02:08:52 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:08:52 user nova-compute[74242]:     </video>
Oct 20 02:08:52 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:08:52 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:08:52 user nova-compute[74242]:     </rng>
Oct 20 02:08:52 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:08:52 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:08:52 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:08:52 user nova-compute[74242]:     </memballoon>
Oct 20 02:08:52 user nova-compute[74242]:   </devices>
Oct 20 02:08:52 user nova-compute[74242]: </domain>
Oct 20 02:08:52 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-634314520',display_name='tempest-TestVolumeBootPattern-volume-backed-server-634314520',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-634314520',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOefACBNESIhBRfSc7v2UAdeZB/MUSdCyw436HH1ifDOPynC/IoShbLLSPIKB0UaN+tUuO6lVl0IuEPAeoFrxYCSiHp843fLX1kqum07o6bC6HrKCMhnTJ2YcC4nvEDEQ==',key_name='tempest-keypair-1754181026',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-qfxq3s8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:08:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=07377280-e3f5-4edd-9501-678dcde42ef3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "350f4931-f460-4a25-a6b4-dd924304f1fa", "address": "fa:16:3e:4f:12:07", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f4931-f4", "ovs_interfaceid": "350f4931-f460-4a25-a6b4-dd924304f1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "350f4931-f460-4a25-a6b4-dd924304f1fa", "address": "fa:16:3e:4f:12:07", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f4931-f4", "ovs_interfaceid": "350f4931-f460-4a25-a6b4-dd924304f1fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:12:07,bridge_name='br-int',has_traffic_filtering=True,id=350f4931-f460-4a25-a6b4-dd924304f1fa,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350f4931-f4') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG os_vif [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:12:07,bridge_name='br-int',has_traffic_filtering=True,id=350f4931-f460-4a25-a6b4-dd924304f1fa,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350f4931-f4') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '67d2aa9c-283d-5677-89e6-9b0e33c53ac3', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap350f4931-f4, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap350f4931-f4, col_values=(('qos', UUID('5036ba7f-a4a5-41ca-8f52-7d168ee705b7')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap350f4931-f4, col_values=(('external_ids', {'iface-id': '350f4931-f460-4a25-a6b4-dd924304f1fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:12:07', 'vm-uuid': '07377280-e3f5-4edd-9501-678dcde42ef3'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:52 user nova-compute[74242]: INFO os_vif [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:12:07,bridge_name='br-int',has_traffic_filtering=True,id=350f4931-f460-4a25-a6b4-dd924304f1fa,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350f4931-f4')
Oct 20 02:08:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:08:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] No VIF found with MAC fa:16:3e:4f:12:07, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:08:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:53 user nova-compute[74242]: INFO nova.compute.manager [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Terminating instance
Oct 20 02:08:53 user nova-compute[74242]: DEBUG nova.compute.manager [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:08:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:53 user nova-compute[74242]: DEBUG nova.compute.manager [req-6847e0bf-5a22-40c5-9bec-97f57f032fdd req-a78b3599-9ba7-4053-a3ec-26581efd7461 service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received event network-vif-unplugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6847e0bf-5a22-40c5-9bec-97f57f032fdd req-a78b3599-9ba7-4053-a3ec-26581efd7461 service nova] Acquiring lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6847e0bf-5a22-40c5-9bec-97f57f032fdd req-a78b3599-9ba7-4053-a3ec-26581efd7461 service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6847e0bf-5a22-40c5-9bec-97f57f032fdd req-a78b3599-9ba7-4053-a3ec-26581efd7461 service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:53 user nova-compute[74242]: DEBUG nova.compute.manager [req-6847e0bf-5a22-40c5-9bec-97f57f032fdd req-a78b3599-9ba7-4053-a3ec-26581efd7461 service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] No waiting events found dispatching network-vif-unplugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:53 user nova-compute[74242]: DEBUG nova.compute.manager [req-6847e0bf-5a22-40c5-9bec-97f57f032fdd req-a78b3599-9ba7-4053-a3ec-26581efd7461 service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received event network-vif-unplugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:54 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Instance destroyed successfully.
Oct 20 02:08:54 user nova-compute[74242]: DEBUG nova.objects.instance [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lazy-loading 'resources' on Instance uuid 5cea10bc-ac5a-48b0-b6b7-7db8f520339d {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T02:04:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-188573106',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1398678858',id=10,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBByq2xkP/vLfwqbivLj0KOupEkRC+NVhYdkJQ+o9Ygk0jtRSmlqIS+Xl5BP30YNRKfmP8HR4R+7hEidAzKb1ATRlMuwuTOJ2xjm20F8owUQAX54yM4FHVtvIf38i+rcUgw==',key_name='tempest-keypair-522194978',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:07:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='647e5ec77b024268af7209c8a0b73380',ramdisk_id='',reservation_id='r-sntnqamj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-320668090',owner_user_name='tempest-ServerActionsV293TestJSON-320668090-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:07:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='67ba274f41b04cbaa4cbfd77948bb7e6',uuid=5cea10bc-ac5a-48b0-b6b7-7db8f520339d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Converting VIF {"id": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "address": "fa:16:3e:ac:50:3a", "network": {"id": "ba22ead9-82b0-4d2e-82d8-851d65f25ab1", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1084802562-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.141", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "647e5ec77b024268af7209c8a0b73380", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5fe0eca0-44", "ovs_interfaceid": "5fe0eca0-44d0-43d0-acc4-b34fa7126eaf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=5fe0eca0-44d0-43d0-acc4-b34fa7126eaf,network=Network(ba22ead9-82b0-4d2e-82d8-851d65f25ab1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe0eca0-44') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG os_vif [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=5fe0eca0-44d0-43d0-acc4-b34fa7126eaf,network=Network(ba22ead9-82b0-4d2e-82d8-851d65f25ab1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe0eca0-44') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5fe0eca0-44, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c016ad96-2d22-4b7a-b1a9-052f89944c3f) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:54 user nova-compute[74242]: INFO os_vif [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ac:50:3a,bridge_name='br-int',has_traffic_filtering=True,id=5fe0eca0-44d0-43d0-acc4-b34fa7126eaf,network=Network(ba22ead9-82b0-4d2e-82d8-851d65f25ab1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5fe0eca0-44')
Oct 20 02:08:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bkyiaYHc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:08:54 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:08:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6623ce01-93a4-4fbc-aee6-de9a3ff2a223]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:08:54 user nova-compute[74242]: No targets found.
Oct 20 02:08:54 user nova-compute[74242]: iSNS:
Oct 20 02:08:54 user nova-compute[74242]: No targets found.
Oct 20 02:08:54 user nova-compute[74242]: STATIC:
Oct 20 02:08:54 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3
Oct 20 02:08:54 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:08:54 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:08:54 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566
Oct 20 02:08:54 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:08:54 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:08:54 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68
Oct 20 02:08:54 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:08:54 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:08:54 user nova-compute[74242]: FIRMWARE:
Oct 20 02:08:54 user nova-compute[74242]: No targets found.
Oct 20 02:08:54 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:08:54 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:08:54 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[191b5b96-3d3e-4d8d-a2b8-0366b4ee85ee]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[06470d78-87b4-48e8-b1d5-09e8797aee8f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:08:54 user nova-compute[74242]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:08:54 user nova-compute[74242]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:08:54 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 (non-flash)
Oct 20 02:08:54 user nova-compute[74242]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:08:54 user nova-compute[74242]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:08:54 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b8648310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68'): ({'sde'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Removing single pathed devices sde {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ac616e-f9f1-4749-8cd1-57cb0c61c236]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae110b7c-90e2-4b8c-93d1-a3f563ded5d4]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Flushing IO for device /dev/sde {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b911e3-33ac-473b-90aa-fec688eaabc9]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG nova.compute.manager [req-f38f6289-094c-4af8-99d1-c58395178b89 req-0e0eec9b-e18e-42b3-aca5-ec758c18e49f service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Received event network-vif-plugged-350f4931-f460-4a25-a6b4-dd924304f1fa {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f38f6289-094c-4af8-99d1-c58395178b89 req-0e0eec9b-e18e-42b3-aca5-ec758c18e49f service nova] Acquiring lock "07377280-e3f5-4edd-9501-678dcde42ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f38f6289-094c-4af8-99d1-c58395178b89 req-0e0eec9b-e18e-42b3-aca5-ec758c18e49f service nova] Lock "07377280-e3f5-4edd-9501-678dcde42ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f38f6289-094c-4af8-99d1-c58395178b89 req-0e0eec9b-e18e-42b3-aca5-ec758c18e49f service nova] Lock "07377280-e3f5-4edd-9501-678dcde42ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG nova.compute.manager [req-f38f6289-094c-4af8-99d1-c58395178b89 req-0e0eec9b-e18e-42b3-aca5-ec758c18e49f service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] No waiting events found dispatching network-vif-plugged-350f4931-f460-4a25-a6b4-dd924304f1fa {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:55 user nova-compute[74242]: WARNING nova.compute.manager [req-f38f6289-094c-4af8-99d1-c58395178b89 req-0e0eec9b-e18e-42b3-aca5-ec758c18e49f service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Received unexpected event network-vif-plugged-350f4931-f460-4a25-a6b4-dd924304f1fa for instance with vm_state building and task_state spawning.
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.109s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e4a535-d155-44d2-a9dd-b81dd1c3e6a5]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cec197-c419-4f49-8136-52cac0ec32b9]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a76ef5-2b36-4dd2-8622-7ad631f2ab6c]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260]
Oct 20 02:08:55 user nova-compute[74242]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68, portal: 172.16.0.220,3260] successful.
Oct 20 02:08:55 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e79478c-34db-431c-86df-ffa42a493f68 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7d2a2a-f443-41ce-9516-4ff51b24e7a7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.463s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] <== disconnect_volume: return (464ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:08:55 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Deleting instance files /opt/stack/data/nova/instances/5cea10bc-ac5a-48b0-b6b7-7db8f520339d_del
Oct 20 02:08:55 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Deletion of /opt/stack/data/nova/instances/5cea10bc-ac5a-48b0-b6b7-7db8f520339d_del complete
Oct 20 02:08:55 user nova-compute[74242]: INFO nova.compute.manager [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Took 1.84 seconds to destroy the instance on the hypervisor.
Oct 20 02:08:55 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-aefc0a26-2eaa-4870-9ee0-0808577cdd59 req-003c48af-6d8f-4cce-9926-9613e209fc9a service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received event network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-aefc0a26-2eaa-4870-9ee0-0808577cdd59 req-003c48af-6d8f-4cce-9926-9613e209fc9a service nova] Acquiring lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-aefc0a26-2eaa-4870-9ee0-0808577cdd59 req-003c48af-6d8f-4cce-9926-9613e209fc9a service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-aefc0a26-2eaa-4870-9ee0-0808577cdd59 req-003c48af-6d8f-4cce-9926-9613e209fc9a service nova] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-aefc0a26-2eaa-4870-9ee0-0808577cdd59 req-003c48af-6d8f-4cce-9926-9613e209fc9a service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] No waiting events found dispatching network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:56 user nova-compute[74242]: WARNING nova.compute.manager [req-aefc0a26-2eaa-4870-9ee0-0808577cdd59 req-003c48af-6d8f-4cce-9926-9613e209fc9a service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received unexpected event network-vif-plugged-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf for instance with vm_state active and task_state deleting.
Oct 20 02:08:56 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:08:56 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Took 1.29 seconds to deallocate network for instance.
Oct 20 02:08:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:08:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:08:57 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Instance spawned successfully.
Oct 20 02:08:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:08:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:08:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:08:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:08:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:08:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:08:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:08:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-532976d2-e12a-4580-a614-4eacc8d0f245 req-2bce26b7-c338-4176-a697-4fa3074c95db service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Received event network-vif-plugged-350f4931-f460-4a25-a6b4-dd924304f1fa {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-532976d2-e12a-4580-a614-4eacc8d0f245 req-2bce26b7-c338-4176-a697-4fa3074c95db service nova] Acquiring lock "07377280-e3f5-4edd-9501-678dcde42ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-532976d2-e12a-4580-a614-4eacc8d0f245 req-2bce26b7-c338-4176-a697-4fa3074c95db service nova] Lock "07377280-e3f5-4edd-9501-678dcde42ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-532976d2-e12a-4580-a614-4eacc8d0f245 req-2bce26b7-c338-4176-a697-4fa3074c95db service nova] Lock "07377280-e3f5-4edd-9501-678dcde42ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-532976d2-e12a-4580-a614-4eacc8d0f245 req-2bce26b7-c338-4176-a697-4fa3074c95db service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] No waiting events found dispatching network-vif-plugged-350f4931-f460-4a25-a6b4-dd924304f1fa {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:08:57 user nova-compute[74242]: WARNING nova.compute.manager [req-532976d2-e12a-4580-a614-4eacc8d0f245 req-2bce26b7-c338-4176-a697-4fa3074c95db service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Received unexpected event network-vif-plugged-350f4931-f460-4a25-a6b4-dd924304f1fa for instance with vm_state building and task_state spawning.
Oct 20 02:08:57 user nova-compute[74242]: INFO nova.compute.manager [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Took 6.15 seconds to spawn the instance on the hypervisor.
Oct 20 02:08:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:08:57 user nova-compute[74242]: INFO nova.compute.manager [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Took 26.95 seconds to build instance.
Oct 20 02:08:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f16de66e-a129-4661-952e-f6d6af9a2de2 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "07377280-e3f5-4edd-9501-678dcde42ef3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 27.081s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:57 user nova-compute[74242]: INFO nova.compute.manager [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Took 0.90 seconds to detach 1 volumes for instance.
Oct 20 02:08:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Deleting volume: 6e79478c-34db-431c-86df-ffa42a493f68 {{(pid=74242) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 02:08:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:08:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:08:58 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:08:58 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:08:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.396s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-0e61815c-7b4b-4e7e-a2e6-06d4a9fdd432 req-4f503e2c-ba42-42e6-aaf6-098c003c087d service nova] [instance: 5cea10bc-ac5a-48b0-b6b7-7db8f520339d] Received event network-vif-deleted-5fe0eca0-44d0-43d0-acc4-b34fa7126eaf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:08:58 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Deleted allocations for instance 5cea10bc-ac5a-48b0-b6b7-7db8f520339d
Oct 20 02:08:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-44de130b-2811-4d61-8a06-79abfe3e513b tempest-ServerActionsV293TestJSON-320668090 tempest-ServerActionsV293TestJSON-320668090-project-member] Lock "5cea10bc-ac5a-48b0-b6b7-7db8f520339d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.908s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:08:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:08:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:09:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCVHudct', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:09:02 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:09:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:09:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:09:02 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:09:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:09:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:09:02 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:09:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d2cc287-1ec4-4ec1-96d0-55a48b185355]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:09:03 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6349ff28-7ae3-4662-b667-65cbe6174db2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160] added
Oct 20 02:09:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a71613-8ca3-4683-b74a-316075c86cb3]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33c75ad-0d69-46f8-ae00-6d9bf34dcc5d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aCVHudct {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aCVHudct" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d137b2-41bd-4af0-b8e7-cb4a90619543]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aCVHudct'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c4e368-277a-4e12-9b6b-06ad02e466d6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[39515172-7f0d-429b-9d1f-dd5341a77f5b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:09:03 user nova-compute[74242]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:09:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:09:03 user nova-compute[74242]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:09:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a30aa05-0269-401b-8d22-358cf4d3e8b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260]
Oct 20 02:09:03 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260] successful.
Oct 20 02:09:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97c38de-4017-4d31-8758-7a9b9e2495e3]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ddda65-f74c-42dd-b06f-7f4afdfa78a9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:09:03 user nova-compute[74242]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:09:03 user nova-compute[74242]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:09:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:09:03 user nova-compute[74242]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:09:03 user nova-compute[74242]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:09:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cf599d-f7a2-4295-a907-7be253f91781]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCVHudct', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:09:03 user nova-compute[74242]: INFO nova.virt.block_device [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Booting with volume 962ae9c3-39bd-4f74-8bf4-958d7e547c7a at /dev/vdc
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.utils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[73fd9419-5470-476d-a020-1feb3dae6793]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f0420a-ed19-4bcf-a73e-fea74c717540]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f45f7ada-9690-46e2-a314-d6bbe23d9194]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4007020f-bc7b-4b3f-a277-8ca3116321d1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:09:03 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4045d5-d3d4-4429-a40b-51ab31d00a25]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG os_brick.utils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updating existing volume attachment record: 17b30df0-5508-42cb-b1e0-dc91243f4d15 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:04 user nova-compute[74242]: INFO nova.compute.manager [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Detaching volume 069f2fdc-94b6-4546-8e3e-58bc608d7ba3
Oct 20 02:09:04 user nova-compute[74242]: INFO nova.virt.block_device [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Attempting to driver detach volume 069f2fdc-94b6-4546-8e3e-58bc608d7ba3 from mountpoint /dev/vdc
Oct 20 02:09:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Attempting to detach device vdc from instance 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:09:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:09:04 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:09:04 user nova-compute[74242]:   <source dev="/dev/sdf"/>
Oct 20 02:09:04 user nova-compute[74242]:   <target dev="vdc" bus="virtio"/>
Oct 20 02:09:04 user nova-compute[74242]:   <serial>069f2fdc-94b6-4546-8e3e-58bc608d7ba3</serial>
Oct 20 02:09:04 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 02:09:04 user nova-compute[74242]: </disk>
Oct 20 02:09:04 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:09:04 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Successfully detached device vdc from instance 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 from the persistent domain config.
Oct 20 02:09:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:09:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:09:04 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:09:04 user nova-compute[74242]:   <source dev="/dev/sdf"/>
Oct 20 02:09:04 user nova-compute[74242]:   <target dev="vdc" bus="virtio"/>
Oct 20 02:09:04 user nova-compute[74242]:   <serial>069f2fdc-94b6-4546-8e3e-58bc608d7ba3</serial>
Oct 20 02:09:04 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 02:09:04 user nova-compute[74242]: </disk>
Oct 20 02:09:04 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:09:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:09:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23732653133656562', 'path': '/dev/sdc'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:09:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732653133656562', 'path': '/dev/sdc'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:09:04 user nova-compute[74242]: DEBUG nova.objects.instance [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lazy-loading 'flavor' on Instance uuid c909c918-59a9-42fe-99fe-72431ba43443 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:09:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:09:04 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:09:04 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:09:04 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:09:04 user nova-compute[74242]:   <serial>4af7b0a8-d384-4def-8ef9-0f2ec5dcf160</serial>
Oct 20 02:09:04 user nova-compute[74242]: </disk>
Oct 20 02:09:04 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:09:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:09:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:09:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:09:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] No VIF found with MAC fa:16:3e:ba:d5:37, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:09:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3982789b-03ca-4075-9c0f-bf8bca21ead2 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "c909c918-59a9-42fe-99fe-72431ba43443" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 45.433s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:06 user nova-compute[74242]: INFO nova.compute.manager [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Rebuilding instance
Oct 20 02:09:06 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:09:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-74bb9a6d-330f-4efc-a730-cf51039a8b3a req-4d5a4694-d363-4bbb-ae58-f9b89ca6e612 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received event network-vif-unplugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:09:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-74bb9a6d-330f-4efc-a730-cf51039a8b3a req-4d5a4694-d363-4bbb-ae58-f9b89ca6e612 service nova] Acquiring lock "c909c918-59a9-42fe-99fe-72431ba43443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-74bb9a6d-330f-4efc-a730-cf51039a8b3a req-4d5a4694-d363-4bbb-ae58-f9b89ca6e612 service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-74bb9a6d-330f-4efc-a730-cf51039a8b3a req-4d5a4694-d363-4bbb-ae58-f9b89ca6e612 service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-74bb9a6d-330f-4efc-a730-cf51039a8b3a req-4d5a4694-d363-4bbb-ae58-f9b89ca6e612 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] No waiting events found dispatching network-vif-unplugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:09:06 user nova-compute[74242]: WARNING nova.compute.manager [req-74bb9a6d-330f-4efc-a730-cf51039a8b3a req-4d5a4694-d363-4bbb-ae58-f9b89ca6e612 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received unexpected event network-vif-unplugged-c358f4c8-2f05-4449-af69-dd6108ecf241 for instance with vm_state active and task_state rebuilding.
Oct 20 02:09:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:07 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Instance destroyed successfully.
Oct 20 02:09:07 user nova-compute[74242]: INFO nova.compute.manager [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Detaching volume 4af7b0a8-d384-4def-8ef9-0f2ec5dcf160
Oct 20 02:09:07 user nova-compute[74242]: INFO nova.virt.block_device [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Attempting to driver detach volume 4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 from mountpoint /dev/vdb
Oct 20 02:09:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Attempting to detach device vdb from instance c909c918-59a9-42fe-99fe-72431ba43443 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:09:07 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:09:07 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:09:07 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:09:07 user nova-compute[74242]:   <serial>4af7b0a8-d384-4def-8ef9-0f2ec5dcf160</serial>
Oct 20 02:09:07 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:09:07 user nova-compute[74242]: </disk>
Oct 20 02:09:07 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:09:07 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Successfully detached device vdb from instance c909c918-59a9-42fe-99fe-72431ba43443 from the persistent domain config.
Oct 20 02:09:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCVHudct', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:09:07 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed7cc3f-f8cd-40ad-b818-8726eaf76939]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:09:07 user nova-compute[74242]: No targets found.
Oct 20 02:09:07 user nova-compute[74242]: iSNS:
Oct 20 02:09:07 user nova-compute[74242]: No targets found.
Oct 20 02:09:07 user nova-compute[74242]: STATIC:
Oct 20 02:09:07 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3
Oct 20 02:09:07 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:09:07 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:09:07 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160
Oct 20 02:09:07 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:09:07 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:09:07 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566
Oct 20 02:09:07 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:09:07 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:09:07 user nova-compute[74242]: FIRMWARE:
Oct 20 02:09:07 user nova-compute[74242]: No targets found.
Oct 20 02:09:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:09:07 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:09:07 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[16baf8ff-6f9d-46a6-ac69-2b66b533bdbf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6432e79c-1818-455f-870d-3b7d7d5c8456]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:09:07 user nova-compute[74242]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:09:07 user nova-compute[74242]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:09:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:09:07 user nova-compute[74242]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:09:07 user nova-compute[74242]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:09:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b87ba4d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160'): ({'sdc'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Removing single pathed devices sdc {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f2464d-685d-4162-860b-c7243a7fc95f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7894fa-1fab-4561-a09b-ae37ecbc9121]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Flushing IO for device /dev/sdc {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f18362ce-6120-4132-be31-21ebfd50d26b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8deb1b1-7fc9-4196-83e1-5e39c69157f0]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbd2985-c873-4303-88d2-055e9cc79d08]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31af4d4-d160-4c37-b429-e20ca3dbcadd]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260]
Oct 20 02:09:07 user nova-compute[74242]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260] successful.
Oct 20 02:09:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b52dcce-b5ec-4522-a3dc-27da7203937d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] <== disconnect_volume: return (326ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:09:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:09:08 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Instance destroyed successfully.
Oct 20 02:09:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1170021543',display_name='tempest-ServerActionsTestOtherA-server-296753290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1170021543',id=13,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrPBdfgfIOd9Bbgyl7XwDZEaA2/I2ig7YDFuATYsERYinJSZl+I4zqRDKdZ1kEG5DAM+H4I0B67KuA8LEv3daLR6RzgTmC0EkFXmvmntpdQWOjWI81e1VZVgofosnIjFA==',key_name='tempest-keypair-1122737131',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:06:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5cf9b187fe8443aba57a8c629d78978e',ramdisk_id='',reservation_id='r-84vssbut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2076229102',owner_user_name='tempest-ServerActionsTestOtherA-2076229102-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:09:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1f488a444de49f5bed5351efd55dafa',uuid=c909c918-59a9-42fe-99fe-72431ba43443,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converting VIF {"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d5:37,bridge_name='br-int',has_traffic_filtering=True,id=c358f4c8-2f05-4449-af69-dd6108ecf241,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc358f4c8-2f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_vif [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d5:37,bridge_name='br-int',has_traffic_filtering=True,id=c358f4c8-2f05-4449-af69-dd6108ecf241,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc358f4c8-2f') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-ac22e769-d4ad-4606-98a5-d93129960182 req-9fa6e9c3-6adb-4311-b4e0-7a5ff3e641d9 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received event network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ac22e769-d4ad-4606-98a5-d93129960182 req-9fa6e9c3-6adb-4311-b4e0-7a5ff3e641d9 service nova] Acquiring lock "c909c918-59a9-42fe-99fe-72431ba43443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ac22e769-d4ad-4606-98a5-d93129960182 req-9fa6e9c3-6adb-4311-b4e0-7a5ff3e641d9 service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ac22e769-d4ad-4606-98a5-d93129960182 req-9fa6e9c3-6adb-4311-b4e0-7a5ff3e641d9 service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-ac22e769-d4ad-4606-98a5-d93129960182 req-9fa6e9c3-6adb-4311-b4e0-7a5ff3e641d9 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] No waiting events found dispatching network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:09:08 user nova-compute[74242]: WARNING nova.compute.manager [req-ac22e769-d4ad-4606-98a5-d93129960182 req-9fa6e9c3-6adb-4311-b4e0-7a5ff3e641d9 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received unexpected event network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 for instance with vm_state active and task_state rebuilding.
Oct 20 02:09:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc358f4c8-2f, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5793ed1-b71f-4335-a5c5-6388cf23f971) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:09:08 user nova-compute[74242]: INFO os_vif [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d5:37,bridge_name='br-int',has_traffic_filtering=True,id=c358f4c8-2f05-4449-af69-dd6108ecf241,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc358f4c8-2f')
Oct 20 02:09:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCVHudct', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:09:08 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84505e7-42b0-4a75-b322-23b987290541]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:09:08 user nova-compute[74242]: No targets found.
Oct 20 02:09:08 user nova-compute[74242]: iSNS:
Oct 20 02:09:08 user nova-compute[74242]: No targets found.
Oct 20 02:09:08 user nova-compute[74242]: STATIC:
Oct 20 02:09:08 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3
Oct 20 02:09:08 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:09:08 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:09:08 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566
Oct 20 02:09:08 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:09:08 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:09:08 user nova-compute[74242]: FIRMWARE:
Oct 20 02:09:08 user nova-compute[74242]: No targets found.
Oct 20 02:09:08 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:09:08 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:09:08 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1ffefe1-d1b4-4aff-8e08-f4319a00ecac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[43360caf-c3f2-4b18-8cc5-2564a0037f96]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:09:08 user nova-compute[74242]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:09:08 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:09:08 user nova-compute[74242]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:09:08 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b87b8af0>, {}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Disconnecting from: [] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] <== disconnect_volume: return (77ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:09:08 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Deleting instance files /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443_del
Oct 20 02:09:08 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Deletion of /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443_del complete
Oct 20 02:09:08 user nova-compute[74242]: INFO nova.virt.block_device [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Booting with volume 4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 at /dev/vdb
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.utils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9d347e-2f82-47aa-bb0d-f6817927cab0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bcafe3e-cdeb-4f18-a079-846261d7e1d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c9f740-78e2-491b-a5f9-e06f4b2159ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e0d2b7-445e-47d4-875a-856f960cdac6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:09:08 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:09:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a3bcdc2-67eb-4820-b97a-b8836c0ee369]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG os_brick.utils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:09:08 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Updating existing volume attachment record: 1f7a0a46-7562-4683-97bf-2f106958d8d7 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:09:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:09:20 user nova-compute[74242]: WARNING nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] While synchronizing instance power states, found 9 instances in the database and 7 instances on the hypervisor.
Oct 20 02:09:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid af9f3d52-79f0-4ce0-9b14-3373b30c2b26 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 0636ce59-3cfb-4959-bb28-bce8f4c30043 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid c909c918-59a9-42fe-99fe-72431ba43443 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 626bb196-0e5e-4dfd-8ead-57306c828b13 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 7e101002-a175-40fe-b5ca-04a58610f60d {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 72003d17-9292-4bdd-acfc-0d3f7e40df80 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 07377280-e3f5-4edd-9501-678dcde42ef3 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 9701b02d-0874-45f9-a599-8c1809f234c4 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "0636ce59-3cfb-4959-bb28-bce8f4c30043" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "c909c918-59a9-42fe-99fe-72431ba43443" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "c909c918-59a9-42fe-99fe-72431ba43443" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:20 user nova-compute[74242]: INFO nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c909c918-59a9-42fe-99fe-72431ba43443] During sync_power_state the instance has a pending task (rebuild_block_device_mapping). Skip.
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "c909c918-59a9-42fe-99fe-72431ba43443" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "7e101002-a175-40fe-b5ca-04a58610f60d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "7e101002-a175-40fe-b5ca-04a58610f60d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "07377280-e3f5-4edd-9501-678dcde42ef3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "07377280-e3f5-4edd-9501-678dcde42ef3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "9701b02d-0874-45f9-a599-8c1809f234c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "9701b02d-0874-45f9-a599-8c1809f234c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.076s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "7e101002-a175-40fe-b5ca-04a58610f60d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "9701b02d-0874-45f9-a599-8c1809f234c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "07377280-e3f5-4edd-9501-678dcde42ef3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.106s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:24 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 is timed out.
Oct 20 02:09:24 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Successfully detached device vdc from instance 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 from the live domain config.
Oct 20 02:09:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pVBGliZf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:09:24 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd19f1c6-fcd2-41a0-9045-1c7ef5c760e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:09:24 user nova-compute[74242]: No targets found.
Oct 20 02:09:24 user nova-compute[74242]: iSNS:
Oct 20 02:09:24 user nova-compute[74242]: No targets found.
Oct 20 02:09:24 user nova-compute[74242]: STATIC:
Oct 20 02:09:24 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3
Oct 20 02:09:24 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:09:24 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:09:24 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566
Oct 20 02:09:24 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:09:24 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:09:24 user nova-compute[74242]: FIRMWARE:
Oct 20 02:09:24 user nova-compute[74242]: No targets found.
Oct 20 02:09:24 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:09:24 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:09:24 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[002fd58a-9084-4c94-9bcf-92e5bf19fcf6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5a94d4-f6ff-4b6d-85b4-33b6822e0ac9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:09:24 user nova-compute[74242]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:09:24 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 (non-flash)
Oct 20 02:09:24 user nova-compute[74242]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:09:24 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d037cb80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3'): ({'sdf'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Removing single pathed devices sdf {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1922c57a-d2e7-415b-8746-6838421c2644]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1318b156-77fe-4605-b623-7210c066d624]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Flushing IO for device /dev/sdf {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d7f5b46-4ef8-4acf-b128-972922405b64]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2688ee-c54f-48f8-9810-ba26324d874e]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] SCSI volumes sdf have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[77755d61-fdbf-4d62-9812-f24867f5b4c3]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b481ff64-580f-4e10-b2eb-de0f860d6ace]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3, portal: 172.16.0.220,3260]
Oct 20 02:09:24 user nova-compute[74242]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3, portal: 172.16.0.220,3260] successful.
Oct 20 02:09:24 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:069f2fdc-94b6-4546-8e3e-58bc608d7ba3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fcc31f-3cbc-476a-b787-ddad9c0c30e7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] <== disconnect_volume: return (315ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:09:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:09:26 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:09:26 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:09:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:09:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:09:26 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:09:26 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updating instance_info_cache with network_info: [{"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:09:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:09:26 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:09:26 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:09:27 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:09:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:09:29 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Creating image(s)
Oct 20 02:09:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "/opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "/opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "/opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.215s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk 1073741824" returned: 0 in 0.051s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.276s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Cannot resize image /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Ensure instance console log exists: /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Start _get_guest_xml network_info=[{"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '1f7a0a46-7562-4683-97bf-2f106958d8d7', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCVHudct', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c909c918-59a9-42fe-99fe-72431ba43443', 'attached_at': '', 'detached_at': '', 'volume_id': '4af7b0a8-d384-4def-8ef9-0f2ec5dcf160', 'serial': '4af7b0a8-d384-4def-8ef9-0f2ec5dcf160'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:09:30 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 02:09:30 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.objects.instance [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lazy-loading 'vcpu_model' on Instance uuid c909c918-59a9-42fe-99fe-72431ba43443 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCVHudct', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:09:30 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.008s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:09:30 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:09:30 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[74187cd9-2e7d-42c2-a783-a91856479993]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:09:30 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[53cddb08-2886-42e7-98d1-49ddf2ba1ccb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160] added
Oct 20 02:09:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[adac5e17-413f-45f8-ae92-3379e5e40bce]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.068s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec285843-7f7a-41cc-b703-c54889f92c57]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aCVHudct {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v aCVHudct" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc278a8b-09aa-450d-b6f4-a76ac8e05742]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'aCVHudct'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[688131aa-10be-4188-8467-3c1ee5c1f9dd]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bd1d97d-42ee-4d6a-aa9d-79aebfc4d195]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:09:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:09:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f82bcdbf-a73f-40f2-a01b-d3afef1cf90a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260]
Oct 20 02:09:30 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260] successful.
Oct 20 02:09:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eeb0f5e-09e3-4609-b02c-a246cccf0dc3]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bc3e03f-a8c5-486e-9003-4dd675b369b5]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:09:30 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:09:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:09:30 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:09:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e2eae0-77fe-423e-9194-16603230b96a]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:09:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCVHudct', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23732653133656562', 'path': '/dev/sdc'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732653133656562', 'path': '/dev/sdc'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T02:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1170021543',display_name='tempest-ServerActionsTestOtherA-server-296753290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1170021543',id=13,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrPBdfgfIOd9Bbgyl7XwDZEaA2/I2ig7YDFuATYsERYinJSZl+I4zqRDKdZ1kEG5DAM+H4I0B67KuA8LEv3daLR6RzgTmC0EkFXmvmntpdQWOjWI81e1VZVgofosnIjFA==',key_name='tempest-keypair-1122737131',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:06:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5cf9b187fe8443aba57a8c629d78978e',ramdisk_id='',reservation_id='r-84vssbut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2076229102',owner_user_name='tempest-ServerActionsTestOtherA-2076229102-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:09:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1f488a444de49f5bed5351efd55dafa',uuid=c909c918-59a9-42fe-99fe-72431ba43443,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converting VIF {"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d5:37,bridge_name='br-int',has_traffic_filtering=True,id=c358f4c8-2f05-4449-af69-dd6108ecf241,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc358f4c8-2f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:09:31 user nova-compute[74242]:   <uuid>c909c918-59a9-42fe-99fe-72431ba43443</uuid>
Oct 20 02:09:31 user nova-compute[74242]:   <name>instance-0000000d</name>
Oct 20 02:09:31 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:09:31 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:09:31 user nova-compute[74242]:   <metadata>
Oct 20 02:09:31 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:09:31 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:09:31 user nova-compute[74242]:       <nova:name>tempest-ServerActionsTestOtherA-server-296753290</nova:name>
Oct 20 02:09:31 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:09:30</nova:creationTime>
Oct 20 02:09:31 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:09:31 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:09:31 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:09:31 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:09:31 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:09:31 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:09:31 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:09:31 user nova-compute[74242]:       <nova:owner>
Oct 20 02:09:31 user nova-compute[74242]:         <nova:user uuid="c1f488a444de49f5bed5351efd55dafa">tempest-ServerActionsTestOtherA-2076229102-project-member</nova:user>
Oct 20 02:09:31 user nova-compute[74242]:         <nova:project uuid="5cf9b187fe8443aba57a8c629d78978e">tempest-ServerActionsTestOtherA-2076229102</nova:project>
Oct 20 02:09:31 user nova-compute[74242]:       </nova:owner>
Oct 20 02:09:31 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:09:31 user nova-compute[74242]:       <nova:ports>
Oct 20 02:09:31 user nova-compute[74242]:         <nova:port uuid="c358f4c8-2f05-4449-af69-dd6108ecf241">
Oct 20 02:09:31 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 02:09:31 user nova-compute[74242]:         </nova:port>
Oct 20 02:09:31 user nova-compute[74242]:       </nova:ports>
Oct 20 02:09:31 user nova-compute[74242]:     </nova:instance>
Oct 20 02:09:31 user nova-compute[74242]:   </metadata>
Oct 20 02:09:31 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:09:31 user nova-compute[74242]:     <system>
Oct 20 02:09:31 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:09:31 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:09:31 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:09:31 user nova-compute[74242]:       <entry name="serial">c909c918-59a9-42fe-99fe-72431ba43443</entry>
Oct 20 02:09:31 user nova-compute[74242]:       <entry name="uuid">c909c918-59a9-42fe-99fe-72431ba43443</entry>
Oct 20 02:09:31 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:09:31 user nova-compute[74242]:     </system>
Oct 20 02:09:31 user nova-compute[74242]:   </sysinfo>
Oct 20 02:09:31 user nova-compute[74242]:   <os>
Oct 20 02:09:31 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:09:31 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:09:31 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:09:31 user nova-compute[74242]:   </os>
Oct 20 02:09:31 user nova-compute[74242]:   <features>
Oct 20 02:09:31 user nova-compute[74242]:     <acpi/>
Oct 20 02:09:31 user nova-compute[74242]:     <apic/>
Oct 20 02:09:31 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:09:31 user nova-compute[74242]:   </features>
Oct 20 02:09:31 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:09:31 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:09:31 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:09:31 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:09:31 user nova-compute[74242]:   </clock>
Oct 20 02:09:31 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:09:31 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:09:31 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:09:31 user nova-compute[74242]:   </cpu>
Oct 20 02:09:31 user nova-compute[74242]:   <devices>
Oct 20 02:09:31 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:09:31 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:09:31 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk"/>
Oct 20 02:09:31 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:09:31 user nova-compute[74242]:     </disk>
Oct 20 02:09:31 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:09:31 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:09:31 user nova-compute[74242]:       <source dev="/dev/sdc"/>
Oct 20 02:09:31 user nova-compute[74242]:       <target dev="vdb" bus="virtio"/>
Oct 20 02:09:31 user nova-compute[74242]:       <serial>4af7b0a8-d384-4def-8ef9-0f2ec5dcf160</serial>
Oct 20 02:09:31 user nova-compute[74242]:     </disk>
Oct 20 02:09:31 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:09:31 user nova-compute[74242]:       <mac address="fa:16:3e:ba:d5:37"/>
Oct 20 02:09:31 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:09:31 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:09:31 user nova-compute[74242]:       <target dev="tapc358f4c8-2f"/>
Oct 20 02:09:31 user nova-compute[74242]:     </interface>
Oct 20 02:09:31 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:09:31 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/console.log" append="off"/>
Oct 20 02:09:31 user nova-compute[74242]:     </serial>
Oct 20 02:09:31 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:09:31 user nova-compute[74242]:     <video>
Oct 20 02:09:31 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:09:31 user nova-compute[74242]:     </video>
Oct 20 02:09:31 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:09:31 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:09:31 user nova-compute[74242]:     </rng>
Oct 20 02:09:31 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:09:31 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:09:31 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:09:31 user nova-compute[74242]:     </memballoon>
Oct 20 02:09:31 user nova-compute[74242]:   </devices>
Oct 20 02:09:31 user nova-compute[74242]: </domain>
Oct 20 02:09:31 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T02:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1170021543',display_name='tempest-ServerActionsTestOtherA-server-296753290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1170021543',id=13,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrPBdfgfIOd9Bbgyl7XwDZEaA2/I2ig7YDFuATYsERYinJSZl+I4zqRDKdZ1kEG5DAM+H4I0B67KuA8LEv3daLR6RzgTmC0EkFXmvmntpdQWOjWI81e1VZVgofosnIjFA==',key_name='tempest-keypair-1122737131',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:06:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5cf9b187fe8443aba57a8c629d78978e',ramdisk_id='',reservation_id='r-84vssbut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2076229102',owner_user_name='tempest-ServerActionsTestOtherA-2076229102-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:09:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1f488a444de49f5bed5351efd55dafa',uuid=c909c918-59a9-42fe-99fe-72431ba43443,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converting VIF {"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d5:37,bridge_name='br-int',has_traffic_filtering=True,id=c358f4c8-2f05-4449-af69-dd6108ecf241,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc358f4c8-2f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG os_vif [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d5:37,bridge_name='br-int',has_traffic_filtering=True,id=c358f4c8-2f05-4449-af69-dd6108ecf241,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc358f4c8-2f') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd9115218-6591-5c10-8252-a38765418375', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc358f4c8-2f, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc358f4c8-2f, col_values=(('qos', UUID('ef12875c-bcdb-4699-ab59-73a871b02af0')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc358f4c8-2f, col_values=(('external_ids', {'iface-id': 'c358f4c8-2f05-4449-af69-dd6108ecf241', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:d5:37', 'vm-uuid': 'c909c918-59a9-42fe-99fe-72431ba43443'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:31 user nova-compute[74242]: INFO os_vif [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d5:37,bridge_name='br-int',has_traffic_filtering=True,id=c358f4c8-2f05-4449-af69-dd6108ecf241,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc358f4c8-2f')
Oct 20 02:09:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:09:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] No VIF found with MAC fa:16:3e:ba:d5:37, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:09:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-190f1031-549a-44e3-b032-6ec21e3ef0c0 req-ed2a5ec7-d0af-4765-b2aa-492710d0ba84 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Received event network-changed-4f154d45-5d20-4df0-bb42-5977772a98c4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-190f1031-549a-44e3-b032-6ec21e3ef0c0 req-ed2a5ec7-d0af-4765-b2aa-492710d0ba84 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Refreshing instance network info cache due to event network-changed-4f154d45-5d20-4df0-bb42-5977772a98c4. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-190f1031-549a-44e3-b032-6ec21e3ef0c0 req-ed2a5ec7-d0af-4765-b2aa-492710d0ba84 service nova] Acquiring lock "refresh_cache-7e101002-a175-40fe-b5ca-04a58610f60d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-190f1031-549a-44e3-b032-6ec21e3ef0c0 req-ed2a5ec7-d0af-4765-b2aa-492710d0ba84 service nova] Acquired lock "refresh_cache-7e101002-a175-40fe-b5ca-04a58610f60d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG nova.network.neutron [req-190f1031-549a-44e3-b032-6ec21e3ef0c0 req-ed2a5ec7-d0af-4765-b2aa-492710d0ba84 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Refreshing network info cache for port 4f154d45-5d20-4df0-bb42-5977772a98c4 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-d32e8571-8707-4a11-a3b6-fd29ffadc2bd req-ba6a264f-1fdd-4528-88ce-bebab57b53d0 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received event network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d32e8571-8707-4a11-a3b6-fd29ffadc2bd req-ba6a264f-1fdd-4528-88ce-bebab57b53d0 service nova] Acquiring lock "c909c918-59a9-42fe-99fe-72431ba43443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d32e8571-8707-4a11-a3b6-fd29ffadc2bd req-ba6a264f-1fdd-4528-88ce-bebab57b53d0 service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d32e8571-8707-4a11-a3b6-fd29ffadc2bd req-ba6a264f-1fdd-4528-88ce-bebab57b53d0 service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-d32e8571-8707-4a11-a3b6-fd29ffadc2bd req-ba6a264f-1fdd-4528-88ce-bebab57b53d0 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] No waiting events found dispatching network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:09:33 user nova-compute[74242]: WARNING nova.compute.manager [req-d32e8571-8707-4a11-a3b6-fd29ffadc2bd req-ba6a264f-1fdd-4528-88ce-bebab57b53d0 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received unexpected event network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 for instance with vm_state active and task_state rebuild_spawning.
Oct 20 02:09:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-62fcef15-44be-4a3e-8e9b-6ddb9a77d581 req-7621508d-c81e-4aca-88f5-2340d3b2e579 service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Received event network-changed-853cfa70-26ff-4bd6-ab16-8f13128cee00 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-62fcef15-44be-4a3e-8e9b-6ddb9a77d581 req-7621508d-c81e-4aca-88f5-2340d3b2e579 service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Refreshing instance network info cache due to event network-changed-853cfa70-26ff-4bd6-ab16-8f13128cee00. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-62fcef15-44be-4a3e-8e9b-6ddb9a77d581 req-7621508d-c81e-4aca-88f5-2340d3b2e579 service nova] Acquiring lock "refresh_cache-72003d17-9292-4bdd-acfc-0d3f7e40df80" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-62fcef15-44be-4a3e-8e9b-6ddb9a77d581 req-7621508d-c81e-4aca-88f5-2340d3b2e579 service nova] Acquired lock "refresh_cache-72003d17-9292-4bdd-acfc-0d3f7e40df80" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.network.neutron [req-62fcef15-44be-4a3e-8e9b-6ddb9a77d581 req-7621508d-c81e-4aca-88f5-2340d3b2e579 service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Refreshing network info cache for port 853cfa70-26ff-4bd6-ab16-8f13128cee00 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-0c276f09-a44e-4dc0-aec4-4a7c9955bc0a req-2c6c7eba-9b1d-4a5c-9f84-57922c0dc62c service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received event network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0c276f09-a44e-4dc0-aec4-4a7c9955bc0a req-2c6c7eba-9b1d-4a5c-9f84-57922c0dc62c service nova] Acquiring lock "c909c918-59a9-42fe-99fe-72431ba43443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0c276f09-a44e-4dc0-aec4-4a7c9955bc0a req-2c6c7eba-9b1d-4a5c-9f84-57922c0dc62c service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0c276f09-a44e-4dc0-aec4-4a7c9955bc0a req-2c6c7eba-9b1d-4a5c-9f84-57922c0dc62c service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-0c276f09-a44e-4dc0-aec4-4a7c9955bc0a req-2c6c7eba-9b1d-4a5c-9f84-57922c0dc62c service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] No waiting events found dispatching network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:09:35 user nova-compute[74242]: WARNING nova.compute.manager [req-0c276f09-a44e-4dc0-aec4-4a7c9955bc0a req-2c6c7eba-9b1d-4a5c-9f84-57922c0dc62c service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received unexpected event network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 for instance with vm_state active and task_state rebuild_spawning.
Oct 20 02:09:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquiring lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.objects.instance [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lazy-loading 'flavor' on Instance uuid 72003d17-9292-4bdd-acfc-0d3f7e40df80 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:09:35 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Instance spawned successfully.
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:09:35 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:09:35 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7745MB free_disk=25.39659881591797GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:09:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.091s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance af9f3d52-79f0-4ce0-9b14-3373b30c2b26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c909c918-59a9-42fe-99fe-72431ba43443 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 626bb196-0e5e-4dfd-8ead-57306c828b13 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7e101002-a175-40fe-b5ca-04a58610f60d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 72003d17-9292-4bdd-acfc-0d3f7e40df80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 07377280-e3f5-4edd-9501-678dcde42ef3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 9701b02d-0874-45f9-a599-8c1809f234c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.network.neutron [req-190f1031-549a-44e3-b032-6ec21e3ef0c0 req-ed2a5ec7-d0af-4765-b2aa-492710d0ba84 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Updated VIF entry in instance network info cache for port 4f154d45-5d20-4df0-bb42-5977772a98c4. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.network.neutron [req-190f1031-549a-44e3-b032-6ec21e3ef0c0 req-ed2a5ec7-d0af-4765-b2aa-492710d0ba84 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Updating instance_info_cache with network_info: [{"id": "4f154d45-5d20-4df0-bb42-5977772a98c4", "address": "fa:16:3e:72:d7:10", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f154d45-5d", "ovs_interfaceid": "4f154d45-5d20-4df0-bb42-5977772a98c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-190f1031-549a-44e3-b032-6ec21e3ef0c0 req-ed2a5ec7-d0af-4765-b2aa-492710d0ba84 service nova] Releasing lock "refresh_cache-7e101002-a175-40fe-b5ca-04a58610f60d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquiring lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:36 user nova-compute[74242]: INFO nova.compute.manager [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Attaching volume a57d408c-853f-4859-bbe9-7608dc3157cb to /dev/vdb
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG os_brick.utils [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de68451-14c5-45b1-b2eb-75d54c0de1c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdddc980-35f0-41a9-9175-b7cbe7f00026]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94370d7-8c85-41d3-bc3e-5adc47fa047e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ea9380-69a9-420f-9a85-77d7bb9ffe29]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:09:36 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9adb8916-56d2-4fd2-a2d5-b674d62b5568]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG os_brick.utils [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] <== get_connector_properties: return (176ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Updating existing volume attachment record: f88947eb-fee3-461d-a7fd-03d01d6e2ce7 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.network.neutron [req-62fcef15-44be-4a3e-8e9b-6ddb9a77d581 req-7621508d-c81e-4aca-88f5-2340d3b2e579 service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Updated VIF entry in instance network info cache for port 853cfa70-26ff-4bd6-ab16-8f13128cee00. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.network.neutron [req-62fcef15-44be-4a3e-8e9b-6ddb9a77d581 req-7621508d-c81e-4aca-88f5-2340d3b2e579 service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Updating instance_info_cache with network_info: [{"id": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "address": "fa:16:3e:53:fc:43", "network": {"id": "35a08d69-02ac-4f3a-8a8c-6a8b41c2679a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2043622955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "589aa4f746cf410cba8fd345ed6f830f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853cfa70-26", "ovs_interfaceid": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-62fcef15-44be-4a3e-8e9b-6ddb9a77d581 req-7621508d-c81e-4aca-88f5-2340d3b2e579 service nova] Releasing lock "refresh_cache-72003d17-9292-4bdd-acfc-0d3f7e40df80" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.725s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.444s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG nova.objects.instance [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74242) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fdd7a-acce-4203-aded-627494565e23 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.082s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:43 user nova-compute[74242]: DEBUG nova.objects.instance [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'flavor' on Instance uuid 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:09:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-45ac3440-6025-4c49-af1c-2c936384c318 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 39.100s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 22.557s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "7e101002-a175-40fe-b5ca-04a58610f60d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "7e101002-a175-40fe-b5ca-04a58610f60d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:43 user nova-compute[74242]: DEBUG nova.objects.instance [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lazy-loading 'flavor' on Instance uuid 7e101002-a175-40fe-b5ca-04a58610f60d {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:09:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "7e101002-a175-40fe-b5ca-04a58610f60d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "7e101002-a175-40fe-b5ca-04a58610f60d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "7e101002-a175-40fe-b5ca-04a58610f60d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:43 user nova-compute[74242]: INFO nova.compute.manager [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Attaching volume 16fdd93a-3729-45c1-8863-934c517cdf1a to /dev/vdb
Oct 20 02:09:44 user nova-compute[74242]: DEBUG os_brick.utils [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fb5b2f-cde9-482d-811e-6c6feb3363a3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[881b0b0c-179a-4c77-8214-699125a00ae8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.035s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6b42bb3-53ca-40e2-9239-4cfeac253dde]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c26485d-0fc7-4efd-9180-e427fe3c23ee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:09:44 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:09:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1c2ab9-7dc3-4a9e-b28e-10fc5d5008f8]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG os_brick.utils [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] <== get_connector_properties: return (387ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:09:44 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Updating existing volume attachment record: 3f8c27e0-c19c-4567-9729-b5151f0f94ca {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:09:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "39a5ba0f-e581-49c3-a179-62d6c333fa59" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:09:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:56 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:09:56 user nova-compute[74242]: INFO nova.compute.claims [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Claim successful on node user
Oct 20 02:09:57 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.408s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:09:57 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:09:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG nova.policy [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ac628a224fb4653932a27e33aa33c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112fda62d355421e80e674dc18bb5069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:09:57 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Creating image(s)
Oct 20 02:09:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "/opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "/opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "/opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.198s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk 1073741824" returned: 0 in 0.058s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Successfully created port: 57aa37e7-d468-477c-ae9f-0a1ccebdf445 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.179s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Checking if we can resize image /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Cannot resize image /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Ensure instance console log exists: /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Successfully updated port: 57aa37e7-d468-477c-ae9f-0a1ccebdf445 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "refresh_cache-39a5ba0f-e581-49c3-a179-62d6c333fa59" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquired lock "refresh_cache-39a5ba0f-e581-49c3-a179-62d6c333fa59" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-42b982e3-a357-408b-88d1-3d619d21d415 req-8721e962-0414-433b-a4e5-2a92137589f5 service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Received event network-changed-57aa37e7-d468-477c-ae9f-0a1ccebdf445 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-42b982e3-a357-408b-88d1-3d619d21d415 req-8721e962-0414-433b-a4e5-2a92137589f5 service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Refreshing instance network info cache due to event network-changed-57aa37e7-d468-477c-ae9f-0a1ccebdf445. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-42b982e3-a357-408b-88d1-3d619d21d415 req-8721e962-0414-433b-a4e5-2a92137589f5 service nova] Acquiring lock "refresh_cache-39a5ba0f-e581-49c3-a179-62d6c333fa59" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Updating instance_info_cache with network_info: [{"id": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "address": "fa:16:3e:79:1a:39", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57aa37e7-d4", "ovs_interfaceid": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Releasing lock "refresh_cache-39a5ba0f-e581-49c3-a179-62d6c333fa59" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Instance network_info: |[{"id": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "address": "fa:16:3e:79:1a:39", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57aa37e7-d4", "ovs_interfaceid": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-42b982e3-a357-408b-88d1-3d619d21d415 req-8721e962-0414-433b-a4e5-2a92137589f5 service nova] Acquired lock "refresh_cache-39a5ba0f-e581-49c3-a179-62d6c333fa59" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.network.neutron [req-42b982e3-a357-408b-88d1-3d619d21d415 req-8721e962-0414-433b-a4e5-2a92137589f5 service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Refreshing network info cache for port 57aa37e7-d468-477c-ae9f-0a1ccebdf445 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Start _get_guest_xml network_info=[{"id": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "address": "fa:16:3e:79:1a:39", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57aa37e7-d4", "ovs_interfaceid": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:09:58 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:09:58 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:09:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:09:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-25051770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-25051770',id=19,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112fda62d355421e80e674dc18bb5069',ramdisk_id='',reservation_id='r-o9jgeo22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:09:57Z,user_data=None,user_id='9ac628a224fb4653932a27e33aa33c9d',uuid=39a5ba0f-e581-49c3-a179-62d6c333fa59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "address": "fa:16:3e:79:1a:39", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57aa37e7-d4", "ovs_interfaceid": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converting VIF {"id": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "address": "fa:16:3e:79:1a:39", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57aa37e7-d4", "ovs_interfaceid": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:1a:39,bridge_name='br-int',has_traffic_filtering=True,id=57aa37e7-d468-477c-ae9f-0a1ccebdf445,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57aa37e7-d4') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'pci_devices' on Instance uuid 39a5ba0f-e581-49c3-a179-62d6c333fa59 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:09:59 user nova-compute[74242]:   <uuid>39a5ba0f-e581-49c3-a179-62d6c333fa59</uuid>
Oct 20 02:09:59 user nova-compute[74242]:   <name>instance-00000013</name>
Oct 20 02:09:59 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:09:59 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:09:59 user nova-compute[74242]:   <metadata>
Oct 20 02:09:59 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:09:59 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:09:59 user nova-compute[74242]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-25051770</nova:name>
Oct 20 02:09:59 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:09:58</nova:creationTime>
Oct 20 02:09:59 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:09:59 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:09:59 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:09:59 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:09:59 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:09:59 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:09:59 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:09:59 user nova-compute[74242]:       <nova:owner>
Oct 20 02:09:59 user nova-compute[74242]:         <nova:user uuid="9ac628a224fb4653932a27e33aa33c9d">tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member</nova:user>
Oct 20 02:09:59 user nova-compute[74242]:         <nova:project uuid="112fda62d355421e80e674dc18bb5069">tempest-ServerBootFromVolumeStableRescueTest-1661425956</nova:project>
Oct 20 02:09:59 user nova-compute[74242]:       </nova:owner>
Oct 20 02:09:59 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:09:59 user nova-compute[74242]:       <nova:ports>
Oct 20 02:09:59 user nova-compute[74242]:         <nova:port uuid="57aa37e7-d468-477c-ae9f-0a1ccebdf445">
Oct 20 02:09:59 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 02:09:59 user nova-compute[74242]:         </nova:port>
Oct 20 02:09:59 user nova-compute[74242]:       </nova:ports>
Oct 20 02:09:59 user nova-compute[74242]:     </nova:instance>
Oct 20 02:09:59 user nova-compute[74242]:   </metadata>
Oct 20 02:09:59 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:09:59 user nova-compute[74242]:     <system>
Oct 20 02:09:59 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:09:59 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:09:59 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:09:59 user nova-compute[74242]:       <entry name="serial">39a5ba0f-e581-49c3-a179-62d6c333fa59</entry>
Oct 20 02:09:59 user nova-compute[74242]:       <entry name="uuid">39a5ba0f-e581-49c3-a179-62d6c333fa59</entry>
Oct 20 02:09:59 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:09:59 user nova-compute[74242]:     </system>
Oct 20 02:09:59 user nova-compute[74242]:   </sysinfo>
Oct 20 02:09:59 user nova-compute[74242]:   <os>
Oct 20 02:09:59 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:09:59 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:09:59 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:09:59 user nova-compute[74242]:   </os>
Oct 20 02:09:59 user nova-compute[74242]:   <features>
Oct 20 02:09:59 user nova-compute[74242]:     <acpi/>
Oct 20 02:09:59 user nova-compute[74242]:     <apic/>
Oct 20 02:09:59 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:09:59 user nova-compute[74242]:   </features>
Oct 20 02:09:59 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:09:59 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:09:59 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:09:59 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:09:59 user nova-compute[74242]:   </clock>
Oct 20 02:09:59 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:09:59 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:09:59 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:09:59 user nova-compute[74242]:   </cpu>
Oct 20 02:09:59 user nova-compute[74242]:   <devices>
Oct 20 02:09:59 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:09:59 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:09:59 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk"/>
Oct 20 02:09:59 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:09:59 user nova-compute[74242]:     </disk>
Oct 20 02:09:59 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:09:59 user nova-compute[74242]:       <mac address="fa:16:3e:79:1a:39"/>
Oct 20 02:09:59 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:09:59 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:09:59 user nova-compute[74242]:       <target dev="tap57aa37e7-d4"/>
Oct 20 02:09:59 user nova-compute[74242]:     </interface>
Oct 20 02:09:59 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:09:59 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/console.log" append="off"/>
Oct 20 02:09:59 user nova-compute[74242]:     </serial>
Oct 20 02:09:59 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:09:59 user nova-compute[74242]:     <video>
Oct 20 02:09:59 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:09:59 user nova-compute[74242]:     </video>
Oct 20 02:09:59 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:09:59 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:09:59 user nova-compute[74242]:     </rng>
Oct 20 02:09:59 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:09:59 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:09:59 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:09:59 user nova-compute[74242]:     </memballoon>
Oct 20 02:09:59 user nova-compute[74242]:   </devices>
Oct 20 02:09:59 user nova-compute[74242]: </domain>
Oct 20 02:09:59 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:09:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-25051770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-25051770',id=19,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112fda62d355421e80e674dc18bb5069',ramdisk_id='',reservation_id='r-o9jgeo22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:09:57Z,user_data=None,user_id='9ac628a224fb4653932a27e33aa33c9d',uuid=39a5ba0f-e581-49c3-a179-62d6c333fa59,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "address": "fa:16:3e:79:1a:39", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57aa37e7-d4", "ovs_interfaceid": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converting VIF {"id": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "address": "fa:16:3e:79:1a:39", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57aa37e7-d4", "ovs_interfaceid": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:79:1a:39,bridge_name='br-int',has_traffic_filtering=True,id=57aa37e7-d468-477c-ae9f-0a1ccebdf445,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57aa37e7-d4') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG os_vif [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:1a:39,bridge_name='br-int',has_traffic_filtering=True,id=57aa37e7-d468-477c-ae9f-0a1ccebdf445,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57aa37e7-d4') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'abd02524-6155-5cb0-b8b0-4b178175c85e', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57aa37e7-d4, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57aa37e7-d4, col_values=(('qos', UUID('3758fa9a-aa10-4e3a-b169-884a3ea4a811')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57aa37e7-d4, col_values=(('external_ids', {'iface-id': '57aa37e7-d468-477c-ae9f-0a1ccebdf445', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:79:1a:39', 'vm-uuid': '39a5ba0f-e581-49c3-a179-62d6c333fa59'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:59 user nova-compute[74242]: INFO os_vif [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:79:1a:39,bridge_name='br-int',has_traffic_filtering=True,id=57aa37e7-d468-477c-ae9f-0a1ccebdf445,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57aa37e7-d4')
Oct 20 02:09:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] No VIF found with MAC fa:16:3e:79:1a:39, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG nova.network.neutron [req-42b982e3-a357-408b-88d1-3d619d21d415 req-8721e962-0414-433b-a4e5-2a92137589f5 service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Updated VIF entry in instance network info cache for port 57aa37e7-d468-477c-ae9f-0a1ccebdf445. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG nova.network.neutron [req-42b982e3-a357-408b-88d1-3d619d21d415 req-8721e962-0414-433b-a4e5-2a92137589f5 service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Updating instance_info_cache with network_info: [{"id": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "address": "fa:16:3e:79:1a:39", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57aa37e7-d4", "ovs_interfaceid": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:09:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-42b982e3-a357-408b-88d1-3d619d21d415 req-8721e962-0414-433b-a4e5-2a92137589f5 service nova] Releasing lock "refresh_cache-39a5ba0f-e581-49c3-a179-62d6c333fa59" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:10:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-2b85f642-3df7-47a0-a125-229c60534dc1 req-08e49268-6cee-44a6-8cd6-170a23d720ea service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Received event network-vif-plugged-57aa37e7-d468-477c-ae9f-0a1ccebdf445 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2b85f642-3df7-47a0-a125-229c60534dc1 req-08e49268-6cee-44a6-8cd6-170a23d720ea service nova] Acquiring lock "39a5ba0f-e581-49c3-a179-62d6c333fa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2b85f642-3df7-47a0-a125-229c60534dc1 req-08e49268-6cee-44a6-8cd6-170a23d720ea service nova] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2b85f642-3df7-47a0-a125-229c60534dc1 req-08e49268-6cee-44a6-8cd6-170a23d720ea service nova] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-2b85f642-3df7-47a0-a125-229c60534dc1 req-08e49268-6cee-44a6-8cd6-170a23d720ea service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] No waiting events found dispatching network-vif-plugged-57aa37e7-d468-477c-ae9f-0a1ccebdf445 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:00 user nova-compute[74242]: WARNING nova.compute.manager [req-2b85f642-3df7-47a0-a125-229c60534dc1 req-08e49268-6cee-44a6-8cd6-170a23d720ea service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Received unexpected event network-vif-plugged-57aa37e7-d468-477c-ae9f-0a1ccebdf445 for instance with vm_state building and task_state spawning.
Oct 20 02:10:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:02 user nova-compute[74242]: INFO nova.compute.manager [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Terminating instance
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:10:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Creating image(s)
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Ensure instance console log exists: /opt/stack/data/nova/instances/626bb196-0e5e-4dfd-8ead-57306c828b13/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Start _get_guest_xml network_info=[{"id": "a1593d20-a266-4958-ba9d-6f03899e6195", "address": "fa:16:3e:03:a4:17", "network": {"id": "35f39b1c-01dd-4269-bb70-ee2df8e0f279", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1724814878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1593d20-a2", "ovs_interfaceid": "a1593d20-a266-4958-ba9d-6f03899e6195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17f0118a-3e44-4d76-b03a-b06790728aec", "address": "fa:16:3e:b2:ee:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17f0118a-3e", "ovs_interfaceid": "17f0118a-3e44-4d76-b03a-b06790728aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a777aac-0d50-4036-823d-017f94a044b1", "address": "fa:16:3e:6f:b4:ee", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a777aac-0d", "ovs_interfaceid": "0a777aac-0d50-4036-823d-017f94a044b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "address": "fa:16:3e:af:aa:49", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4025d0ae-da", "ovs_interfaceid": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "address": "fa:16:3e:af:36:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69d4eef-6a", "ovs_interfaceid": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "address": "fa:16:3e:48:0b:b9", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c9e8a9-b1", "ovs_interfaceid": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "address": "fa:16:3e:c5:2f:3d", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3751e3f-04", "ovs_interfaceid": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'bff419ea-afec-4fc0-99e8-2045bf67b6b9', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxlJPBft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '626bb196-0e5e-4dfd-8ead-57306c828b13', 'attached_at': '', 'detached_at': '', 'volume_id': 'bbb8694b-1d43-40e0-bacf-3b6217a16f5d', 'serial': 'bbb8694b-1d43-40e0-bacf-3b6217a16f5d'}, 'volume_type': None}, {'boot_index': 1, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '3061271c-eb0c-4078-a32d-0baf4e257def', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRvxCGTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '626bb196-0e5e-4dfd-8ead-57306c828b13', 'attached_at': '', 'detached_at': '', 'volume_id': '6e34d0dc-134e-4e91-84e6-d16394881d1c', 'serial': '6e34d0dc-134e-4e91-84e6-d16394881d1c'}, 'volume_type': None}, {'boot_index': 2, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdc', 'disk_bus': 'virtio', 'attachment_id': '17b30df0-5508-42cb-b1e0-dc91243f4d15', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iszRIhLt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '626bb196-0e5e-4dfd-8ead-57306c828b13', 'attached_at': '', 'detached_at': '', 'volume_id': '962ae9c3-39bd-4f74-8bf4-958d7e547c7a', 'serial': '962ae9c3-39bd-4f74-8bf4-958d7e547c7a'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:10:02 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:10:02 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:10:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxlJPBft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:10:02 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:10:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:10:02 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:10:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:10:02 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:10:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[194d6049-7695-42e2-833f-48e6a8164685]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:10:02 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Instance spawned successfully.
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.032s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc49759-5c6f-41db-8cff-8e301a165f2f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d] added
Oct 20 02:10:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35b4cb1-8915-4076-b7fd-86e66a7bca39]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-f45874cb-ca66-4fcb-8afc-f57f04d8152e req-831b5970-9d4d-4482-aec8-b205793740a6 service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Received event network-vif-plugged-57aa37e7-d468-477c-ae9f-0a1ccebdf445 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f45874cb-ca66-4fcb-8afc-f57f04d8152e req-831b5970-9d4d-4482-aec8-b205793740a6 service nova] Acquiring lock "39a5ba0f-e581-49c3-a179-62d6c333fa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f45874cb-ca66-4fcb-8afc-f57f04d8152e req-831b5970-9d4d-4482-aec8-b205793740a6 service nova] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f45874cb-ca66-4fcb-8afc-f57f04d8152e req-831b5970-9d4d-4482-aec8-b205793740a6 service nova] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-f45874cb-ca66-4fcb-8afc-f57f04d8152e req-831b5970-9d4d-4482-aec8-b205793740a6 service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] No waiting events found dispatching network-vif-plugged-57aa37e7-d468-477c-ae9f-0a1ccebdf445 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:02 user nova-compute[74242]: WARNING nova.compute.manager [req-f45874cb-ca66-4fcb-8afc-f57f04d8152e req-831b5970-9d4d-4482-aec8-b205793740a6 service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Received unexpected event network-vif-plugged-57aa37e7-d468-477c-ae9f-0a1ccebdf445 for instance with vm_state building and task_state spawning.
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[50937cf4-35f5-4c19-8837-f79dcca7815f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxlJPBft {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FxlJPBft" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c1cc23-9312-4b98-b527-4ed7f2664cc2]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FxlJPBft'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:02 user nova-compute[74242]: INFO nova.compute.manager [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Took 5.40 seconds to spawn the instance on the hypervisor.
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-1ab7844b-92fc-48d8-9409-e5dfcab8d865 req-5b3b668f-c2ff-41e0-80bf-107ce06d0555 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-vif-unplugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1ab7844b-92fc-48d8-9409-e5dfcab8d865 req-5b3b668f-c2ff-41e0-80bf-107ce06d0555 service nova] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1ab7844b-92fc-48d8-9409-e5dfcab8d865 req-5b3b668f-c2ff-41e0-80bf-107ce06d0555 service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1ab7844b-92fc-48d8-9409-e5dfcab8d865 req-5b3b668f-c2ff-41e0-80bf-107ce06d0555 service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-1ab7844b-92fc-48d8-9409-e5dfcab8d865 req-5b3b668f-c2ff-41e0-80bf-107ce06d0555 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] No waiting events found dispatching network-vif-unplugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-1ab7844b-92fc-48d8-9409-e5dfcab8d865 req-5b3b668f-c2ff-41e0-80bf-107ce06d0555 service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-vif-unplugged-daaa523c-866b-4afd-9e64-cd87cb820350 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.046s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60bdbcd-df5b-46cf-8601-4b756cd70215]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a7663f7-ed09-431d-849c-63c428039305]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:02 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:02 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:10:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:03 user nova-compute[74242]: INFO nova.compute.manager [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Took 6.24 seconds to build instance.
Oct 20 02:10:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[13bb44ab-b15d-4417-a1ba-45f08992d2fd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d, portal: 172.16.0.220,3260]
Oct 20 02:10:03 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d, portal: 172.16.0.220,3260] successful.
Oct 20 02:10:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8548e255-558e-4afa-8bbc-e0022877dab6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.351s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ca0b52-26c7-461b-b410-fc8e209ff8a6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e1905b-e90f-48be-8895-87fe3741bffb]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:03 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:03 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:03 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:03 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.414s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.029s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e9b89d-9829-45d6-8ea6-b758b1cf0a96]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxlJPBft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:03 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Instance destroyed successfully.
Oct 20 02:10:03 user nova-compute[74242]: DEBUG nova.objects.instance [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'resources' on Instance uuid 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T02:02:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-566546331',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-566546331',id=2,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLO87wbKYFm5G333AGmDldzgoH1ghPEuADrWLYYKcEP5y09FucUxX6mOkAqUfawuywqPj6azEOJhzxEJ7NSj3401RT/fEXGW0wPMsz7zTIUQkpJLtSnWyr1NkameoGYCrA==',key_name='tempest-keypair-869078676',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:07:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7a2695b5ad341e0afd133522f680bf9',ramdisk_id='',reservation_id='r-0l3toedx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-750275147',owner_user_name='tempest-AttachVolumeShelveTestJSON-750275147-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:07:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d6645596e24f24a216d2b4e7809073',uuid=90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converting VIF {"id": "daaa523c-866b-4afd-9e64-cd87cb820350", "address": "fa:16:3e:0b:d9:3e", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdaaa523c-86", "ovs_interfaceid": "daaa523c-866b-4afd-9e64-cd87cb820350", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0b:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=daaa523c-866b-4afd-9e64-cd87cb820350,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaaa523c-86') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG os_vif [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=daaa523c-866b-4afd-9e64-cd87cb820350,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaaa523c-86') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdaaa523c-86, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6b7edb92-81f6-46f1-85c3-9b0600a20744) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:03 user nova-compute[74242]: INFO os_vif [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0b:d9:3e,bridge_name='br-int',has_traffic_filtering=True,id=daaa523c-866b-4afd-9e64-cd87cb820350,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdaaa523c-86')
Oct 20 02:10:03 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Deleting instance files /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36_del
Oct 20 02:10:03 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Deletion of /opt/stack/data/nova/instances/90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36_del complete
Oct 20 02:10:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:03 user nova-compute[74242]: INFO nova.compute.manager [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Took 1.04 seconds to destroy the instance on the hypervisor.
Oct 20 02:10:03 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:10:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LarSqPnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:10:03 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:10:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] <== connect_volume: return (1462ms) {'type': 'block', 'scsi_wwn': '23331666666393430', 'path': '/dev/sdd'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23331666666393430', 'path': '/dev/sdd'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.418s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:10:04 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:10:04 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:10:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d936c795-1f43-4be8-aa13-10db9050e648]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:10:04 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2ba564-ec5f-4a32-afd6-50d3cc52e423]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a] added
Oct 20 02:10:04 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRvxCGTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:10:04 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ea067a2-5a02-45a6-9c28-a29b2200b861]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa3af0c-4c81-4213-a5c1-a8b691493174]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LarSqPnY {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LarSqPnY" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ccd6100-7052-4a59-9e10-a9dd7c0fce5b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LarSqPnY'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b072682-e2cb-4267-8dca-9ef4f202d38a]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f1c5e2-924e-4702-b60c-b3c0b56995d2]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:04 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:04 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:04 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:04 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:04 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:04 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[62a7efe8-a701-469e-9f5f-faf8902aceec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a, portal: 172.16.0.220,3260]
Oct 20 02:10:04 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a, portal: 172.16.0.220,3260] successful.
Oct 20 02:10:04 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6eb794f-22cc-494e-99be-24bcb1d41a63]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ebc713-4cf1-4b5e-b405-3354631a76d4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:04 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:04 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:04 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:04 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:04 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:04 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:04 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:04 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b82725-c7d2-4b80-af84-d9b9ce4bc9d7]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LarSqPnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:10:04 user nova-compute[74242]: DEBUG nova.compute.manager [req-45262282-3c6d-4b72-8070-17bccc25923f req-49d42628-ddb4-4d32-97b9-03af55857f4c service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-vif-deleted-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:04 user nova-compute[74242]: INFO nova.compute.manager [req-45262282-3c6d-4b72-8070-17bccc25923f req-49d42628-ddb4-4d32-97b9-03af55857f4c service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Neutron deleted interface daaa523c-866b-4afd-9e64-cd87cb820350; detaching it from the instance and deleting it from the info cache
Oct 20 02:10:04 user nova-compute[74242]: DEBUG nova.network.neutron [req-45262282-3c6d-4b72-8070-17bccc25923f req-49d42628-ddb4-4d32-97b9-03af55857f4c service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:10:05 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Took 1.42 seconds to deallocate network for instance.
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-45262282-3c6d-4b72-8070-17bccc25923f req-49d42628-ddb4-4d32-97b9-03af55857f4c service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Detach interface failed, port_id=daaa523c-866b-4afd-9e64-cd87cb820350, reason: Instance 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] No waiting events found dispatching network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:05 user nova-compute[74242]: WARNING nova.compute.manager [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received unexpected event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 for instance with vm_state active and task_state deleting.
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] No waiting events found dispatching network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:05 user nova-compute[74242]: WARNING nova.compute.manager [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received unexpected event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 for instance with vm_state active and task_state deleting.
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] No waiting events found dispatching network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:05 user nova-compute[74242]: WARNING nova.compute.manager [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received unexpected event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 for instance with vm_state active and task_state deleting.
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-vif-unplugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] No waiting events found dispatching network-vif-unplugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-vif-unplugged-daaa523c-866b-4afd-9e64-cd87cb820350 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] Acquiring lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] No waiting events found dispatching network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:05 user nova-compute[74242]: WARNING nova.compute.manager [req-95ce9f6b-2952-4064-b7cf-ee05eaef9581 req-b515d586-3daf-4d32-be22-a4b05abb931d service nova] [instance: 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36] Received unexpected event network-vif-plugged-daaa523c-866b-4afd-9e64-cd87cb820350 for instance with vm_state active and task_state deleting.
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:05 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Deleted allocations for instance 90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36
Oct 20 02:10:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] <== connect_volume: return (1832ms) {'type': 'block', 'scsi_wwn': '23861306334353430', 'path': '/dev/sde'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23861306334353430', 'path': '/dev/sde'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.323s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:10:05 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:10:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:10:05 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.objects.instance [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lazy-loading 'flavor' on Instance uuid 7e101002-a175-40fe-b5ca-04a58610f60d {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2c6a261-8420-42a7-9cd3-c6222f3e42ec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:10:05 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:10:05 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:10:05 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:10:05 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:10:05 user nova-compute[74242]:   <serial>16fdd93a-3729-45c1-8863-934c517cdf1a</serial>
Oct 20 02:10:05 user nova-compute[74242]: </disk>
Oct 20 02:10:05 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-862c4427-7087-477c-8b16-885435cd5bd3 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "90d8af16-6bc3-4f0d-b3c7-ac4908c2ec36" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.118s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f250bc-9af4-4ebf-9eb2-8f63086d4b90]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c] added
Oct 20 02:10:05 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e48550cd-dcee-419a-97f8-c22359886bdb]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[404db8ab-bae6-4468-81ac-4d2966781deb]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRvxCGTz {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MRvxCGTz" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2068b20-b7d6-4efd-83df-95286c13ae92]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MRvxCGTz'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[80bbdf21-dd5f-49fe-91c8-39464456ccf1]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f788261-90b3-40fc-9f91-ea1160354f97]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:05 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:05 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:05 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:05 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:05 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:05 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:05 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:05 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[de80a30b-906b-4035-bd1f-22ae4f720c22]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c, portal: 172.16.0.220,3260]
Oct 20 02:10:05 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c, portal: 172.16.0.220,3260] successful.
Oct 20 02:10:05 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[02e49797-0ef6-4879-bbea-6a452eddcc21]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cccab60-26e7-4fac-81ad-f9b93e38f785]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:06 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:06 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:06 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:06 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:10:06 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:10:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:06 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:06 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:06 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:06 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:10:06 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:10:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.425s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:10:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:10:06 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:10:06 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:10:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf1b404-057c-4e6d-a399-53a4d217cbe1]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:06 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:10:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRvxCGTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:10:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:10:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:10:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] No VIF found with MAC fa:16:3e:72:d7:10, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:10:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d36c5218-a649-4f10-b128-e524cea787bb tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "7e101002-a175-40fe-b5ca-04a58610f60d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 22.430s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.464s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] <== connect_volume: return (2788ms) {'type': 'block', 'scsi_wwn': '23762333864373539', 'path': '/dev/sdf'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23762333864373539', 'path': '/dev/sdf'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iszRIhLt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:10:07 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:10:07 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:10:07 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3613516-7017-439f-af91-fa8107d4b676]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:10:07 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0185e7-6c97-4c88-a9d8-e5f05ba110c9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a] added
Oct 20 02:10:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b26db0e7-72b2-424e-b7cf-f19b365ff4e6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6442de-e484-40dd-bc87-acf9a11675df]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iszRIhLt {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iszRIhLt" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aae9bbc-0995-460a-8512-ca93772d6322]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iszRIhLt'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8536957-7763-4fc8-90f2-dfb96f6c3823]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c05af9-15fa-46b3-bd68-cd67af92fa8f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:10:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:10:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[02db7004-6174-4fbe-9e82-1b6c220ccdf2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a, portal: 172.16.0.220,3260]
Oct 20 02:10:07 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a, portal: 172.16.0.220,3260] successful.
Oct 20 02:10:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7841b55c-2dab-4fdf-bf74-1c042ed6a5ef]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a88a14-9f0e-41d0-8a59-3d08a34eef2c]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:10:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:10:07 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:10:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.387s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9411f5bd-47af-4a0b-a88c-dab497e3020b]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iszRIhLt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "7e101002-a175-40fe-b5ca-04a58610f60d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "7e101002-a175-40fe-b5ca-04a58610f60d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:07 user nova-compute[74242]: INFO nova.compute.manager [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Detaching volume 16fdd93a-3729-45c1-8863-934c517cdf1a
Oct 20 02:10:07 user nova-compute[74242]: INFO nova.virt.block_device [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Attempting to driver detach volume 16fdd93a-3729-45c1-8863-934c517cdf1a from mountpoint /dev/vdb
Oct 20 02:10:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Attempting to detach device vdb from instance 7e101002-a175-40fe-b5ca-04a58610f60d from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:10:07 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:10:07 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:10:07 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:10:07 user nova-compute[74242]:   <serial>16fdd93a-3729-45c1-8863-934c517cdf1a</serial>
Oct 20 02:10:07 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:10:07 user nova-compute[74242]: </disk>
Oct 20 02:10:07 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:10:07 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Successfully detached device vdb from instance 7e101002-a175-40fe-b5ca-04a58610f60d from the persistent domain config.
Oct 20 02:10:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7e101002-a175-40fe-b5ca-04a58610f60d from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:10:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:10:07 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:10:07 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:10:07 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:10:07 user nova-compute[74242]:   <serial>16fdd93a-3729-45c1-8863-934c517cdf1a</serial>
Oct 20 02:10:07 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:10:07 user nova-compute[74242]: </disk>
Oct 20 02:10:07 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7e101002-a175-40fe-b5ca-04a58610f60d {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.447s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] <== connect_volume: return (1449ms) {'type': 'block', 'scsi_wwn': '23034356461383866', 'path': '/dev/sdg'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23034356461383866', 'path': '/dev/sdg'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1593d20-a266-4958-ba9d-6f03899e6195", "address": "fa:16:3e:03:a4:17", "network": {"id": "35f39b1c-01dd-4269-bb70-ee2df8e0f279", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1724814878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1593d20-a2", "ovs_interfaceid": "a1593d20-a266-4958-ba9d-6f03899e6195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "a1593d20-a266-4958-ba9d-6f03899e6195", "address": "fa:16:3e:03:a4:17", "network": {"id": "35f39b1c-01dd-4269-bb70-ee2df8e0f279", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1724814878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1593d20-a2", "ovs_interfaceid": "a1593d20-a266-4958-ba9d-6f03899e6195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:a4:17,bridge_name='br-int',has_traffic_filtering=True,id=a1593d20-a266-4958-ba9d-6f03899e6195,network=Network(35f39b1c-01dd-4269-bb70-ee2df8e0f279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1593d20-a2') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17f0118a-3e44-4d76-b03a-b06790728aec", "address": "fa:16:3e:b2:ee:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17f0118a-3e", "ovs_interfaceid": "17f0118a-3e44-4d76-b03a-b06790728aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "17f0118a-3e44-4d76-b03a-b06790728aec", "address": "fa:16:3e:b2:ee:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17f0118a-3e", "ovs_interfaceid": "17f0118a-3e44-4d76-b03a-b06790728aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ee:46,bridge_name='br-int',has_traffic_filtering=True,id=17f0118a-3e44-4d76-b03a-b06790728aec,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17f0118a-3e') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a777aac-0d50-4036-823d-017f94a044b1", "address": "fa:16:3e:6f:b4:ee", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a777aac-0d", "ovs_interfaceid": "0a777aac-0d50-4036-823d-017f94a044b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "0a777aac-0d50-4036-823d-017f94a044b1", "address": "fa:16:3e:6f:b4:ee", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a777aac-0d", "ovs_interfaceid": "0a777aac-0d50-4036-823d-017f94a044b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b4:ee,bridge_name='br-int',has_traffic_filtering=True,id=0a777aac-0d50-4036-823d-017f94a044b1,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0a777aac-0d') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "address": "fa:16:3e:af:aa:49", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4025d0ae-da", "ovs_interfaceid": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "address": "fa:16:3e:af:aa:49", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4025d0ae-da", "ovs_interfaceid": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:aa:49,bridge_name='br-int',has_traffic_filtering=True,id=4025d0ae-da49-4ae1-93ca-5fb17863f713,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4025d0ae-da') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "address": "fa:16:3e:af:36:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69d4eef-6a", "ovs_interfaceid": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "address": "fa:16:3e:af:36:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69d4eef-6a", "ovs_interfaceid": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:36:46,bridge_name='br-int',has_traffic_filtering=True,id=d69d4eef-6af5-4d1d-8e7e-49a60dc36111,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69d4eef-6a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "address": "fa:16:3e:48:0b:b9", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c9e8a9-b1", "ovs_interfaceid": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "address": "fa:16:3e:48:0b:b9", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c9e8a9-b1", "ovs_interfaceid": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:0b:b9,bridge_name='br-int',has_traffic_filtering=True,id=a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9,network=Network(14bf9904-61c1-4cbf-ab7c-e6458c827909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c9e8a9-b1') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "address": "fa:16:3e:c5:2f:3d", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3751e3f-04", "ovs_interfaceid": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "address": "fa:16:3e:c5:2f:3d", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3751e3f-04", "ovs_interfaceid": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:2f:3d,bridge_name='br-int',has_traffic_filtering=True,id=a3751e3f-044b-44fc-94ab-9e54484b46cc,network=Network(14bf9904-61c1-4cbf-ab7c-e6458c827909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3751e3f-04') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.objects.instance [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lazy-loading 'pci_devices' on Instance uuid 626bb196-0e5e-4dfd-8ead-57306c828b13 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:10:08 user nova-compute[74242]:   <uuid>626bb196-0e5e-4dfd-8ead-57306c828b13</uuid>
Oct 20 02:10:08 user nova-compute[74242]:   <name>instance-0000000e</name>
Oct 20 02:10:08 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:10:08 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:10:08 user nova-compute[74242]:   <metadata>
Oct 20 02:10:08 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:10:08 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:10:08 user nova-compute[74242]:       <nova:name>tempest-device-tagging-server-1429375259</nova:name>
Oct 20 02:10:08 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:10:02</nova:creationTime>
Oct 20 02:10:08 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:10:08 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:10:08 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:10:08 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:10:08 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:10:08 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:10:08 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:10:08 user nova-compute[74242]:       <nova:owner>
Oct 20 02:10:08 user nova-compute[74242]:         <nova:user uuid="a1d648d2ff70456aaaa6f6cbeec5c565">tempest-TaggedBootDevicesTest_v242-1934919575-project-member</nova:user>
Oct 20 02:10:08 user nova-compute[74242]:         <nova:project uuid="62401f86776f46bdba398c876de8a575">tempest-TaggedBootDevicesTest_v242-1934919575</nova:project>
Oct 20 02:10:08 user nova-compute[74242]:       </nova:owner>
Oct 20 02:10:08 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:10:08 user nova-compute[74242]:       <nova:ports>
Oct 20 02:10:08 user nova-compute[74242]:         <nova:port uuid="a1593d20-a266-4958-ba9d-6f03899e6195">
Oct 20 02:10:08 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 02:10:08 user nova-compute[74242]:         </nova:port>
Oct 20 02:10:08 user nova-compute[74242]:         <nova:port uuid="17f0118a-3e44-4d76-b03a-b06790728aec">
Oct 20 02:10:08 user nova-compute[74242]:           <nova:ip type="fixed" address="10.1.1.127" ipVersion="4"/>
Oct 20 02:10:08 user nova-compute[74242]:         </nova:port>
Oct 20 02:10:08 user nova-compute[74242]:         <nova:port uuid="0a777aac-0d50-4036-823d-017f94a044b1">
Oct 20 02:10:08 user nova-compute[74242]:           <nova:ip type="fixed" address="10.1.1.78" ipVersion="4"/>
Oct 20 02:10:08 user nova-compute[74242]:         </nova:port>
Oct 20 02:10:08 user nova-compute[74242]:         <nova:port uuid="4025d0ae-da49-4ae1-93ca-5fb17863f713">
Oct 20 02:10:08 user nova-compute[74242]:           <nova:ip type="fixed" address="10.1.1.204" ipVersion="4"/>
Oct 20 02:10:08 user nova-compute[74242]:         </nova:port>
Oct 20 02:10:08 user nova-compute[74242]:         <nova:port uuid="d69d4eef-6af5-4d1d-8e7e-49a60dc36111">
Oct 20 02:10:08 user nova-compute[74242]:           <nova:ip type="fixed" address="10.1.1.148" ipVersion="4"/>
Oct 20 02:10:08 user nova-compute[74242]:         </nova:port>
Oct 20 02:10:08 user nova-compute[74242]:         <nova:port uuid="a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9">
Oct 20 02:10:08 user nova-compute[74242]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Oct 20 02:10:08 user nova-compute[74242]:         </nova:port>
Oct 20 02:10:08 user nova-compute[74242]:         <nova:port uuid="a3751e3f-044b-44fc-94ab-9e54484b46cc">
Oct 20 02:10:08 user nova-compute[74242]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Oct 20 02:10:08 user nova-compute[74242]:         </nova:port>
Oct 20 02:10:08 user nova-compute[74242]:       </nova:ports>
Oct 20 02:10:08 user nova-compute[74242]:     </nova:instance>
Oct 20 02:10:08 user nova-compute[74242]:   </metadata>
Oct 20 02:10:08 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:10:08 user nova-compute[74242]:     <system>
Oct 20 02:10:08 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:10:08 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:10:08 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:10:08 user nova-compute[74242]:       <entry name="serial">626bb196-0e5e-4dfd-8ead-57306c828b13</entry>
Oct 20 02:10:08 user nova-compute[74242]:       <entry name="uuid">626bb196-0e5e-4dfd-8ead-57306c828b13</entry>
Oct 20 02:10:08 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:10:08 user nova-compute[74242]:     </system>
Oct 20 02:10:08 user nova-compute[74242]:   </sysinfo>
Oct 20 02:10:08 user nova-compute[74242]:   <os>
Oct 20 02:10:08 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:10:08 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:10:08 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:10:08 user nova-compute[74242]:   </os>
Oct 20 02:10:08 user nova-compute[74242]:   <features>
Oct 20 02:10:08 user nova-compute[74242]:     <acpi/>
Oct 20 02:10:08 user nova-compute[74242]:     <apic/>
Oct 20 02:10:08 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:10:08 user nova-compute[74242]:   </features>
Oct 20 02:10:08 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:10:08 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:10:08 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:10:08 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:10:08 user nova-compute[74242]:   </clock>
Oct 20 02:10:08 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:10:08 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:10:08 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:10:08 user nova-compute[74242]:   </cpu>
Oct 20 02:10:08 user nova-compute[74242]:   <devices>
Oct 20 02:10:08 user nova-compute[74242]:     <disk type="file" device="cdrom">
Oct 20 02:10:08 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none"/>
Oct 20 02:10:08 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/626bb196-0e5e-4dfd-8ead-57306c828b13/disk.config"/>
Oct 20 02:10:08 user nova-compute[74242]:       <target dev="hda" bus="ide"/>
Oct 20 02:10:08 user nova-compute[74242]:     </disk>
Oct 20 02:10:08 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:10:08 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:10:08 user nova-compute[74242]:       <source dev="/dev/sdd"/>
Oct 20 02:10:08 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:10:08 user nova-compute[74242]:       <serial>bbb8694b-1d43-40e0-bacf-3b6217a16f5d</serial>
Oct 20 02:10:08 user nova-compute[74242]:     </disk>
Oct 20 02:10:08 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:10:08 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:10:08 user nova-compute[74242]:       <source dev="/dev/sdf"/>
Oct 20 02:10:08 user nova-compute[74242]:       <target dev="vdb" bus="virtio"/>
Oct 20 02:10:08 user nova-compute[74242]:       <serial>6e34d0dc-134e-4e91-84e6-d16394881d1c</serial>
Oct 20 02:10:08 user nova-compute[74242]:     </disk>
Oct 20 02:10:08 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:10:08 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:10:08 user nova-compute[74242]:       <source dev="/dev/sdg"/>
Oct 20 02:10:08 user nova-compute[74242]:       <target dev="vdc" bus="virtio"/>
Oct 20 02:10:08 user nova-compute[74242]:       <serial>962ae9c3-39bd-4f74-8bf4-958d7e547c7a</serial>
Oct 20 02:10:08 user nova-compute[74242]:     </disk>
Oct 20 02:10:08 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:10:08 user nova-compute[74242]:       <mac address="fa:16:3e:03:a4:17"/>
Oct 20 02:10:08 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:10:08 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:10:08 user nova-compute[74242]:       <target dev="tapa1593d20-a2"/>
Oct 20 02:10:08 user nova-compute[74242]:     </interface>
Oct 20 02:10:08 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:10:08 user nova-compute[74242]:       <mac address="fa:16:3e:b2:ee:46"/>
Oct 20 02:10:08 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:10:08 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:10:08 user nova-compute[74242]:       <target dev="tap17f0118a-3e"/>
Oct 20 02:10:08 user nova-compute[74242]:     </interface>
Oct 20 02:10:08 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:10:08 user nova-compute[74242]:       <mac address="fa:16:3e:6f:b4:ee"/>
Oct 20 02:10:08 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:10:08 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:10:08 user nova-compute[74242]:       <target dev="tap0a777aac-0d"/>
Oct 20 02:10:08 user nova-compute[74242]:     </interface>
Oct 20 02:10:08 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:10:08 user nova-compute[74242]:       <mac address="fa:16:3e:af:aa:49"/>
Oct 20 02:10:08 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:10:08 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:10:08 user nova-compute[74242]:       <target dev="tap4025d0ae-da"/>
Oct 20 02:10:08 user nova-compute[74242]:     </interface>
Oct 20 02:10:08 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:10:08 user nova-compute[74242]:       <mac address="fa:16:3e:af:36:46"/>
Oct 20 02:10:08 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:10:08 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:10:08 user nova-compute[74242]:       <target dev="tapd69d4eef-6a"/>
Oct 20 02:10:08 user nova-compute[74242]:     </interface>
Oct 20 02:10:08 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:10:08 user nova-compute[74242]:       <mac address="fa:16:3e:48:0b:b9"/>
Oct 20 02:10:08 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:10:08 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:10:08 user nova-compute[74242]:       <target dev="tapa3c9e8a9-b1"/>
Oct 20 02:10:08 user nova-compute[74242]:     </interface>
Oct 20 02:10:08 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:10:08 user nova-compute[74242]:       <mac address="fa:16:3e:c5:2f:3d"/>
Oct 20 02:10:08 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:10:08 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:10:08 user nova-compute[74242]:       <target dev="tapa3751e3f-04"/>
Oct 20 02:10:08 user nova-compute[74242]:     </interface>
Oct 20 02:10:08 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:10:08 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/626bb196-0e5e-4dfd-8ead-57306c828b13/console.log" append="off"/>
Oct 20 02:10:08 user nova-compute[74242]:     </serial>
Oct 20 02:10:08 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:10:08 user nova-compute[74242]:     <video>
Oct 20 02:10:08 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:10:08 user nova-compute[74242]:     </video>
Oct 20 02:10:08 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:10:08 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:10:08 user nova-compute[74242]:     </rng>
Oct 20 02:10:08 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:10:08 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:10:08 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:10:08 user nova-compute[74242]:     </memballoon>
Oct 20 02:10:08 user nova-compute[74242]:   </devices>
Oct 20 02:10:08 user nova-compute[74242]: </domain>
Oct 20 02:10:08 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a1593d20-a266-4958-ba9d-6f03899e6195", "address": "fa:16:3e:03:a4:17", "network": {"id": "35f39b1c-01dd-4269-bb70-ee2df8e0f279", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1724814878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1593d20-a2", "ovs_interfaceid": "a1593d20-a266-4958-ba9d-6f03899e6195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "a1593d20-a266-4958-ba9d-6f03899e6195", "address": "fa:16:3e:03:a4:17", "network": {"id": "35f39b1c-01dd-4269-bb70-ee2df8e0f279", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1724814878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1593d20-a2", "ovs_interfaceid": "a1593d20-a266-4958-ba9d-6f03899e6195", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:a4:17,bridge_name='br-int',has_traffic_filtering=True,id=a1593d20-a266-4958-ba9d-6f03899e6195,network=Network(35f39b1c-01dd-4269-bb70-ee2df8e0f279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1593d20-a2') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG os_vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:a4:17,bridge_name='br-int',has_traffic_filtering=True,id=a1593d20-a266-4958-ba9d-6f03899e6195,network=Network(35f39b1c-01dd-4269-bb70-ee2df8e0f279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1593d20-a2') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7aad379c-e1bd-5247-92db-e00a10374df4', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa1593d20-a2, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa1593d20-a2, col_values=(('qos', UUID('1b58b943-181c-4447-91fd-9572d025ea4f')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa1593d20-a2, col_values=(('external_ids', {'iface-id': 'a1593d20-a266-4958-ba9d-6f03899e6195', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:a4:17', 'vm-uuid': '626bb196-0e5e-4dfd-8ead-57306c828b13'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: INFO os_vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:a4:17,bridge_name='br-int',has_traffic_filtering=True,id=a1593d20-a266-4958-ba9d-6f03899e6195,network=Network(35f39b1c-01dd-4269-bb70-ee2df8e0f279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1593d20-a2')
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17f0118a-3e44-4d76-b03a-b06790728aec", "address": "fa:16:3e:b2:ee:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17f0118a-3e", "ovs_interfaceid": "17f0118a-3e44-4d76-b03a-b06790728aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "17f0118a-3e44-4d76-b03a-b06790728aec", "address": "fa:16:3e:b2:ee:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17f0118a-3e", "ovs_interfaceid": "17f0118a-3e44-4d76-b03a-b06790728aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ee:46,bridge_name='br-int',has_traffic_filtering=True,id=17f0118a-3e44-4d76-b03a-b06790728aec,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17f0118a-3e') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG os_vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ee:46,bridge_name='br-int',has_traffic_filtering=True,id=17f0118a-3e44-4d76-b03a-b06790728aec,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17f0118a-3e') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab7a5e65-2fc4-546a-b656-68d195c61c4f', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17f0118a-3e, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17f0118a-3e, col_values=(('qos', UUID('3cf38c79-3ec4-48bc-b56d-366cab4a69b9')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17f0118a-3e, col_values=(('external_ids', {'iface-id': '17f0118a-3e44-4d76-b03a-b06790728aec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b2:ee:46', 'vm-uuid': '626bb196-0e5e-4dfd-8ead-57306c828b13'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: INFO os_vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ee:46,bridge_name='br-int',has_traffic_filtering=True,id=17f0118a-3e44-4d76-b03a-b06790728aec,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17f0118a-3e')
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0a777aac-0d50-4036-823d-017f94a044b1", "address": "fa:16:3e:6f:b4:ee", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a777aac-0d", "ovs_interfaceid": "0a777aac-0d50-4036-823d-017f94a044b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "0a777aac-0d50-4036-823d-017f94a044b1", "address": "fa:16:3e:6f:b4:ee", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a777aac-0d", "ovs_interfaceid": "0a777aac-0d50-4036-823d-017f94a044b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b4:ee,bridge_name='br-int',has_traffic_filtering=True,id=0a777aac-0d50-4036-823d-017f94a044b1,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0a777aac-0d') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG os_vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b4:ee,bridge_name='br-int',has_traffic_filtering=True,id=0a777aac-0d50-4036-823d-017f94a044b1,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0a777aac-0d') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c568b48b-bded-5458-b997-2bc36463c8db', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0a777aac-0d, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0a777aac-0d, col_values=(('qos', UUID('81f9528d-feb7-4fe8-b737-f88d22cee93e')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0a777aac-0d, col_values=(('external_ids', {'iface-id': '0a777aac-0d50-4036-823d-017f94a044b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6f:b4:ee', 'vm-uuid': '626bb196-0e5e-4dfd-8ead-57306c828b13'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: INFO os_vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b4:ee,bridge_name='br-int',has_traffic_filtering=True,id=0a777aac-0d50-4036-823d-017f94a044b1,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0a777aac-0d')
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "address": "fa:16:3e:af:aa:49", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4025d0ae-da", "ovs_interfaceid": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "address": "fa:16:3e:af:aa:49", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4025d0ae-da", "ovs_interfaceid": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:aa:49,bridge_name='br-int',has_traffic_filtering=True,id=4025d0ae-da49-4ae1-93ca-5fb17863f713,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4025d0ae-da') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG os_vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:aa:49,bridge_name='br-int',has_traffic_filtering=True,id=4025d0ae-da49-4ae1-93ca-5fb17863f713,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4025d0ae-da') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a18eda0e-4f24-5438-8d8a-296993b0c996', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4025d0ae-da, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4025d0ae-da, col_values=(('qos', UUID('5265d248-8148-487b-a93c-ee9ff4e9515e')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4025d0ae-da, col_values=(('external_ids', {'iface-id': '4025d0ae-da49-4ae1-93ca-5fb17863f713', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:aa:49', 'vm-uuid': '626bb196-0e5e-4dfd-8ead-57306c828b13'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: INFO os_vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:aa:49,bridge_name='br-int',has_traffic_filtering=True,id=4025d0ae-da49-4ae1-93ca-5fb17863f713,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4025d0ae-da')
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "address": "fa:16:3e:af:36:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69d4eef-6a", "ovs_interfaceid": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "address": "fa:16:3e:af:36:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69d4eef-6a", "ovs_interfaceid": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:36:46,bridge_name='br-int',has_traffic_filtering=True,id=d69d4eef-6af5-4d1d-8e7e-49a60dc36111,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69d4eef-6a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG os_vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:36:46,bridge_name='br-int',has_traffic_filtering=True,id=d69d4eef-6af5-4d1d-8e7e-49a60dc36111,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69d4eef-6a') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '480c5714-ff04-5394-b10c-acd85ab60abc', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd69d4eef-6a, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd69d4eef-6a, col_values=(('qos', UUID('51624fb2-cc85-40f3-bb7f-cc7552d0aadf')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd69d4eef-6a, col_values=(('external_ids', {'iface-id': 'd69d4eef-6af5-4d1d-8e7e-49a60dc36111', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:af:36:46', 'vm-uuid': '626bb196-0e5e-4dfd-8ead-57306c828b13'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:09 user nova-compute[74242]: INFO os_vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:36:46,bridge_name='br-int',has_traffic_filtering=True,id=d69d4eef-6af5-4d1d-8e7e-49a60dc36111,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69d4eef-6a')
Oct 20 02:10:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "address": "fa:16:3e:48:0b:b9", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c9e8a9-b1", "ovs_interfaceid": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "address": "fa:16:3e:48:0b:b9", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c9e8a9-b1", "ovs_interfaceid": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:0b:b9,bridge_name='br-int',has_traffic_filtering=True,id=a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9,network=Network(14bf9904-61c1-4cbf-ab7c-e6458c827909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c9e8a9-b1') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG os_vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0b:b9,bridge_name='br-int',has_traffic_filtering=True,id=a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9,network=Network(14bf9904-61c1-4cbf-ab7c-e6458c827909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c9e8a9-b1') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6863fb33-7453-5005-bb4e-0ba213b781a2', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3c9e8a9-b1, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3c9e8a9-b1, col_values=(('qos', UUID('40fa1754-9bfd-4348-8299-2ab3ee1050b7')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3c9e8a9-b1, col_values=(('external_ids', {'iface-id': 'a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:0b:b9', 'vm-uuid': '626bb196-0e5e-4dfd-8ead-57306c828b13'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:09 user nova-compute[74242]: INFO os_vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0b:b9,bridge_name='br-int',has_traffic_filtering=True,id=a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9,network=Network(14bf9904-61c1-4cbf-ab7c-e6458c827909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c9e8a9-b1')
Oct 20 02:10:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:07:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "address": "fa:16:3e:c5:2f:3d", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3751e3f-04", "ovs_interfaceid": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "address": "fa:16:3e:c5:2f:3d", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3751e3f-04", "ovs_interfaceid": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:2f:3d,bridge_name='br-int',has_traffic_filtering=True,id=a3751e3f-044b-44fc-94ab-9e54484b46cc,network=Network(14bf9904-61c1-4cbf-ab7c-e6458c827909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3751e3f-04') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG os_vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:2f:3d,bridge_name='br-int',has_traffic_filtering=True,id=a3751e3f-044b-44fc-94ab-9e54484b46cc,network=Network(14bf9904-61c1-4cbf-ab7c-e6458c827909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3751e3f-04') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7edda292-d847-5d7c-a444-7a9f514ddd6b', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa3751e3f-04, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa3751e3f-04, col_values=(('qos', UUID('5200483d-3190-419d-9cf1-a1b79334124e')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa3751e3f-04, col_values=(('external_ids', {'iface-id': 'a3751e3f-044b-44fc-94ab-9e54484b46cc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:2f:3d', 'vm-uuid': '626bb196-0e5e-4dfd-8ead-57306c828b13'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:09 user nova-compute[74242]: INFO os_vif [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:2f:3d,bridge_name='br-int',has_traffic_filtering=True,id=a3751e3f-044b-44fc-94ab-9e54484b46cc,network=Network(14bf9904-61c1-4cbf-ab7c-e6458c827909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3751e3f-04')
Oct 20 02:10:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] No BDM found with device name hda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] No VIF found with MAC fa:16:3e:03:a4:17, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] No VIF found with MAC fa:16:3e:af:36:46, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:10:09 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Using config drive
Oct 20 02:10:09 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Creating config drive at /opt/stack/data/nova/instances/626bb196-0e5e-4dfd-8ead-57306c828b13/disk.config
Oct 20 02:10:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/626bb196-0e5e-4dfd-8ead-57306c828b13/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpugjorudh {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/626bb196-0e5e-4dfd-8ead-57306c828b13/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpugjorudh" returned: 0 in 0.067s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:11 user nova-compute[74242]: DEBUG nova.compute.manager [req-a52ce869-4f9e-430d-8ff1-d8b6986d2179 req-7b04d4d1-f2d7-4767-b727-8dd377729704 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-a1593d20-a266-4958-ba9d-6f03899e6195 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a52ce869-4f9e-430d-8ff1-d8b6986d2179 req-7b04d4d1-f2d7-4767-b727-8dd377729704 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a52ce869-4f9e-430d-8ff1-d8b6986d2179 req-7b04d4d1-f2d7-4767-b727-8dd377729704 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a52ce869-4f9e-430d-8ff1-d8b6986d2179 req-7b04d4d1-f2d7-4767-b727-8dd377729704 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:11 user nova-compute[74242]: DEBUG nova.compute.manager [req-a52ce869-4f9e-430d-8ff1-d8b6986d2179 req-7b04d4d1-f2d7-4767-b727-8dd377729704 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-a1593d20-a266-4958-ba9d-6f03899e6195 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:11 user nova-compute[74242]: WARNING nova.compute.manager [req-a52ce869-4f9e-430d-8ff1-d8b6986d2179 req-7b04d4d1-f2d7-4767-b727-8dd377729704 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-a1593d20-a266-4958-ba9d-6f03899e6195 for instance with vm_state building and task_state spawning.
Oct 20 02:10:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG nova.compute.manager [req-30bfb602-d885-46c8-9bde-123ac0763ec6 req-38bda98c-e041-4960-aeda-0f5c5bacb7f4 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-17f0118a-3e44-4d76-b03a-b06790728aec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-30bfb602-d885-46c8-9bde-123ac0763ec6 req-38bda98c-e041-4960-aeda-0f5c5bacb7f4 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-30bfb602-d885-46c8-9bde-123ac0763ec6 req-38bda98c-e041-4960-aeda-0f5c5bacb7f4 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-30bfb602-d885-46c8-9bde-123ac0763ec6 req-38bda98c-e041-4960-aeda-0f5c5bacb7f4 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG nova.compute.manager [req-30bfb602-d885-46c8-9bde-123ac0763ec6 req-38bda98c-e041-4960-aeda-0f5c5bacb7f4 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-17f0118a-3e44-4d76-b03a-b06790728aec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:12 user nova-compute[74242]: WARNING nova.compute.manager [req-30bfb602-d885-46c8-9bde-123ac0763ec6 req-38bda98c-e041-4960-aeda-0f5c5bacb7f4 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-17f0118a-3e44-4d76-b03a-b06790728aec for instance with vm_state building and task_state spawning.
Oct 20 02:10:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG nova.compute.manager [req-7c16a759-424e-4849-b42d-c8dd98ff59bc req-581a5e23-6d58-4258-9542-dd73985c1155 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-0a777aac-0d50-4036-823d-017f94a044b1 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7c16a759-424e-4849-b42d-c8dd98ff59bc req-581a5e23-6d58-4258-9542-dd73985c1155 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7c16a759-424e-4849-b42d-c8dd98ff59bc req-581a5e23-6d58-4258-9542-dd73985c1155 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7c16a759-424e-4849-b42d-c8dd98ff59bc req-581a5e23-6d58-4258-9542-dd73985c1155 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG nova.compute.manager [req-7c16a759-424e-4849-b42d-c8dd98ff59bc req-581a5e23-6d58-4258-9542-dd73985c1155 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-0a777aac-0d50-4036-823d-017f94a044b1 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:12 user nova-compute[74242]: WARNING nova.compute.manager [req-7c16a759-424e-4849-b42d-c8dd98ff59bc req-581a5e23-6d58-4258-9542-dd73985c1155 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-0a777aac-0d50-4036-823d-017f94a044b1 for instance with vm_state building and task_state spawning.
Oct 20 02:10:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGQhFZIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:10:12 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:10:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.014s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:10:12 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:10:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:10:12 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:10:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260" returned: 21 in 0.039s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d78f960-064b-4e22-a593-983038cee219]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:10:12 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6c8ad77-cc46-4483-b586-7824b9408166]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb] added
Oct 20 02:10:12 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7d36728-d01a-47e0-ba28-a1e07298448b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c316628-2dff-4db4-ae15-0f543204b5cd]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGQhFZIU {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGQhFZIU" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fba8e3-047d-4ef0-8d53-c2c38d5f18a1]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oGQhFZIU'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba3afa9-e58c-4d9b-8323-cb1d69f1d20f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[281f1a45-32a9-47b4-8719-2e6a4d5b04be]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:10:13 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:10:13 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --login" returned: 0 in 0.123s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5694e044-3a9a-4b68-8907-0549da6dfa66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260]
Oct 20 02:10:13 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260] successful.
Oct 20 02:10:13 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8705090c-3578-4b26-adb0-112f3be736ac]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1243efd-6a0a-4208-ab7d-49824818447f]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:10:13 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:10:13 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:10:13 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.494s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] HCTL ('39', '-', '-', 0) found on session 21 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee92d31-e230-4548-840a-2c0dc642851d]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Searching for a device in session 21 and hctl ['39', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG nova.compute.manager [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-a1593d20-a266-4958-ba9d-6f03899e6195 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG nova.compute.manager [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-a1593d20-a266-4958-ba9d-6f03899e6195 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:13 user nova-compute[74242]: WARNING nova.compute.manager [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-a1593d20-a266-4958-ba9d-6f03899e6195 for instance with vm_state building and task_state spawning.
Oct 20 02:10:13 user nova-compute[74242]: DEBUG nova.compute.manager [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-4025d0ae-da49-4ae1-93ca-5fb17863f713 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG nova.compute.manager [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-4025d0ae-da49-4ae1-93ca-5fb17863f713 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:13 user nova-compute[74242]: WARNING nova.compute.manager [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-4025d0ae-da49-4ae1-93ca-5fb17863f713 for instance with vm_state building and task_state spawning.
Oct 20 02:10:13 user nova-compute[74242]: DEBUG nova.compute.manager [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-4025d0ae-da49-4ae1-93ca-5fb17863f713 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG nova.compute.manager [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-4025d0ae-da49-4ae1-93ca-5fb17863f713 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:13 user nova-compute[74242]: WARNING nova.compute.manager [req-e0f0eaaf-7ee3-4821-af9b-d93b9021e5cd req-23919e78-2126-4f0e-8dd4-ca7f5cfd5c11 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-4025d0ae-da49-4ae1-93ca-5fb17863f713 for instance with vm_state building and task_state spawning.
Oct 20 02:10:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG nova.compute.manager [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-17f0118a-3e44-4d76-b03a-b06790728aec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG nova.compute.manager [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-17f0118a-3e44-4d76-b03a-b06790728aec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:14 user nova-compute[74242]: WARNING nova.compute.manager [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-17f0118a-3e44-4d76-b03a-b06790728aec for instance with vm_state building and task_state spawning.
Oct 20 02:10:14 user nova-compute[74242]: DEBUG nova.compute.manager [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-d69d4eef-6af5-4d1d-8e7e-49a60dc36111 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG nova.compute.manager [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-d69d4eef-6af5-4d1d-8e7e-49a60dc36111 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:14 user nova-compute[74242]: WARNING nova.compute.manager [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-d69d4eef-6af5-4d1d-8e7e-49a60dc36111 for instance with vm_state building and task_state spawning.
Oct 20 02:10:14 user nova-compute[74242]: DEBUG nova.compute.manager [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-d69d4eef-6af5-4d1d-8e7e-49a60dc36111 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG nova.compute.manager [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-d69d4eef-6af5-4d1d-8e7e-49a60dc36111 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:14 user nova-compute[74242]: WARNING nova.compute.manager [req-80cc1ac5-5764-4fce-93a9-c64fcee7013d req-00bc1a94-e5b7-444e-9a7f-3d0248f50c1f service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-d69d4eef-6af5-4d1d-8e7e-49a60dc36111 for instance with vm_state building and task_state spawning.
Oct 20 02:10:14 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Searching for a device in session 21 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGQhFZIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.547s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] <== connect_volume: return (1561ms) {'type': 'block', 'scsi_wwn': '26463633730623264', 'path': '/dev/sdh'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463633730623264', 'path': '/dev/sdh'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG nova.objects.instance [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lazy-loading 'flavor' on Instance uuid 72003d17-9292-4bdd-acfc-0d3f7e40df80 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:10:14 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:10:14 user nova-compute[74242]:   <source dev="/dev/sdh"/>
Oct 20 02:10:14 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:10:14 user nova-compute[74242]:   <serial>a57d408c-853f-4859-bbe9-7608dc3157cb</serial>
Oct 20 02:10:14 user nova-compute[74242]: </disk>
Oct 20 02:10:14 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG nova.compute.manager [req-56a265ab-da39-4898-98fd-d3b15b152d77 req-3f1e371e-f088-4f3d-aed2-1bee2a5d4d20 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-0a777aac-0d50-4036-823d-017f94a044b1 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-56a265ab-da39-4898-98fd-d3b15b152d77 req-3f1e371e-f088-4f3d-aed2-1bee2a5d4d20 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-56a265ab-da39-4898-98fd-d3b15b152d77 req-3f1e371e-f088-4f3d-aed2-1bee2a5d4d20 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-56a265ab-da39-4898-98fd-d3b15b152d77 req-3f1e371e-f088-4f3d-aed2-1bee2a5d4d20 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG nova.compute.manager [req-56a265ab-da39-4898-98fd-d3b15b152d77 req-3f1e371e-f088-4f3d-aed2-1bee2a5d4d20 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-0a777aac-0d50-4036-823d-017f94a044b1 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:14 user nova-compute[74242]: WARNING nova.compute.manager [req-56a265ab-da39-4898-98fd-d3b15b152d77 req-3f1e371e-f088-4f3d-aed2-1bee2a5d4d20 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-0a777aac-0d50-4036-823d-017f94a044b1 for instance with vm_state building and task_state spawning.
Oct 20 02:10:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:10:14 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] No VIF found with MAC fa:16:3e:53:fc:43, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:10:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-11e7605f-e8cb-4c7b-8988-da03b4bed2bf tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.919s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-ed9ec774-b971-42b0-b621-6057c5203991 req-db0225ca-5492-41d1-91a6-2e9287c95ea8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-a3751e3f-044b-44fc-94ab-9e54484b46cc {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ed9ec774-b971-42b0-b621-6057c5203991 req-db0225ca-5492-41d1-91a6-2e9287c95ea8 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ed9ec774-b971-42b0-b621-6057c5203991 req-db0225ca-5492-41d1-91a6-2e9287c95ea8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ed9ec774-b971-42b0-b621-6057c5203991 req-db0225ca-5492-41d1-91a6-2e9287c95ea8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-ed9ec774-b971-42b0-b621-6057c5203991 req-db0225ca-5492-41d1-91a6-2e9287c95ea8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-a3751e3f-044b-44fc-94ab-9e54484b46cc {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:16 user nova-compute[74242]: WARNING nova.compute.manager [req-ed9ec774-b971-42b0-b621-6057c5203991 req-db0225ca-5492-41d1-91a6-2e9287c95ea8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-a3751e3f-044b-44fc-94ab-9e54484b46cc for instance with vm_state building and task_state spawning.
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-ed9ec774-b971-42b0-b621-6057c5203991 req-db0225ca-5492-41d1-91a6-2e9287c95ea8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-a3751e3f-044b-44fc-94ab-9e54484b46cc {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ed9ec774-b971-42b0-b621-6057c5203991 req-db0225ca-5492-41d1-91a6-2e9287c95ea8 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ed9ec774-b971-42b0-b621-6057c5203991 req-db0225ca-5492-41d1-91a6-2e9287c95ea8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ed9ec774-b971-42b0-b621-6057c5203991 req-db0225ca-5492-41d1-91a6-2e9287c95ea8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-ed9ec774-b971-42b0-b621-6057c5203991 req-db0225ca-5492-41d1-91a6-2e9287c95ea8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-a3751e3f-044b-44fc-94ab-9e54484b46cc {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:16 user nova-compute[74242]: WARNING nova.compute.manager [req-ed9ec774-b971-42b0-b621-6057c5203991 req-db0225ca-5492-41d1-91a6-2e9287c95ea8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-a3751e3f-044b-44fc-94ab-9e54484b46cc for instance with vm_state building and task_state spawning.
Oct 20 02:10:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-19429579-98f3-4a12-bea5-2ba817e978f9 req-dc0f7aff-cfcc-4318-9605-c450555cb25d service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-19429579-98f3-4a12-bea5-2ba817e978f9 req-dc0f7aff-cfcc-4318-9605-c450555cb25d service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-19429579-98f3-4a12-bea5-2ba817e978f9 req-dc0f7aff-cfcc-4318-9605-c450555cb25d service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-19429579-98f3-4a12-bea5-2ba817e978f9 req-dc0f7aff-cfcc-4318-9605-c450555cb25d service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-19429579-98f3-4a12-bea5-2ba817e978f9 req-dc0f7aff-cfcc-4318-9605-c450555cb25d service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:16 user nova-compute[74242]: WARNING nova.compute.manager [req-19429579-98f3-4a12-bea5-2ba817e978f9 req-dc0f7aff-cfcc-4318-9605-c450555cb25d service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 for instance with vm_state building and task_state spawning.
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-19429579-98f3-4a12-bea5-2ba817e978f9 req-dc0f7aff-cfcc-4318-9605-c450555cb25d service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-19429579-98f3-4a12-bea5-2ba817e978f9 req-dc0f7aff-cfcc-4318-9605-c450555cb25d service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-19429579-98f3-4a12-bea5-2ba817e978f9 req-dc0f7aff-cfcc-4318-9605-c450555cb25d service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-19429579-98f3-4a12-bea5-2ba817e978f9 req-dc0f7aff-cfcc-4318-9605-c450555cb25d service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-19429579-98f3-4a12-bea5-2ba817e978f9 req-dc0f7aff-cfcc-4318-9605-c450555cb25d service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:10:16 user nova-compute[74242]: WARNING nova.compute.manager [req-19429579-98f3-4a12-bea5-2ba817e978f9 req-dc0f7aff-cfcc-4318-9605-c450555cb25d service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 for instance with vm_state building and task_state spawning.
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Acquiring lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG os_brick.utils [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d81333-8c68-4668-8e4a-0acd94c2114b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e984472-885b-4b4b-926c-076c979269a0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[95825ba6-923b-43e5-9480-840236a99e39]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c5d3bf-83b9-40e5-8b3f-826438271681]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:10:16 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:10:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fc5bee-2122-4db7-92c3-0f077b5fc978]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG os_brick.utils [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] <== get_connector_properties: return (162ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:10:16 user nova-compute[74242]: INFO nova.compute.manager [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Swapping volume a57d408c-853f-4859-bbe9-7608dc3157cb for 0eeba8c7-d10b-40aa-a048-5b18e5d6b502
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.compute.manager [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:10:16 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Instance spawned successfully.
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:10:16 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:10:17 user nova-compute[74242]: INFO nova.compute.manager [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Took 14.52 seconds to spawn the instance on the hypervisor.
Oct 20 02:10:17 user nova-compute[74242]: DEBUG nova.compute.manager [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:10:17 user nova-compute[74242]: INFO nova.compute.manager [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Took 163.69 seconds to build instance.
Oct 20 02:10:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60568af6-f214-4feb-abee-64c699807ed3 tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 163.831s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 57.178s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:17 user nova-compute[74242]: INFO nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 20 02:10:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:21 user nova-compute[74242]: DEBUG nova.compute.manager [req-fa3e3845-ff20-4783-bfbb-3ada3079200c req-9b57b16d-b62b-4f44-8aca-965db5b9accf service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Received event network-changed-350f4931-f460-4a25-a6b4-dd924304f1fa {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:21 user nova-compute[74242]: DEBUG nova.compute.manager [req-fa3e3845-ff20-4783-bfbb-3ada3079200c req-9b57b16d-b62b-4f44-8aca-965db5b9accf service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Refreshing instance network info cache due to event network-changed-350f4931-f460-4a25-a6b4-dd924304f1fa. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:10:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fa3e3845-ff20-4783-bfbb-3ada3079200c req-9b57b16d-b62b-4f44-8aca-965db5b9accf service nova] Acquiring lock "refresh_cache-07377280-e3f5-4edd-9501-678dcde42ef3" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:10:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fa3e3845-ff20-4783-bfbb-3ada3079200c req-9b57b16d-b62b-4f44-8aca-965db5b9accf service nova] Acquired lock "refresh_cache-07377280-e3f5-4edd-9501-678dcde42ef3" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:10:21 user nova-compute[74242]: DEBUG nova.network.neutron [req-fa3e3845-ff20-4783-bfbb-3ada3079200c req-9b57b16d-b62b-4f44-8aca-965db5b9accf service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Refreshing network info cache for port 350f4931-f460-4a25-a6b4-dd924304f1fa {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:10:22 user nova-compute[74242]: DEBUG nova.network.neutron [req-fa3e3845-ff20-4783-bfbb-3ada3079200c req-9b57b16d-b62b-4f44-8aca-965db5b9accf service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Updated VIF entry in instance network info cache for port 350f4931-f460-4a25-a6b4-dd924304f1fa. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:10:22 user nova-compute[74242]: DEBUG nova.network.neutron [req-fa3e3845-ff20-4783-bfbb-3ada3079200c req-9b57b16d-b62b-4f44-8aca-965db5b9accf service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Updating instance_info_cache with network_info: [{"id": "350f4931-f460-4a25-a6b4-dd924304f1fa", "address": "fa:16:3e:4f:12:07", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f4931-f4", "ovs_interfaceid": "350f4931-f460-4a25-a6b4-dd924304f1fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:10:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fa3e3845-ff20-4783-bfbb-3ada3079200c req-9b57b16d-b62b-4f44-8aca-965db5b9accf service nova] Releasing lock "refresh_cache-07377280-e3f5-4edd-9501-678dcde42ef3" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:10:23 user nova-compute[74242]: DEBUG nova.compute.manager [req-c087c1b2-7871-46a8-9659-6c0414f09e38 req-6e2169f3-1af0-41c1-b599-e2702938fa9a service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Received event network-changed-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:23 user nova-compute[74242]: DEBUG nova.compute.manager [req-c087c1b2-7871-46a8-9659-6c0414f09e38 req-6e2169f3-1af0-41c1-b599-e2702938fa9a service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Refreshing instance network info cache due to event network-changed-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:10:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c087c1b2-7871-46a8-9659-6c0414f09e38 req-6e2169f3-1af0-41c1-b599-e2702938fa9a service nova] Acquiring lock "refresh_cache-9701b02d-0874-45f9-a599-8c1809f234c4" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:10:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c087c1b2-7871-46a8-9659-6c0414f09e38 req-6e2169f3-1af0-41c1-b599-e2702938fa9a service nova] Acquired lock "refresh_cache-9701b02d-0874-45f9-a599-8c1809f234c4" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:10:23 user nova-compute[74242]: DEBUG nova.network.neutron [req-c087c1b2-7871-46a8-9659-6c0414f09e38 req-6e2169f3-1af0-41c1-b599-e2702938fa9a service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Refreshing network info cache for port 43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:10:23 user nova-compute[74242]: DEBUG nova.network.neutron [req-c087c1b2-7871-46a8-9659-6c0414f09e38 req-6e2169f3-1af0-41c1-b599-e2702938fa9a service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Updated VIF entry in instance network info cache for port 43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:10:23 user nova-compute[74242]: DEBUG nova.network.neutron [req-c087c1b2-7871-46a8-9659-6c0414f09e38 req-6e2169f3-1af0-41c1-b599-e2702938fa9a service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Updating instance_info_cache with network_info: [{"id": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "address": "fa:16:3e:e1:15:28", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e139d5-eb", "ovs_interfaceid": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:10:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c087c1b2-7871-46a8-9659-6c0414f09e38 req-6e2169f3-1af0-41c1-b599-e2702938fa9a service nova] Releasing lock "refresh_cache-9701b02d-0874-45f9-a599-8c1809f234c4" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:10:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:28 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7e101002-a175-40fe-b5ca-04a58610f60d is timed out.
Oct 20 02:10:28 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Successfully detached device vdb from instance 7e101002-a175-40fe-b5ca-04a58610f60d from the live domain config.
Oct 20 02:10:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LarSqPnY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:10:28 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c0bce5-bbbf-4815-8a60-4bd22ff0ff76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:10:28 user nova-compute[74242]: No targets found.
Oct 20 02:10:28 user nova-compute[74242]: iSNS:
Oct 20 02:10:28 user nova-compute[74242]: No targets found.
Oct 20 02:10:28 user nova-compute[74242]: STATIC:
Oct 20 02:10:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb
Oct 20 02:10:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:10:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:10:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d
Oct 20 02:10:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:10:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:10:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a
Oct 20 02:10:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:10:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:10:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c
Oct 20 02:10:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:10:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:10:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160
Oct 20 02:10:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:10:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:10:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566
Oct 20 02:10:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:10:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:10:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a
Oct 20 02:10:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:10:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:10:28 user nova-compute[74242]: FIRMWARE:
Oct 20 02:10:28 user nova-compute[74242]: No targets found.
Oct 20 02:10:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:10:28 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:10:28 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[037a3afa-4a6b-4cb5-a5c2-50e69959e89b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bff817c-f96d-4979-b599-a0017a3a6615]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:28 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:28 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:28 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:28 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:10:28 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:10:28 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:10:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:10:28 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:10:28 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:10:28 user nova-compute[74242]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a (non-flash)
Oct 20 02:10:28 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:10:28 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:10:28 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:10:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d930b1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a'): ({'sde'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Removing single pathed devices sde {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f32c76-11b0-442c-aae8-0fbcc23c2a49]: (4, ('path checker states:\nup                  5\npending             2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a37981-63ad-46bf-a196-6d913b34cdaa]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Flushing IO for device /dev/sde {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3815fbf0-6bed-4d40-b560-6abe5d8cfca1]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1883ad-4067-4abd-b22c-e601d127e6c4]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[37af4bfe-076b-4249-9a67-24994a3ca3a2]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a12205dd-bc32-4d82-a001-1a91371c4920]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a, portal: 172.16.0.220,3260]
Oct 20 02:10:28 user nova-compute[74242]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a, portal: 172.16.0.220,3260] successful.
Oct 20 02:10:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16fdd93a-3729-45c1-8863-934c517cdf1a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[86264981-cce5-4ef5-b469-573770905b00]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] <== disconnect_volume: return (385ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:10:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "9701b02d-0874-45f9-a599-8c1809f234c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "9701b02d-0874-45f9-a599-8c1809f234c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG nova.objects.instance [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lazy-loading 'flavor' on Instance uuid 9701b02d-0874-45f9-a599-8c1809f234c4 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "9701b02d-0874-45f9-a599-8c1809f234c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG nova.objects.instance [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lazy-loading 'flavor' on Instance uuid 7e101002-a175-40fe-b5ca-04a58610f60d {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-07056733-0d0c-45f8-870f-e629f5735940 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "7e101002-a175-40fe-b5ca-04a58610f60d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.973s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "9701b02d-0874-45f9-a599-8c1809f234c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "9701b02d-0874-45f9-a599-8c1809f234c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:29 user nova-compute[74242]: INFO nova.compute.manager [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Attaching volume 5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 to /dev/vdb
Oct 20 02:10:29 user nova-compute[74242]: DEBUG os_brick.utils [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c415273-422c-45c7-ad23-4cee402ebf6e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6125af68-73dc-44c2-8b71-b067c0a794e3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73e4454-9dcd-45bc-9655-6428e7fb4fb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfdd1fa-591b-4af2-9aa1-da2e843b6557]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:10:29 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:10:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cd61de1-9a8c-44b8-9a8b-cee119ac3f0e]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG os_brick.utils [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:10:29 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Updating existing volume attachment record: 6194b3c7-28d2-4a42-9aff-c035dc6b0d84 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:10:31 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:10:31 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:10:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:10:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-c909c918-59a9-42fe-99fe-72431ba43443" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:10:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-c909c918-59a9-42fe-99fe-72431ba43443" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:10:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Updating instance_info_cache with network_info: [{"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-c909c918-59a9-42fe-99fe-72431ba43443" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:10:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:10:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.331s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:36 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:10:36 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7514MB free_disk=25.33652114868164GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance af9f3d52-79f0-4ce0-9b14-3373b30c2b26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c909c918-59a9-42fe-99fe-72431ba43443 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 626bb196-0e5e-4dfd-8ead-57306c828b13 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7e101002-a175-40fe-b5ca-04a58610f60d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 72003d17-9292-4bdd-acfc-0d3f7e40df80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 07377280-e3f5-4edd-9501-678dcde42ef3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 9701b02d-0874-45f9-a599-8c1809f234c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7c68c0e0-fb73-4458-9dc0-e05560c0509f has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.674s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.569s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:10:36 user nova-compute[74242]: INFO nova.compute.claims [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Claim successful on node user
Oct 20 02:10:36 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:10:36 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:10:37 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:10:37 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:10:37 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:10:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.642s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:10:37 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:10:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:10:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:10:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:10:37 user nova-compute[74242]: DEBUG nova.policy [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00ea297f598040fbb338b9ab2e1a1d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e137c75824d7429585ddd2245f86a6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:10:37 user nova-compute[74242]: INFO nova.virt.block_device [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Booting with volume snapshot c0994b7d-671e-43f9-94ca-3b771a2d665f at /dev/vda
Oct 20 02:10:38 user nova-compute[74242]: DEBUG nova.network.neutron [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Successfully created port: 063bd34a-5020-427a-94cc-51df3002af02 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG nova.network.neutron [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Successfully updated port: 063bd34a-5020-427a-94cc-51df3002af02 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-5f9282bc-d1f8-47d9-af30-496951e16ab3 req-b5821577-b62a-44ff-be32-c42ca7e4f3b3 service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Received event network-changed-063bd34a-5020-427a-94cc-51df3002af02 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-5f9282bc-d1f8-47d9-af30-496951e16ab3 req-b5821577-b62a-44ff-be32-c42ca7e4f3b3 service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Refreshing instance network info cache due to event network-changed-063bd34a-5020-427a-94cc-51df3002af02. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5f9282bc-d1f8-47d9-af30-496951e16ab3 req-b5821577-b62a-44ff-be32-c42ca7e4f3b3 service nova] Acquiring lock "refresh_cache-7c68c0e0-fb73-4458-9dc0-e05560c0509f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5f9282bc-d1f8-47d9-af30-496951e16ab3 req-b5821577-b62a-44ff-be32-c42ca7e4f3b3 service nova] Acquired lock "refresh_cache-7c68c0e0-fb73-4458-9dc0-e05560c0509f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG nova.network.neutron [req-5f9282bc-d1f8-47d9-af30-496951e16ab3 req-b5821577-b62a-44ff-be32-c42ca7e4f3b3 service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Refreshing network info cache for port 063bd34a-5020-427a-94cc-51df3002af02 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "refresh_cache-7c68c0e0-fb73-4458-9dc0-e05560c0509f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG nova.network.neutron [req-5f9282bc-d1f8-47d9-af30-496951e16ab3 req-b5821577-b62a-44ff-be32-c42ca7e4f3b3 service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG nova.network.neutron [req-5f9282bc-d1f8-47d9-af30-496951e16ab3 req-b5821577-b62a-44ff-be32-c42ca7e4f3b3 service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5f9282bc-d1f8-47d9-af30-496951e16ab3 req-b5821577-b62a-44ff-be32-c42ca7e4f3b3 service nova] Releasing lock "refresh_cache-7c68c0e0-fb73-4458-9dc0-e05560c0509f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquired lock "refresh_cache-7c68c0e0-fb73-4458-9dc0-e05560c0509f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG nova.network.neutron [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG nova.network.neutron [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG nova.network.neutron [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Updating instance_info_cache with network_info: [{"id": "063bd34a-5020-427a-94cc-51df3002af02", "address": "fa:16:3e:ab:01:76", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063bd34a-50", "ovs_interfaceid": "063bd34a-5020-427a-94cc-51df3002af02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Releasing lock "refresh_cache-7c68c0e0-fb73-4458-9dc0-e05560c0509f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:10:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Instance network_info: |[{"id": "063bd34a-5020-427a-94cc-51df3002af02", "address": "fa:16:3e:ab:01:76", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063bd34a-50", "ovs_interfaceid": "063bd34a-5020-427a-94cc-51df3002af02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG os_brick.utils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[035440b6-5f1a-4f39-8c4a-9782d91e14ea]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.110s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2610ec91-445f-4cce-a305-11c6cf9d3294]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[03556913-a236-4229-83b3-32211a298401]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ceeab22-ca81-4093-a261-b00173127a53]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:10:43 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:10:43 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48cad6b-c468-45fc-b033-ec094eb4d4b3]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG os_brick.utils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== get_connector_properties: return (206ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:10:43 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Updating existing volume attachment record: e885dbfb-6652-4eea-a458-57ad63d39cdb {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:10:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "d1559836-bd5f-402d-b7b2-1ea2e613b362" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:10:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:56 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:10:56 user nova-compute[74242]: INFO nova.compute.claims [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Claim successful on node user
Oct 20 02:10:56 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:10:56 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:10:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:10:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:10:56 user nova-compute[74242]: DEBUG nova.network.neutron [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:10:56 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:10:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:10:56 user nova-compute[74242]: DEBUG nova.policy [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a3d6645596e24f24a216d2b4e7809073', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a7a2695b5ad341e0afd133522f680bf9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:10:57 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Creating image(s)
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "/opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "/opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.178s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk 1073741824" returned: 0 in 0.052s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Successfully created port: 75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Cannot resize image /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Ensure instance console log exists: /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:10:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Successfully updated port: 75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquired lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-374a331d-cfdd-4cca-9f78-be83c7c13502 req-81131485-6f2e-44a5-bfdb-82fbfbec4320 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received event network-changed-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-374a331d-cfdd-4cca-9f78-be83c7c13502 req-81131485-6f2e-44a5-bfdb-82fbfbec4320 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Refreshing instance network info cache due to event network-changed-75c2194c-b6fc-4b52-8643-2137bd1d1235. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-374a331d-cfdd-4cca-9f78-be83c7c13502 req-81131485-6f2e-44a5-bfdb-82fbfbec4320 service nova] Acquiring lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Updating instance_info_cache with network_info: [{"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Releasing lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Instance network_info: |[{"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-374a331d-cfdd-4cca-9f78-be83c7c13502 req-81131485-6f2e-44a5-bfdb-82fbfbec4320 service nova] Acquired lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.network.neutron [req-374a331d-cfdd-4cca-9f78-be83c7c13502 req-81131485-6f2e-44a5-bfdb-82fbfbec4320 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Refreshing network info cache for port 75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Start _get_guest_xml network_info=[{"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:10:58 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:10:58 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1898730605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1898730605',id=21,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL45lC8uP88aLhPjVpFusc36EgxSMjXZFMi7kNkF3ISmf58aNyLJGlf6kN9rY1GLxONqaKngDD8N296JSE/ycrNLnxQHHeJNFHkBaGooBjeCsoqTZFQ43Lc0w8v+CVTfKQ==',key_name='tempest-keypair-1736999254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7a2695b5ad341e0afd133522f680bf9',ramdisk_id='',reservation_id='r-t0tvfa99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-750275147',owner_user_name='tempest-AttachVolumeShelveTestJSON-750275147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:10:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d6645596e24f24a216d2b4e7809073',uuid=d1559836-bd5f-402d-b7b2-1ea2e613b362,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converting VIF {"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=75c2194c-b6fc-4b52-8643-2137bd1d1235,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c2194c-b6') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.objects.instance [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'pci_devices' on Instance uuid d1559836-bd5f-402d-b7b2-1ea2e613b362 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:10:58 user nova-compute[74242]:   <uuid>d1559836-bd5f-402d-b7b2-1ea2e613b362</uuid>
Oct 20 02:10:58 user nova-compute[74242]:   <name>instance-00000015</name>
Oct 20 02:10:58 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:10:58 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:10:58 user nova-compute[74242]:   <metadata>
Oct 20 02:10:58 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:10:58 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:10:58 user nova-compute[74242]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1898730605</nova:name>
Oct 20 02:10:58 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:10:58</nova:creationTime>
Oct 20 02:10:58 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:10:58 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:10:58 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:10:58 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:10:58 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:10:58 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:10:58 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:10:58 user nova-compute[74242]:       <nova:owner>
Oct 20 02:10:58 user nova-compute[74242]:         <nova:user uuid="a3d6645596e24f24a216d2b4e7809073">tempest-AttachVolumeShelveTestJSON-750275147-project-member</nova:user>
Oct 20 02:10:58 user nova-compute[74242]:         <nova:project uuid="a7a2695b5ad341e0afd133522f680bf9">tempest-AttachVolumeShelveTestJSON-750275147</nova:project>
Oct 20 02:10:58 user nova-compute[74242]:       </nova:owner>
Oct 20 02:10:58 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:10:58 user nova-compute[74242]:       <nova:ports>
Oct 20 02:10:58 user nova-compute[74242]:         <nova:port uuid="75c2194c-b6fc-4b52-8643-2137bd1d1235">
Oct 20 02:10:58 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 02:10:58 user nova-compute[74242]:         </nova:port>
Oct 20 02:10:58 user nova-compute[74242]:       </nova:ports>
Oct 20 02:10:58 user nova-compute[74242]:     </nova:instance>
Oct 20 02:10:58 user nova-compute[74242]:   </metadata>
Oct 20 02:10:58 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:10:58 user nova-compute[74242]:     <system>
Oct 20 02:10:58 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:10:58 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:10:58 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:10:58 user nova-compute[74242]:       <entry name="serial">d1559836-bd5f-402d-b7b2-1ea2e613b362</entry>
Oct 20 02:10:58 user nova-compute[74242]:       <entry name="uuid">d1559836-bd5f-402d-b7b2-1ea2e613b362</entry>
Oct 20 02:10:58 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:10:58 user nova-compute[74242]:     </system>
Oct 20 02:10:58 user nova-compute[74242]:   </sysinfo>
Oct 20 02:10:58 user nova-compute[74242]:   <os>
Oct 20 02:10:58 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:10:58 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:10:58 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:10:58 user nova-compute[74242]:   </os>
Oct 20 02:10:58 user nova-compute[74242]:   <features>
Oct 20 02:10:58 user nova-compute[74242]:     <acpi/>
Oct 20 02:10:58 user nova-compute[74242]:     <apic/>
Oct 20 02:10:58 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:10:58 user nova-compute[74242]:   </features>
Oct 20 02:10:58 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:10:58 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:10:58 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:10:58 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:10:58 user nova-compute[74242]:   </clock>
Oct 20 02:10:58 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:10:58 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:10:58 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:10:58 user nova-compute[74242]:   </cpu>
Oct 20 02:10:58 user nova-compute[74242]:   <devices>
Oct 20 02:10:58 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:10:58 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:10:58 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk"/>
Oct 20 02:10:58 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:10:58 user nova-compute[74242]:     </disk>
Oct 20 02:10:58 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:10:58 user nova-compute[74242]:       <mac address="fa:16:3e:4e:a2:94"/>
Oct 20 02:10:58 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:10:58 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:10:58 user nova-compute[74242]:       <target dev="tap75c2194c-b6"/>
Oct 20 02:10:58 user nova-compute[74242]:     </interface>
Oct 20 02:10:58 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:10:58 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/console.log" append="off"/>
Oct 20 02:10:58 user nova-compute[74242]:     </serial>
Oct 20 02:10:58 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:10:58 user nova-compute[74242]:     <video>
Oct 20 02:10:58 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:10:58 user nova-compute[74242]:     </video>
Oct 20 02:10:58 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:10:58 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:10:58 user nova-compute[74242]:     </rng>
Oct 20 02:10:58 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:10:58 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:10:58 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:10:58 user nova-compute[74242]:     </memballoon>
Oct 20 02:10:58 user nova-compute[74242]:   </devices>
Oct 20 02:10:58 user nova-compute[74242]: </domain>
Oct 20 02:10:58 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1898730605',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1898730605',id=21,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL45lC8uP88aLhPjVpFusc36EgxSMjXZFMi7kNkF3ISmf58aNyLJGlf6kN9rY1GLxONqaKngDD8N296JSE/ycrNLnxQHHeJNFHkBaGooBjeCsoqTZFQ43Lc0w8v+CVTfKQ==',key_name='tempest-keypair-1736999254',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a7a2695b5ad341e0afd133522f680bf9',ramdisk_id='',reservation_id='r-t0tvfa99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-750275147',owner_user_name='tempest-AttachVolumeShelveTestJSON-750275147-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:10:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d6645596e24f24a216d2b4e7809073',uuid=d1559836-bd5f-402d-b7b2-1ea2e613b362,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converting VIF {"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=75c2194c-b6fc-4b52-8643-2137bd1d1235,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c2194c-b6') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG os_vif [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=75c2194c-b6fc-4b52-8643-2137bd1d1235,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c2194c-b6') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98ebf3b9-2f63-5c1e-83af-f6b3f6a8bf71', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75c2194c-b6, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75c2194c-b6, col_values=(('qos', UUID('984c1836-b968-4d23-a8ab-aeed83e551e8')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75c2194c-b6, col_values=(('external_ids', {'iface-id': '75c2194c-b6fc-4b52-8643-2137bd1d1235', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:a2:94', 'vm-uuid': 'd1559836-bd5f-402d-b7b2-1ea2e613b362'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:10:58 user nova-compute[74242]: INFO os_vif [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=75c2194c-b6fc-4b52-8643-2137bd1d1235,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c2194c-b6')
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:10:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] No VIF found with MAC fa:16:3e:4e:a2:94, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:10:59 user nova-compute[74242]: DEBUG nova.network.neutron [req-374a331d-cfdd-4cca-9f78-be83c7c13502 req-81131485-6f2e-44a5-bfdb-82fbfbec4320 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Updated VIF entry in instance network info cache for port 75c2194c-b6fc-4b52-8643-2137bd1d1235. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:10:59 user nova-compute[74242]: DEBUG nova.network.neutron [req-374a331d-cfdd-4cca-9f78-be83c7c13502 req-81131485-6f2e-44a5-bfdb-82fbfbec4320 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Updating instance_info_cache with network_info: [{"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:10:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-374a331d-cfdd-4cca-9f78-be83c7c13502 req-81131485-6f2e-44a5-bfdb-82fbfbec4320 service nova] Releasing lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:10:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-bd66b424-bab8-4e14-b7a6-236d2706f8b5 req-ca0f94fd-6ab8-487c-b96b-810bd1ec1879 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received event network-vif-plugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bd66b424-bab8-4e14-b7a6-236d2706f8b5 req-ca0f94fd-6ab8-487c-b96b-810bd1ec1879 service nova] Acquiring lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bd66b424-bab8-4e14-b7a6-236d2706f8b5 req-ca0f94fd-6ab8-487c-b96b-810bd1ec1879 service nova] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bd66b424-bab8-4e14-b7a6-236d2706f8b5 req-ca0f94fd-6ab8-487c-b96b-810bd1ec1879 service nova] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-bd66b424-bab8-4e14-b7a6-236d2706f8b5 req-ca0f94fd-6ab8-487c-b96b-810bd1ec1879 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] No waiting events found dispatching network-vif-plugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:11:00 user nova-compute[74242]: WARNING nova.compute.manager [req-bd66b424-bab8-4e14-b7a6-236d2706f8b5 req-ca0f94fd-6ab8-487c-b96b-810bd1ec1879 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received unexpected event network-vif-plugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 for instance with vm_state building and task_state spawning.
Oct 20 02:11:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:11:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Instance spawned successfully.
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-6a33bab5-3930-41cf-abc4-8eb41d3f5fe6 req-f89a2513-f3b8-429b-a6c5-0a8ff8a5bd9e service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received event network-vif-plugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6a33bab5-3930-41cf-abc4-8eb41d3f5fe6 req-f89a2513-f3b8-429b-a6c5-0a8ff8a5bd9e service nova] Acquiring lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6a33bab5-3930-41cf-abc4-8eb41d3f5fe6 req-f89a2513-f3b8-429b-a6c5-0a8ff8a5bd9e service nova] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6a33bab5-3930-41cf-abc4-8eb41d3f5fe6 req-f89a2513-f3b8-429b-a6c5-0a8ff8a5bd9e service nova] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-6a33bab5-3930-41cf-abc4-8eb41d3f5fe6 req-f89a2513-f3b8-429b-a6c5-0a8ff8a5bd9e service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] No waiting events found dispatching network-vif-plugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:11:02 user nova-compute[74242]: WARNING nova.compute.manager [req-6a33bab5-3930-41cf-abc4-8eb41d3f5fe6 req-f89a2513-f3b8-429b-a6c5-0a8ff8a5bd9e service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received unexpected event network-vif-plugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 for instance with vm_state building and task_state spawning.
Oct 20 02:11:02 user nova-compute[74242]: INFO nova.compute.manager [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Took 5.64 seconds to spawn the instance on the hypervisor.
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:11:02 user nova-compute[74242]: INFO nova.compute.manager [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Took 6.51 seconds to build instance.
Oct 20 02:11:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a9332ded-af4f-422f-a541-862ff661bf54 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.625s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:11:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Creating image(s)
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Ensure instance console log exists: /opt/stack/data/nova/instances/7c68c0e0-fb73-4458-9dc0-e05560c0509f/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Start _get_guest_xml network_info=[{"id": "063bd34a-5020-427a-94cc-51df3002af02", "address": "fa:16:3e:ab:01:76", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063bd34a-50", "ovs_interfaceid": "063bd34a-5020-427a-94cc-51df3002af02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T02:10:24Z,direct_url=<?>,disk_format='qcow2',id=eb96aa2a-f2ed-4825-af78-8f7ebce11bcf,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2040424358',owner='e137c75824d7429585ddd2245f86a6d0',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T02:10:26Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'e885dbfb-6652-4eea-a458-57ad63d39cdb', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ioMONpgP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c68c0e0-fb73-4458-9dc0-e05560c0509f', 'attached_at': '', 'detached_at': '', 'volume_id': 'a6789df0-c12d-4587-8be0-acbedfb5ba4a', 'serial': 'a6789df0-c12d-4587-8be0-acbedfb5ba4a'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:11:02 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:11:02 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-20T02:10:24Z,direct_url=<?>,disk_format='qcow2',id=eb96aa2a-f2ed-4825-af78-8f7ebce11bcf,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2040424358',owner='e137c75824d7429585ddd2245f86a6d0',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-20T02:10:26Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:11:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ioMONpgP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:11:02 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:11:03 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:11:03 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed1533b7-d37c-46df-a612-9e7611475f66]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:11:03 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2309bb-33a0-44e1-9bc9-349fdf98d9de]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a] added
Oct 20 02:11:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[81a3297e-b418-4208-b475-c3dd4904168d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[947ec708-8856-483a-afd6-b8c21162418a]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ioMONpgP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ioMONpgP" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d84e36a-3259-4216-943f-898c4fe29045]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ioMONpgP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8fd615-2d83-407d-8b19-5bbf219d7182]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8dce1ed-a9b1-4ab3-82ef-43d4a66a0395]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:11:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:11:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --login" returned: 0 in 0.200s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[33edc1de-6326-4706-8639-67677d852d56]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a, portal: 172.16.0.220,3260]
Oct 20 02:11:03 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a, portal: 172.16.0.220,3260] successful.
Oct 20 02:11:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[51726858-1e7b-4a0d-9bac-dfe8580bf27d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.045s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[89061ac8-887e-4acf-b5ec-00619d1135ad]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:11:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:11:03 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:11:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.480s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] HCTL ('36', '-', '-', 0) found on session 22 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.034s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc31754-14bb-4651-b81e-98f93791c90a]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching for a device in session 22 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ioMONpgP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:11:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "20b69222-b73f-4a7d-9807-d476439e1e2a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "20b69222-b73f-4a7d-9807-d476439e1e2a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.compute.manager [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:11:04 user nova-compute[74242]: INFO nova.compute.claims [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Claim successful on node user
Oct 20 02:11:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.559s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== connect_volume: return (1561ms) {'type': 'block', 'scsi_wwn': '23263623033383566', 'path': '/dev/sde'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23263623033383566', 'path': '/dev/sde'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1424072206',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1424072206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1424072206',id=20,image_ref='eb96aa2a-f2ed-4825-af78-8f7ebce11bcf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2lGnDkqYY3ry87H9q2zORHFlBl5aeXZ3sU9PBOLr7115V6HVVrvJc+5Q1CiAGg10U1NyzVuJdjs8eEgnEC+i8+1Wo0AT2HFqJQiLcmvIXQB8w3DePUJPo/KjrEwXGx/w==',key_name='tempest-keypair-1654096633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-k52aqg4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-882774340',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=7c68c0e0-fb73-4458-9dc0-e05560c0509f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "063bd34a-5020-427a-94cc-51df3002af02", "address": "fa:16:3e:ab:01:76", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063bd34a-50", "ovs_interfaceid": "063bd34a-5020-427a-94cc-51df3002af02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "063bd34a-5020-427a-94cc-51df3002af02", "address": "fa:16:3e:ab:01:76", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063bd34a-50", "ovs_interfaceid": "063bd34a-5020-427a-94cc-51df3002af02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:01:76,bridge_name='br-int',has_traffic_filtering=True,id=063bd34a-5020-427a-94cc-51df3002af02,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063bd34a-50') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.objects.instance [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c68c0e0-fb73-4458-9dc0-e05560c0509f {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:11:04 user nova-compute[74242]:   <uuid>7c68c0e0-fb73-4458-9dc0-e05560c0509f</uuid>
Oct 20 02:11:04 user nova-compute[74242]:   <name>instance-00000014</name>
Oct 20 02:11:04 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:11:04 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:11:04 user nova-compute[74242]:   <metadata>
Oct 20 02:11:04 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:11:04 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:11:04 user nova-compute[74242]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1424072206</nova:name>
Oct 20 02:11:04 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:11:02</nova:creationTime>
Oct 20 02:11:04 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:11:04 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:11:04 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:11:04 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:11:04 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:11:04 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:11:04 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:11:04 user nova-compute[74242]:       <nova:owner>
Oct 20 02:11:04 user nova-compute[74242]:         <nova:user uuid="00ea297f598040fbb338b9ab2e1a1d3a">tempest-TestVolumeBootPattern-882774340-project-member</nova:user>
Oct 20 02:11:04 user nova-compute[74242]:         <nova:project uuid="e137c75824d7429585ddd2245f86a6d0">tempest-TestVolumeBootPattern-882774340</nova:project>
Oct 20 02:11:04 user nova-compute[74242]:       </nova:owner>
Oct 20 02:11:04 user nova-compute[74242]:       <nova:root type="image" uuid="eb96aa2a-f2ed-4825-af78-8f7ebce11bcf"/>
Oct 20 02:11:04 user nova-compute[74242]:       <nova:ports>
Oct 20 02:11:04 user nova-compute[74242]:         <nova:port uuid="063bd34a-5020-427a-94cc-51df3002af02">
Oct 20 02:11:04 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 02:11:04 user nova-compute[74242]:         </nova:port>
Oct 20 02:11:04 user nova-compute[74242]:       </nova:ports>
Oct 20 02:11:04 user nova-compute[74242]:     </nova:instance>
Oct 20 02:11:04 user nova-compute[74242]:   </metadata>
Oct 20 02:11:04 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:11:04 user nova-compute[74242]:     <system>
Oct 20 02:11:04 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:11:04 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:11:04 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:11:04 user nova-compute[74242]:       <entry name="serial">7c68c0e0-fb73-4458-9dc0-e05560c0509f</entry>
Oct 20 02:11:04 user nova-compute[74242]:       <entry name="uuid">7c68c0e0-fb73-4458-9dc0-e05560c0509f</entry>
Oct 20 02:11:04 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:11:04 user nova-compute[74242]:     </system>
Oct 20 02:11:04 user nova-compute[74242]:   </sysinfo>
Oct 20 02:11:04 user nova-compute[74242]:   <os>
Oct 20 02:11:04 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:11:04 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:11:04 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:11:04 user nova-compute[74242]:   </os>
Oct 20 02:11:04 user nova-compute[74242]:   <features>
Oct 20 02:11:04 user nova-compute[74242]:     <acpi/>
Oct 20 02:11:04 user nova-compute[74242]:     <apic/>
Oct 20 02:11:04 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:11:04 user nova-compute[74242]:   </features>
Oct 20 02:11:04 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:11:04 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:11:04 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:11:04 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:11:04 user nova-compute[74242]:   </clock>
Oct 20 02:11:04 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:11:04 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:11:04 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:11:04 user nova-compute[74242]:   </cpu>
Oct 20 02:11:04 user nova-compute[74242]:   <devices>
Oct 20 02:11:04 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:11:04 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:11:04 user nova-compute[74242]:       <source dev="/dev/sde"/>
Oct 20 02:11:04 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:11:04 user nova-compute[74242]:       <serial>a6789df0-c12d-4587-8be0-acbedfb5ba4a</serial>
Oct 20 02:11:04 user nova-compute[74242]:     </disk>
Oct 20 02:11:04 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:11:04 user nova-compute[74242]:       <mac address="fa:16:3e:ab:01:76"/>
Oct 20 02:11:04 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:11:04 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:11:04 user nova-compute[74242]:       <target dev="tap063bd34a-50"/>
Oct 20 02:11:04 user nova-compute[74242]:     </interface>
Oct 20 02:11:04 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:11:04 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/7c68c0e0-fb73-4458-9dc0-e05560c0509f/console.log" append="off"/>
Oct 20 02:11:04 user nova-compute[74242]:     </serial>
Oct 20 02:11:04 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:11:04 user nova-compute[74242]:     <video>
Oct 20 02:11:04 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:11:04 user nova-compute[74242]:     </video>
Oct 20 02:11:04 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:11:04 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:11:04 user nova-compute[74242]:     </rng>
Oct 20 02:11:04 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:11:04 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:11:04 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:11:04 user nova-compute[74242]:     </memballoon>
Oct 20 02:11:04 user nova-compute[74242]:   </devices>
Oct 20 02:11:04 user nova-compute[74242]: </domain>
Oct 20 02:11:04 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1424072206',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1424072206',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1424072206',id=20,image_ref='eb96aa2a-f2ed-4825-af78-8f7ebce11bcf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2lGnDkqYY3ry87H9q2zORHFlBl5aeXZ3sU9PBOLr7115V6HVVrvJc+5Q1CiAGg10U1NyzVuJdjs8eEgnEC+i8+1Wo0AT2HFqJQiLcmvIXQB8w3DePUJPo/KjrEwXGx/w==',key_name='tempest-keypair-1654096633',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-k52aqg4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-882774340',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:10:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=7c68c0e0-fb73-4458-9dc0-e05560c0509f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "063bd34a-5020-427a-94cc-51df3002af02", "address": "fa:16:3e:ab:01:76", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063bd34a-50", "ovs_interfaceid": "063bd34a-5020-427a-94cc-51df3002af02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "063bd34a-5020-427a-94cc-51df3002af02", "address": "fa:16:3e:ab:01:76", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063bd34a-50", "ovs_interfaceid": "063bd34a-5020-427a-94cc-51df3002af02", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:01:76,bridge_name='br-int',has_traffic_filtering=True,id=063bd34a-5020-427a-94cc-51df3002af02,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063bd34a-50') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG os_vif [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:01:76,bridge_name='br-int',has_traffic_filtering=True,id=063bd34a-5020-427a-94cc-51df3002af02,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063bd34a-50') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'dccbe3af-b793-5ec0-891f-07aeb2dd19d0', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap063bd34a-50, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap063bd34a-50, col_values=(('qos', UUID('feec4fef-1dfd-4052-982b-5bf9363845bf')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap063bd34a-50, col_values=(('external_ids', {'iface-id': '063bd34a-5020-427a-94cc-51df3002af02', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:01:76', 'vm-uuid': '7c68c0e0-fb73-4458-9dc0-e05560c0509f'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:04 user nova-compute[74242]: INFO os_vif [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:01:76,bridge_name='br-int',has_traffic_filtering=True,id=063bd34a-5020-427a-94cc-51df3002af02,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063bd34a-50')
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] No VIF found with MAC fa:16:3e:ab:01:76, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.621s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:04 user nova-compute[74242]: DEBUG nova.compute.manager [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG nova.compute.manager [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG nova.network.neutron [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:11:05 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:11:05 user nova-compute[74242]: DEBUG nova.compute.manager [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG nova.policy [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5770dbda6dd84c99ada813b97a477f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3c5bff2faf14b7887d0fa959c6e91ab', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG nova.compute.manager [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:11:05 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Creating image(s)
Oct 20 02:11:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "/opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "/opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "/opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.252s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.195s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk 1073741824" returned: 0 in 0.084s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:05 user nova-compute[74242]: DEBUG nova.network.neutron [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Successfully created port: fcdb6d5c-aa2b-4505-8c78-599dc419e982 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.195s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Checking if we can resize image /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Cannot resize image /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Ensure instance console log exists: /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-2e556c1a-1de8-4fea-bd34-404984af15fa req-33f2b2e4-fd3a-4693-8a1c-74750e60d45f service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Received event network-vif-plugged-063bd34a-5020-427a-94cc-51df3002af02 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2e556c1a-1de8-4fea-bd34-404984af15fa req-33f2b2e4-fd3a-4693-8a1c-74750e60d45f service nova] Acquiring lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2e556c1a-1de8-4fea-bd34-404984af15fa req-33f2b2e4-fd3a-4693-8a1c-74750e60d45f service nova] Lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2e556c1a-1de8-4fea-bd34-404984af15fa req-33f2b2e4-fd3a-4693-8a1c-74750e60d45f service nova] Lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-2e556c1a-1de8-4fea-bd34-404984af15fa req-33f2b2e4-fd3a-4693-8a1c-74750e60d45f service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] No waiting events found dispatching network-vif-plugged-063bd34a-5020-427a-94cc-51df3002af02 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:11:06 user nova-compute[74242]: WARNING nova.compute.manager [req-2e556c1a-1de8-4fea-bd34-404984af15fa req-33f2b2e4-fd3a-4693-8a1c-74750e60d45f service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Received unexpected event network-vif-plugged-063bd34a-5020-427a-94cc-51df3002af02 for instance with vm_state building and task_state spawning.
Oct 20 02:11:06 user nova-compute[74242]: DEBUG nova.network.neutron [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Successfully updated port: fcdb6d5c-aa2b-4505-8c78-599dc419e982 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "refresh_cache-20b69222-b73f-4a7d-9807-d476439e1e2a" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquired lock "refresh_cache-20b69222-b73f-4a7d-9807-d476439e1e2a" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG nova.network.neutron [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-5ed3f3c4-e079-4f9f-bb08-f23542aecb23 req-81aac2e6-15c1-461c-aa27-5d300ba2547e service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Received event network-changed-fcdb6d5c-aa2b-4505-8c78-599dc419e982 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-5ed3f3c4-e079-4f9f-bb08-f23542aecb23 req-81aac2e6-15c1-461c-aa27-5d300ba2547e service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Refreshing instance network info cache due to event network-changed-fcdb6d5c-aa2b-4505-8c78-599dc419e982. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:11:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5ed3f3c4-e079-4f9f-bb08-f23542aecb23 req-81aac2e6-15c1-461c-aa27-5d300ba2547e service nova] Acquiring lock "refresh_cache-20b69222-b73f-4a7d-9807-d476439e1e2a" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.network.neutron [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.network.neutron [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Updating instance_info_cache with network_info: [{"id": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "address": "fa:16:3e:0a:26:13", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcdb6d5c-aa", "ovs_interfaceid": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Releasing lock "refresh_cache-20b69222-b73f-4a7d-9807-d476439e1e2a" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.compute.manager [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Instance network_info: |[{"id": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "address": "fa:16:3e:0a:26:13", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcdb6d5c-aa", "ovs_interfaceid": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5ed3f3c4-e079-4f9f-bb08-f23542aecb23 req-81aac2e6-15c1-461c-aa27-5d300ba2547e service nova] Acquired lock "refresh_cache-20b69222-b73f-4a7d-9807-d476439e1e2a" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.network.neutron [req-5ed3f3c4-e079-4f9f-bb08-f23542aecb23 req-81aac2e6-15c1-461c-aa27-5d300ba2547e service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Refreshing network info cache for port fcdb6d5c-aa2b-4505-8c78-599dc419e982 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Start _get_guest_xml network_info=[{"id": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "address": "fa:16:3e:0a:26:13", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcdb6d5c-aa", "ovs_interfaceid": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:11:07 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:11:07 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:11:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1065833772',display_name='tempest-VolumesAdminNegativeTest-server-1065833772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1065833772',id=22,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3c5bff2faf14b7887d0fa959c6e91ab',ramdisk_id='',reservation_id='r-tfg0u3g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1678070801',owner_user_name='tempest-VolumesAdminNegativeTest-1678070801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:11:05Z,user_data=None,user_id='5770dbda6dd84c99ada813b97a477f8a',uuid=20b69222-b73f-4a7d-9807-d476439e1e2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "address": "fa:16:3e:0a:26:13", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcdb6d5c-aa", "ovs_interfaceid": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Converting VIF {"id": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "address": "fa:16:3e:0a:26:13", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcdb6d5c-aa", "ovs_interfaceid": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:26:13,bridge_name='br-int',has_traffic_filtering=True,id=fcdb6d5c-aa2b-4505-8c78-599dc419e982,network=Network(a476089f-e2c5-41a8-8c01-0bfd9c9e280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcdb6d5c-aa') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.objects.instance [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lazy-loading 'pci_devices' on Instance uuid 20b69222-b73f-4a7d-9807-d476439e1e2a {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:11:07 user nova-compute[74242]:   <uuid>20b69222-b73f-4a7d-9807-d476439e1e2a</uuid>
Oct 20 02:11:07 user nova-compute[74242]:   <name>instance-00000016</name>
Oct 20 02:11:07 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:11:07 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:11:07 user nova-compute[74242]:   <metadata>
Oct 20 02:11:07 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:11:07 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:11:07 user nova-compute[74242]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1065833772</nova:name>
Oct 20 02:11:07 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:11:07</nova:creationTime>
Oct 20 02:11:07 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:11:07 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:11:07 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:11:07 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:11:07 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:11:07 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:11:07 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:11:07 user nova-compute[74242]:       <nova:owner>
Oct 20 02:11:07 user nova-compute[74242]:         <nova:user uuid="5770dbda6dd84c99ada813b97a477f8a">tempest-VolumesAdminNegativeTest-1678070801-project-member</nova:user>
Oct 20 02:11:07 user nova-compute[74242]:         <nova:project uuid="e3c5bff2faf14b7887d0fa959c6e91ab">tempest-VolumesAdminNegativeTest-1678070801</nova:project>
Oct 20 02:11:07 user nova-compute[74242]:       </nova:owner>
Oct 20 02:11:07 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:11:07 user nova-compute[74242]:       <nova:ports>
Oct 20 02:11:07 user nova-compute[74242]:         <nova:port uuid="fcdb6d5c-aa2b-4505-8c78-599dc419e982">
Oct 20 02:11:07 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 02:11:07 user nova-compute[74242]:         </nova:port>
Oct 20 02:11:07 user nova-compute[74242]:       </nova:ports>
Oct 20 02:11:07 user nova-compute[74242]:     </nova:instance>
Oct 20 02:11:07 user nova-compute[74242]:   </metadata>
Oct 20 02:11:07 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:11:07 user nova-compute[74242]:     <system>
Oct 20 02:11:07 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:11:07 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:11:07 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:11:07 user nova-compute[74242]:       <entry name="serial">20b69222-b73f-4a7d-9807-d476439e1e2a</entry>
Oct 20 02:11:07 user nova-compute[74242]:       <entry name="uuid">20b69222-b73f-4a7d-9807-d476439e1e2a</entry>
Oct 20 02:11:07 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:11:07 user nova-compute[74242]:     </system>
Oct 20 02:11:07 user nova-compute[74242]:   </sysinfo>
Oct 20 02:11:07 user nova-compute[74242]:   <os>
Oct 20 02:11:07 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:11:07 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:11:07 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:11:07 user nova-compute[74242]:   </os>
Oct 20 02:11:07 user nova-compute[74242]:   <features>
Oct 20 02:11:07 user nova-compute[74242]:     <acpi/>
Oct 20 02:11:07 user nova-compute[74242]:     <apic/>
Oct 20 02:11:07 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:11:07 user nova-compute[74242]:   </features>
Oct 20 02:11:07 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:11:07 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:11:07 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:11:07 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:11:07 user nova-compute[74242]:   </clock>
Oct 20 02:11:07 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:11:07 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:11:07 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:11:07 user nova-compute[74242]:   </cpu>
Oct 20 02:11:07 user nova-compute[74242]:   <devices>
Oct 20 02:11:07 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:11:07 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:11:07 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk"/>
Oct 20 02:11:07 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:11:07 user nova-compute[74242]:     </disk>
Oct 20 02:11:07 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:11:07 user nova-compute[74242]:       <mac address="fa:16:3e:0a:26:13"/>
Oct 20 02:11:07 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:11:07 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:11:07 user nova-compute[74242]:       <target dev="tapfcdb6d5c-aa"/>
Oct 20 02:11:07 user nova-compute[74242]:     </interface>
Oct 20 02:11:07 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:11:07 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/console.log" append="off"/>
Oct 20 02:11:07 user nova-compute[74242]:     </serial>
Oct 20 02:11:07 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:11:07 user nova-compute[74242]:     <video>
Oct 20 02:11:07 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:11:07 user nova-compute[74242]:     </video>
Oct 20 02:11:07 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:11:07 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:11:07 user nova-compute[74242]:     </rng>
Oct 20 02:11:07 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:11:07 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:11:07 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:11:07 user nova-compute[74242]:     </memballoon>
Oct 20 02:11:07 user nova-compute[74242]:   </devices>
Oct 20 02:11:07 user nova-compute[74242]: </domain>
Oct 20 02:11:07 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:11:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1065833772',display_name='tempest-VolumesAdminNegativeTest-server-1065833772',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1065833772',id=22,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3c5bff2faf14b7887d0fa959c6e91ab',ramdisk_id='',reservation_id='r-tfg0u3g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1678070801',owner_user_name='tempest-VolumesAdminNegativeTest-1678070801-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:11:05Z,user_data=None,user_id='5770dbda6dd84c99ada813b97a477f8a',uuid=20b69222-b73f-4a7d-9807-d476439e1e2a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "address": "fa:16:3e:0a:26:13", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcdb6d5c-aa", "ovs_interfaceid": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Converting VIF {"id": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "address": "fa:16:3e:0a:26:13", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcdb6d5c-aa", "ovs_interfaceid": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:26:13,bridge_name='br-int',has_traffic_filtering=True,id=fcdb6d5c-aa2b-4505-8c78-599dc419e982,network=Network(a476089f-e2c5-41a8-8c01-0bfd9c9e280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcdb6d5c-aa') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG os_vif [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:26:13,bridge_name='br-int',has_traffic_filtering=True,id=fcdb6d5c-aa2b-4505-8c78-599dc419e982,network=Network(a476089f-e2c5-41a8-8c01-0bfd9c9e280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcdb6d5c-aa') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ee543623-030c-5a1e-8548-c8cc06a27f74', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfcdb6d5c-aa, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfcdb6d5c-aa, col_values=(('qos', UUID('e4ade93a-3197-44fd-acfc-8791508ff6b3')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfcdb6d5c-aa, col_values=(('external_ids', {'iface-id': 'fcdb6d5c-aa2b-4505-8c78-599dc419e982', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0a:26:13', 'vm-uuid': '20b69222-b73f-4a7d-9807-d476439e1e2a'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:07 user nova-compute[74242]: INFO os_vif [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:26:13,bridge_name='br-int',has_traffic_filtering=True,id=fcdb6d5c-aa2b-4505-8c78-599dc419e982,network=Network(a476089f-e2c5-41a8-8c01-0bfd9c9e280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcdb6d5c-aa')
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] No VIF found with MAC fa:16:3e:0a:26:13, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.network.neutron [req-5ed3f3c4-e079-4f9f-bb08-f23542aecb23 req-81aac2e6-15c1-461c-aa27-5d300ba2547e service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Updated VIF entry in instance network info cache for port fcdb6d5c-aa2b-4505-8c78-599dc419e982. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG nova.network.neutron [req-5ed3f3c4-e079-4f9f-bb08-f23542aecb23 req-81aac2e6-15c1-461c-aa27-5d300ba2547e service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Updating instance_info_cache with network_info: [{"id": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "address": "fa:16:3e:0a:26:13", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcdb6d5c-aa", "ovs_interfaceid": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:11:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5ed3f3c4-e079-4f9f-bb08-f23542aecb23 req-81aac2e6-15c1-461c-aa27-5d300ba2547e service nova] Releasing lock "refresh_cache-20b69222-b73f-4a7d-9807-d476439e1e2a" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:11:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-5d755531-78b9-4030-8115-e097d0feb68a req-8a831cf5-c9ed-4cc2-8e63-798714c08b26 service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Received event network-vif-plugged-063bd34a-5020-427a-94cc-51df3002af02 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5d755531-78b9-4030-8115-e097d0feb68a req-8a831cf5-c9ed-4cc2-8e63-798714c08b26 service nova] Acquiring lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5d755531-78b9-4030-8115-e097d0feb68a req-8a831cf5-c9ed-4cc2-8e63-798714c08b26 service nova] Lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5d755531-78b9-4030-8115-e097d0feb68a req-8a831cf5-c9ed-4cc2-8e63-798714c08b26 service nova] Lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-5d755531-78b9-4030-8115-e097d0feb68a req-8a831cf5-c9ed-4cc2-8e63-798714c08b26 service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] No waiting events found dispatching network-vif-plugged-063bd34a-5020-427a-94cc-51df3002af02 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:11:08 user nova-compute[74242]: WARNING nova.compute.manager [req-5d755531-78b9-4030-8115-e097d0feb68a req-8a831cf5-c9ed-4cc2-8e63-798714c08b26 service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Received unexpected event network-vif-plugged-063bd34a-5020-427a-94cc-51df3002af02 for instance with vm_state building and task_state spawning.
Oct 20 02:11:08 user nova-compute[74242]: DEBUG nova.compute.manager [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:11:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:11:08 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Instance spawned successfully.
Oct 20 02:11:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:11:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:09 user nova-compute[74242]: INFO nova.compute.manager [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Took 6.16 seconds to spawn the instance on the hypervisor.
Oct 20 02:11:09 user nova-compute[74242]: DEBUG nova.compute.manager [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:11:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:09 user nova-compute[74242]: INFO nova.compute.manager [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Took 33.13 seconds to build instance.
Oct 20 02:11:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-900c27b5-385a-408e-afc4-45776df8dee0 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.265s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:09 user nova-compute[74242]: DEBUG nova.compute.manager [req-f103cbb7-21b9-4118-8a68-29eae3452777 req-c780d679-704f-4b0e-95c3-c88b8dc3a4d0 service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Received event network-vif-plugged-fcdb6d5c-aa2b-4505-8c78-599dc419e982 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f103cbb7-21b9-4118-8a68-29eae3452777 req-c780d679-704f-4b0e-95c3-c88b8dc3a4d0 service nova] Acquiring lock "20b69222-b73f-4a7d-9807-d476439e1e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f103cbb7-21b9-4118-8a68-29eae3452777 req-c780d679-704f-4b0e-95c3-c88b8dc3a4d0 service nova] Lock "20b69222-b73f-4a7d-9807-d476439e1e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f103cbb7-21b9-4118-8a68-29eae3452777 req-c780d679-704f-4b0e-95c3-c88b8dc3a4d0 service nova] Lock "20b69222-b73f-4a7d-9807-d476439e1e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:09 user nova-compute[74242]: DEBUG nova.compute.manager [req-f103cbb7-21b9-4118-8a68-29eae3452777 req-c780d679-704f-4b0e-95c3-c88b8dc3a4d0 service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] No waiting events found dispatching network-vif-plugged-fcdb6d5c-aa2b-4505-8c78-599dc419e982 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:11:09 user nova-compute[74242]: WARNING nova.compute.manager [req-f103cbb7-21b9-4118-8a68-29eae3452777 req-c780d679-704f-4b0e-95c3-c88b8dc3a4d0 service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Received unexpected event network-vif-plugged-fcdb6d5c-aa2b-4505-8c78-599dc419e982 for instance with vm_state building and task_state spawning.
Oct 20 02:11:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:11 user nova-compute[74242]: DEBUG nova.compute.manager [req-bfa9d3af-c378-48d5-89ad-3d13029abb69 req-471ebd88-0dbc-4772-9312-b5cb8af8b2e4 service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Received event network-vif-plugged-fcdb6d5c-aa2b-4505-8c78-599dc419e982 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bfa9d3af-c378-48d5-89ad-3d13029abb69 req-471ebd88-0dbc-4772-9312-b5cb8af8b2e4 service nova] Acquiring lock "20b69222-b73f-4a7d-9807-d476439e1e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bfa9d3af-c378-48d5-89ad-3d13029abb69 req-471ebd88-0dbc-4772-9312-b5cb8af8b2e4 service nova] Lock "20b69222-b73f-4a7d-9807-d476439e1e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bfa9d3af-c378-48d5-89ad-3d13029abb69 req-471ebd88-0dbc-4772-9312-b5cb8af8b2e4 service nova] Lock "20b69222-b73f-4a7d-9807-d476439e1e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:11 user nova-compute[74242]: DEBUG nova.compute.manager [req-bfa9d3af-c378-48d5-89ad-3d13029abb69 req-471ebd88-0dbc-4772-9312-b5cb8af8b2e4 service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] No waiting events found dispatching network-vif-plugged-fcdb6d5c-aa2b-4505-8c78-599dc419e982 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:11:11 user nova-compute[74242]: WARNING nova.compute.manager [req-bfa9d3af-c378-48d5-89ad-3d13029abb69 req-471ebd88-0dbc-4772-9312-b5cb8af8b2e4 service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Received unexpected event network-vif-plugged-fcdb6d5c-aa2b-4505-8c78-599dc419e982 for instance with vm_state building and task_state spawning.
Oct 20 02:11:11 user nova-compute[74242]: DEBUG nova.compute.manager [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:11:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:11:11 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Instance spawned successfully.
Oct 20 02:11:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:11:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:11 user nova-compute[74242]: INFO nova.compute.manager [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Took 6.50 seconds to spawn the instance on the hypervisor.
Oct 20 02:11:11 user nova-compute[74242]: DEBUG nova.compute.manager [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:11:11 user nova-compute[74242]: INFO nova.compute.manager [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Took 7.56 seconds to build instance.
Oct 20 02:11:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-62cb82d0-6adb-498a-97a7-1fa7b50b9305 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "20b69222-b73f-4a7d-9807-d476439e1e2a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.699s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG nova.compute.manager [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmknUdXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72003d17-9292-4bdd-acfc-0d3f7e40df80', 'attached_at': '', 'detached_at': '', 'volume_id': '0eeba8c7-d10b-40aa-a048-5b18e5d6b502', 'serial': '0eeba8c7-d10b-40aa-a048-5b18e5d6b502'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGQhFZIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '72003d17-9292-4bdd-acfc-0d3f7e40df80', 'attached_at': '', 'detached_at': '', 'volume_id': 'a57d408c-853f-4859-bbe9-7608dc3157cb', 'serial'} {{(pid=74242) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmknUdXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:11:15 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:11:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:11:15 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:11:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:11:15 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[260d1610-c6da-46cb-a22d-a9708a509795]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:11:15 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b64f32c-c0d3-485e-aba6-ec72c5e5b5c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502] added
Oct 20 02:11:15 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXwKlSdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:11:15 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:11:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbed5de-55f9-4f82-8ee2-18e8de8cf505]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[939d21e6-d2e2-496b-9ccd-b5200eb3a75b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmknUdXq {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SmknUdXq" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[46d63992-5228-4d06-986d-1af0595ce291]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SmknUdXq'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da98d50-a8a0-4a69-aee9-ad715a049529]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf76d9a-bac0-498c-a77e-4fa737400ba0]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:11:15 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:11:15 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:11:15 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:11:15 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:11:15 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:11:15 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:11:15 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:11:15 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:11:15 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:11:15 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:11:15 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:11:15 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:11:15 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:11:15 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:11:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --login" returned: 0 in 0.102s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dc20bc-bb4b-428f-9368-6e66a52aa0d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502, portal: 172.16.0.220,3260]
Oct 20 02:11:16 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502, portal: 172.16.0.220,3260] successful.
Oct 20 02:11:16 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.256s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a1dbfa1-e5bb-4b17-889d-419080534f74]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[972d31a7-aef2-4bfe-b7e5-503c8896f121]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:11:16 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:11:16 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:11:16 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:11:16 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:11:16 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:11:16 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:11:16 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:11:16 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:11:16 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:11:16 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:11:16 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:11:16 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:11:16 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:11:16 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:11:16 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:11:16 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.667s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] HCTL ('40', '-', '-', 0) found on session 23 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a90246d-cd41-4a01-a50e-665124fa7412]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Searching for a device in session 23 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:11:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmknUdXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.729s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] <== connect_volume: return (1732ms) {'type': 'block', 'scsi_wwn': '23335316230356462', 'path': '/dev/sdi'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335316230356462', 'path': '/dev/sdi'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.641s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:11:17 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:11:17 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG nova.objects.instance [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lazy-loading 'flavor' on Instance uuid 72003d17-9292-4bdd-acfc-0d3f7e40df80 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c5239d-ece7-404e-b03c-5cc90afa24aa]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:11:17 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[224c71a0-7fe8-4109-9763-a6faa935d83b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4] added
Oct 20 02:11:17 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a54dd2-ae9d-43cb-939d-6c492183a83d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fa5382-f829-4be1-a3d3-49f754f36ef3]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXwKlSdg {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vXwKlSdg" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f38b759-10e0-4355-b2a9-a302c50b3404]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vXwKlSdg'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07fbfaf-0709-433f-a998-187773bbd1e4]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[12472cd6-6b12-4ac5-a2b8-9f78f2429e06]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:11:17 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:11:17 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.128s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e78fb055-2915-4df7-b131-c9ff3d7d0cc3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4, portal: 172.16.0.220,3260]
Oct 20 02:11:17 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4, portal: 172.16.0.220,3260] successful.
Oct 20 02:11:17 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8221be0-209a-4081-a9cb-eac7b6a81866]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec91224-313e-4030-aeec-78f9c5958d8e]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:11:17 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:11:17 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:11:17 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.450s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] HCTL ('41', '-', '-', 0) found on session 24 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Scanning host 41 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host41/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host41/scan" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3945dd-7c2b-4a6b-aff7-57d73935b4cb]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Searching for a device in session 24 and hctl ['41', '*', '*', 0] yield: sdj {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:11:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Connected to sdj using {'target_iqn': 'iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXwKlSdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:11:18 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:11:18 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 83886080 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:11:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.503s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:11:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] <== connect_volume: return (3145ms) {'type': 'block', 'scsi_wwn': '23338386536653034', 'path': '/dev/sdj'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:11:18 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338386536653034', 'path': '/dev/sdj'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:11:18 user nova-compute[74242]: DEBUG nova.objects.instance [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lazy-loading 'flavor' on Instance uuid 9701b02d-0874-45f9-a599-8c1809f234c4 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:11:18 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:11:18 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:11:18 user nova-compute[74242]:   <source dev="/dev/sdj"/>
Oct 20 02:11:18 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:11:18 user nova-compute[74242]:   <serial>5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4</serial>
Oct 20 02:11:18 user nova-compute[74242]: </disk>
Oct 20 02:11:18 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:11:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 238026752 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:11:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 333447168 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:11:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:11:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:11:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] No VIF found with MAC fa:16:3e:e1:15:28, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:11:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0eb7237a-864d-4531-ba21-13f82565676b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "9701b02d-0874-45f9-a599-8c1809f234c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 50.380s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 459276288 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:11:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 572522496 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:11:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 707788800 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:11:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 833617920 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:11:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 914358272 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:11:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:11:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 1033895936 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGQhFZIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:11:23 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[28105bbe-a6ab-4e5b-8f22-e665bd78a9d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:11:23 user nova-compute[74242]: No targets found.
Oct 20 02:11:23 user nova-compute[74242]: iSNS:
Oct 20 02:11:23 user nova-compute[74242]: No targets found.
Oct 20 02:11:23 user nova-compute[74242]: STATIC:
Oct 20 02:11:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4
Oct 20 02:11:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:11:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:11:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502
Oct 20 02:11:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:11:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:11:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a
Oct 20 02:11:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:11:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:11:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb
Oct 20 02:11:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:11:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:11:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d
Oct 20 02:11:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:11:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:11:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a
Oct 20 02:11:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:11:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:11:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c
Oct 20 02:11:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:11:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:11:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160
Oct 20 02:11:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:11:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:11:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566
Oct 20 02:11:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:11:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:11:23 user nova-compute[74242]: FIRMWARE:
Oct 20 02:11:23 user nova-compute[74242]: No targets found.
Oct 20 02:11:23 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:11:23 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:11:23 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7504c62a-5af6-4344-b98e-ffb7321f0bb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[248a6237-7da0-4b06-b78c-05eed507bae7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:11:23 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:11:23 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:11:23 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b86a05e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb'): ({'sdh'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Removing single pathed devices sdh {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaef4014-559b-473a-aea9-e0ad37dd735a]: (4, ('path checker states:\nup                  8\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[794a1b1c-1c21-4989-b4a3-e72499659e8e]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Flushing IO for device /dev/sdh {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9202c77-5cde-4637-b9e1-c41caa1f6a14]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.050s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bb4595-ff39-4721-8258-56abb8ccc1e6]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] SCSI volumes sdh have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3cbd7db-677d-4b24-9250-aeecf43d6424]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd5f7a7-6d62-49bb-a2c1-80c189a519d7]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260]
Oct 20 02:11:23 user nova-compute[74242]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260] successful.
Oct 20 02:11:23 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.050s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[76571622-b6db-4cf1-8dda-907444a994af]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.473s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] <== disconnect_volume: return (475ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG nova.compute.manager [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmknUdXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, 'status': 'reserved', 'instance': '72003d17-9292-4bdd-acfc-0d3f7e40df80', 'attached_at': '', 'detached_at': '', 'volume_id': '0eeba8c7-d10b-40aa-a048-5b18e5d6b502', 'serial'} {{(pid=74242) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 20 02:11:23 user nova-compute[74242]: DEBUG nova.compute.manager [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] swap_volume: removing Cinder connection for volume a57d408c-853f-4859-bbe9-7608dc3157cb {{(pid=74242) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 20 02:11:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "a37dce3b-16e3-4f5f-8412-38291312b306" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "a37dce3b-16e3-4f5f-8412-38291312b306" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:25 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:11:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:25 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:11:25 user nova-compute[74242]: INFO nova.compute.claims [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Claim successful on node user
Oct 20 02:11:26 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.668s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:11:26 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:11:26 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG nova.policy [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3069dcf63864aa08f632601c3a849c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74cc27f49384dc78190bd5d9ed7fab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:11:26 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Creating image(s)
Oct 20 02:11:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "/opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "/opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "/opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.226s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.225s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk 1073741824" returned: 0 in 0.067s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.240s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Successfully created port: a85765e3-167b-4e18-9b8b-f8b4d306a53c {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Cannot resize image /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Ensure instance console log exists: /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Skipping network cache update for instance because it is Building. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-af9f3d52-79f0-4ce0-9b14-3373b30c2b26" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-af9f3d52-79f0-4ce0-9b14-3373b30c2b26" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid af9f3d52-79f0-4ce0-9b14-3373b30c2b26 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Successfully updated port: a85765e3-167b-4e18-9b8b-f8b4d306a53c {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "refresh_cache-a37dce3b-16e3-4f5f-8412-38291312b306" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquired lock "refresh_cache-a37dce3b-16e3-4f5f-8412-38291312b306" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-3e65ef46-83db-4040-9fa0-8c1f86a34ad6 req-836ce7d1-5b07-4ec6-a38a-4aeb66db7d81 service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Received event network-changed-a85765e3-167b-4e18-9b8b-f8b4d306a53c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-3e65ef46-83db-4040-9fa0-8c1f86a34ad6 req-836ce7d1-5b07-4ec6-a38a-4aeb66db7d81 service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Refreshing instance network info cache due to event network-changed-a85765e3-167b-4e18-9b8b-f8b4d306a53c. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3e65ef46-83db-4040-9fa0-8c1f86a34ad6 req-836ce7d1-5b07-4ec6-a38a-4aeb66db7d81 service nova] Acquiring lock "refresh_cache-a37dce3b-16e3-4f5f-8412-38291312b306" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG nova.compute.manager [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] swap_volume: Updating volume a57d408c-853f-4859-bbe9-7608dc3157cb BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "SmknUdXq", "auth_password": "Dnouat7P9TIyHN", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdi", "volume_id": "0eeba8c7-d10b-40aa-a048-5b18e5d6b502"}, "status": "reserved", "instance": "72003d17-9292-4bdd-acfc-0d3f7e40df80", "attached_at": "", "detached_at": "", "volume_id": "0eeba8c7-d10b-40aa-a048-5b18e5d6b502", "serial": "0eeba8c7-d10b-40aa-a048-5b18e5d6b502"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0eeba8c7-d10b-40aa-a048-5b18e5d6b502', 'no_device': None, 'attachment_id': '43caf165-1ecb-4053-a026-eafe0a8cad18'} {{(pid=74242) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 20 02:11:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-18c7da18-0fde-4173-8906-a8d1a79ea96d tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 72.380s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Updating instance_info_cache with network_info: [{"id": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "address": "fa:16:3e:30:f8:54", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85765e3-16", "ovs_interfaceid": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Releasing lock "refresh_cache-a37dce3b-16e3-4f5f-8412-38291312b306" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Instance network_info: |[{"id": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "address": "fa:16:3e:30:f8:54", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85765e3-16", "ovs_interfaceid": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3e65ef46-83db-4040-9fa0-8c1f86a34ad6 req-836ce7d1-5b07-4ec6-a38a-4aeb66db7d81 service nova] Acquired lock "refresh_cache-a37dce3b-16e3-4f5f-8412-38291312b306" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.network.neutron [req-3e65ef46-83db-4040-9fa0-8c1f86a34ad6 req-836ce7d1-5b07-4ec6-a38a-4aeb66db7d81 service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Refreshing network info cache for port a85765e3-167b-4e18-9b8b-f8b4d306a53c {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Start _get_guest_xml network_info=[{"id": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "address": "fa:16:3e:30:f8:54", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85765e3-16", "ovs_interfaceid": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:11:29 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:11:29 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1902207886',display_name='tempest-AttachVolumeNegativeTest-server-1902207886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1902207886',id=23,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAQuzOuS3iEAG2ZrDio3Ny7e5nL47yYcPp4Vw8UXeHnuD/zwmZ/y2angwYuFOTXL2SOyAffRtfDAq/Bf6Kk4ZyZintope131hW7Nr3PJfRQErdk82SiZtTQTkGFhMX3Mg==',key_name='tempest-keypair-2092172209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e74cc27f49384dc78190bd5d9ed7fab9',ramdisk_id='',reservation_id='r-5iao1ljh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1292543897',owner_user_name='tempest-AttachVolumeNegativeTest-1292543897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:11:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3069dcf63864aa08f632601c3a849c5',uuid=a37dce3b-16e3-4f5f-8412-38291312b306,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "address": "fa:16:3e:30:f8:54", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85765e3-16", "ovs_interfaceid": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converting VIF {"id": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "address": "fa:16:3e:30:f8:54", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85765e3-16", "ovs_interfaceid": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:f8:54,bridge_name='br-int',has_traffic_filtering=True,id=a85765e3-167b-4e18-9b8b-f8b4d306a53c,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa85765e3-16') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.objects.instance [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lazy-loading 'pci_devices' on Instance uuid a37dce3b-16e3-4f5f-8412-38291312b306 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:11:29 user nova-compute[74242]:   <uuid>a37dce3b-16e3-4f5f-8412-38291312b306</uuid>
Oct 20 02:11:29 user nova-compute[74242]:   <name>instance-00000017</name>
Oct 20 02:11:29 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:11:29 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:11:29 user nova-compute[74242]:   <metadata>
Oct 20 02:11:29 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:11:29 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:11:29 user nova-compute[74242]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1902207886</nova:name>
Oct 20 02:11:29 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:11:29</nova:creationTime>
Oct 20 02:11:29 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:11:29 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:11:29 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:11:29 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:11:29 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:11:29 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:11:29 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:11:29 user nova-compute[74242]:       <nova:owner>
Oct 20 02:11:29 user nova-compute[74242]:         <nova:user uuid="d3069dcf63864aa08f632601c3a849c5">tempest-AttachVolumeNegativeTest-1292543897-project-member</nova:user>
Oct 20 02:11:29 user nova-compute[74242]:         <nova:project uuid="e74cc27f49384dc78190bd5d9ed7fab9">tempest-AttachVolumeNegativeTest-1292543897</nova:project>
Oct 20 02:11:29 user nova-compute[74242]:       </nova:owner>
Oct 20 02:11:29 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:11:29 user nova-compute[74242]:       <nova:ports>
Oct 20 02:11:29 user nova-compute[74242]:         <nova:port uuid="a85765e3-167b-4e18-9b8b-f8b4d306a53c">
Oct 20 02:11:29 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 02:11:29 user nova-compute[74242]:         </nova:port>
Oct 20 02:11:29 user nova-compute[74242]:       </nova:ports>
Oct 20 02:11:29 user nova-compute[74242]:     </nova:instance>
Oct 20 02:11:29 user nova-compute[74242]:   </metadata>
Oct 20 02:11:29 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:11:29 user nova-compute[74242]:     <system>
Oct 20 02:11:29 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:11:29 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:11:29 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:11:29 user nova-compute[74242]:       <entry name="serial">a37dce3b-16e3-4f5f-8412-38291312b306</entry>
Oct 20 02:11:29 user nova-compute[74242]:       <entry name="uuid">a37dce3b-16e3-4f5f-8412-38291312b306</entry>
Oct 20 02:11:29 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:11:29 user nova-compute[74242]:     </system>
Oct 20 02:11:29 user nova-compute[74242]:   </sysinfo>
Oct 20 02:11:29 user nova-compute[74242]:   <os>
Oct 20 02:11:29 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:11:29 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:11:29 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:11:29 user nova-compute[74242]:   </os>
Oct 20 02:11:29 user nova-compute[74242]:   <features>
Oct 20 02:11:29 user nova-compute[74242]:     <acpi/>
Oct 20 02:11:29 user nova-compute[74242]:     <apic/>
Oct 20 02:11:29 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:11:29 user nova-compute[74242]:   </features>
Oct 20 02:11:29 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:11:29 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:11:29 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:11:29 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:11:29 user nova-compute[74242]:   </clock>
Oct 20 02:11:29 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:11:29 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:11:29 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:11:29 user nova-compute[74242]:   </cpu>
Oct 20 02:11:29 user nova-compute[74242]:   <devices>
Oct 20 02:11:29 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:11:29 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:11:29 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk"/>
Oct 20 02:11:29 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:11:29 user nova-compute[74242]:     </disk>
Oct 20 02:11:29 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:11:29 user nova-compute[74242]:       <mac address="fa:16:3e:30:f8:54"/>
Oct 20 02:11:29 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:11:29 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:11:29 user nova-compute[74242]:       <target dev="tapa85765e3-16"/>
Oct 20 02:11:29 user nova-compute[74242]:     </interface>
Oct 20 02:11:29 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:11:29 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/console.log" append="off"/>
Oct 20 02:11:29 user nova-compute[74242]:     </serial>
Oct 20 02:11:29 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:11:29 user nova-compute[74242]:     <video>
Oct 20 02:11:29 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:11:29 user nova-compute[74242]:     </video>
Oct 20 02:11:29 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:11:29 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:11:29 user nova-compute[74242]:     </rng>
Oct 20 02:11:29 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:11:29 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:11:29 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:11:29 user nova-compute[74242]:     </memballoon>
Oct 20 02:11:29 user nova-compute[74242]:   </devices>
Oct 20 02:11:29 user nova-compute[74242]: </domain>
Oct 20 02:11:29 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1902207886',display_name='tempest-AttachVolumeNegativeTest-server-1902207886',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1902207886',id=23,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAQuzOuS3iEAG2ZrDio3Ny7e5nL47yYcPp4Vw8UXeHnuD/zwmZ/y2angwYuFOTXL2SOyAffRtfDAq/Bf6Kk4ZyZintope131hW7Nr3PJfRQErdk82SiZtTQTkGFhMX3Mg==',key_name='tempest-keypair-2092172209',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e74cc27f49384dc78190bd5d9ed7fab9',ramdisk_id='',reservation_id='r-5iao1ljh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1292543897',owner_user_name='tempest-AttachVolumeNegativeTest-1292543897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:11:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3069dcf63864aa08f632601c3a849c5',uuid=a37dce3b-16e3-4f5f-8412-38291312b306,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "address": "fa:16:3e:30:f8:54", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85765e3-16", "ovs_interfaceid": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converting VIF {"id": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "address": "fa:16:3e:30:f8:54", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85765e3-16", "ovs_interfaceid": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:f8:54,bridge_name='br-int',has_traffic_filtering=True,id=a85765e3-167b-4e18-9b8b-f8b4d306a53c,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa85765e3-16') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG os_vif [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:f8:54,bridge_name='br-int',has_traffic_filtering=True,id=a85765e3-167b-4e18-9b8b-f8b4d306a53c,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa85765e3-16') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '94825d3b-1e2b-5c23-8a84-df213b32787b', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa85765e3-16, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa85765e3-16, col_values=(('qos', UUID('3d3013f2-cfa3-4bb3-9856-5b5500a96a05')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa85765e3-16, col_values=(('external_ids', {'iface-id': 'a85765e3-167b-4e18-9b8b-f8b4d306a53c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:f8:54', 'vm-uuid': 'a37dce3b-16e3-4f5f-8412-38291312b306'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:29 user nova-compute[74242]: INFO os_vif [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:f8:54,bridge_name='br-int',has_traffic_filtering=True,id=a85765e3-167b-4e18-9b8b-f8b4d306a53c,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa85765e3-16')
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] No VIF found with MAC fa:16:3e:30:f8:54, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Updating instance_info_cache with network_info: [{"id": "b98a0d98-dfbf-4307-a04b-23d585652343", "address": "fa:16:3e:83:01:9b", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a0d98-df", "ovs_interfaceid": "b98a0d98-dfbf-4307-a04b-23d585652343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.network.neutron [req-3e65ef46-83db-4040-9fa0-8c1f86a34ad6 req-836ce7d1-5b07-4ec6-a38a-4aeb66db7d81 service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Updated VIF entry in instance network info cache for port a85765e3-167b-4e18-9b8b-f8b4d306a53c. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.network.neutron [req-3e65ef46-83db-4040-9fa0-8c1f86a34ad6 req-836ce7d1-5b07-4ec6-a38a-4aeb66db7d81 service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Updating instance_info_cache with network_info: [{"id": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "address": "fa:16:3e:30:f8:54", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85765e3-16", "ovs_interfaceid": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-af9f3d52-79f0-4ce0-9b14-3373b30c2b26" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:11:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3e65ef46-83db-4040-9fa0-8c1f86a34ad6 req-836ce7d1-5b07-4ec6-a38a-4aeb66db7d81 service nova] Releasing lock "refresh_cache-a37dce3b-16e3-4f5f-8412-38291312b306" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Acquiring lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG os_brick.utils [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bab82f54-7b57-4c90-8ec2-16be21c7741f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eed6a93-af2f-408a-8976-0047bdc5fa6a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-7c1f0e53-2203-4292-acf7-9d7d347a1d53 req-1abb9fcc-d016-4767-96e4-293c57b78234 service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Received event network-vif-plugged-a85765e3-167b-4e18-9b8b-f8b4d306a53c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7c1f0e53-2203-4292-acf7-9d7d347a1d53 req-1abb9fcc-d016-4767-96e4-293c57b78234 service nova] Acquiring lock "a37dce3b-16e3-4f5f-8412-38291312b306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7c1f0e53-2203-4292-acf7-9d7d347a1d53 req-1abb9fcc-d016-4767-96e4-293c57b78234 service nova] Lock "a37dce3b-16e3-4f5f-8412-38291312b306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7c1f0e53-2203-4292-acf7-9d7d347a1d53 req-1abb9fcc-d016-4767-96e4-293c57b78234 service nova] Lock "a37dce3b-16e3-4f5f-8412-38291312b306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-7c1f0e53-2203-4292-acf7-9d7d347a1d53 req-1abb9fcc-d016-4767-96e4-293c57b78234 service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] No waiting events found dispatching network-vif-plugged-a85765e3-167b-4e18-9b8b-f8b4d306a53c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:11:30 user nova-compute[74242]: WARNING nova.compute.manager [req-7c1f0e53-2203-4292-acf7-9d7d347a1d53 req-1abb9fcc-d016-4767-96e4-293c57b78234 service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Received unexpected event network-vif-plugged-a85765e3-167b-4e18-9b8b-f8b4d306a53c for instance with vm_state building and task_state spawning.
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c6560f-d93e-49e1-a3c2-4faab1acbc0c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[150f45c7-8e55-4a43-8cd9-403abce4aa47]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:11:30 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:11:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4740409-7a72-4c1a-a2c1-8a0160121c02]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:11:30 user nova-compute[74242]: DEBUG os_brick.utils [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:11:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:31 user nova-compute[74242]: INFO nova.compute.manager [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Swapping volume 0eeba8c7-d10b-40aa-a048-5b18e5d6b502 for a57d408c-853f-4859-bbe9-7608dc3157cb
Oct 20 02:11:31 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:11:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:31 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:11:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:11:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:11:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:11:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:11:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdg (vdc) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:11:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-b34b53a5-0e9c-4303-ac28-9b944d18ad59 req-e02eb5b7-ffc0-4dec-86b2-b548a216efec service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Received event network-vif-plugged-a85765e3-167b-4e18-9b8b-f8b4d306a53c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b34b53a5-0e9c-4303-ac28-9b944d18ad59 req-e02eb5b7-ffc0-4dec-86b2-b548a216efec service nova] Acquiring lock "a37dce3b-16e3-4f5f-8412-38291312b306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b34b53a5-0e9c-4303-ac28-9b944d18ad59 req-e02eb5b7-ffc0-4dec-86b2-b548a216efec service nova] Lock "a37dce3b-16e3-4f5f-8412-38291312b306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b34b53a5-0e9c-4303-ac28-9b944d18ad59 req-e02eb5b7-ffc0-4dec-86b2-b548a216efec service nova] Lock "a37dce3b-16e3-4f5f-8412-38291312b306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-b34b53a5-0e9c-4303-ac28-9b944d18ad59 req-e02eb5b7-ffc0-4dec-86b2-b548a216efec service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] No waiting events found dispatching network-vif-plugged-a85765e3-167b-4e18-9b8b-f8b4d306a53c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:11:33 user nova-compute[74242]: WARNING nova.compute.manager [req-b34b53a5-0e9c-4303-ac28-9b944d18ad59 req-e02eb5b7-ffc0-4dec-86b2-b548a216efec service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Received unexpected event network-vif-plugged-a85765e3-167b-4e18-9b8b-f8b4d306a53c for instance with vm_state building and task_state spawning.
Oct 20 02:11:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:11:33 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Instance spawned successfully.
Oct 20 02:11:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:11:33 user nova-compute[74242]: INFO nova.compute.manager [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Took 6.75 seconds to spawn the instance on the hypervisor.
Oct 20 02:11:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:33 user nova-compute[74242]: INFO nova.compute.manager [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Took 7.90 seconds to build instance.
Oct 20 02:11:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9e76d6ef-e1e3-450d-87b9-fe51c6211011 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "a37dce3b-16e3-4f5f-8412-38291312b306" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.059s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:11:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:11:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:11:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:36 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:11:36 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7037MB free_disk=25.267452239990234GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance af9f3d52-79f0-4ce0-9b14-3373b30c2b26 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c909c918-59a9-42fe-99fe-72431ba43443 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 626bb196-0e5e-4dfd-8ead-57306c828b13 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7e101002-a175-40fe-b5ca-04a58610f60d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 72003d17-9292-4bdd-acfc-0d3f7e40df80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 07377280-e3f5-4edd-9501-678dcde42ef3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 9701b02d-0874-45f9-a599-8c1809f234c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7c68c0e0-fb73-4458-9dc0-e05560c0509f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d1559836-bd5f-402d-b7b2-1ea2e613b362 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 20b69222-b73f-4a7d-9807-d476439e1e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance a37dce3b-16e3-4f5f-8412-38291312b306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:11:36 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:11:37 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:11:37 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:11:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:11:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.986s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:38 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:11:38 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:11:38 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:11:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:38 user nova-compute[74242]: INFO nova.compute.manager [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Terminating instance
Oct 20 02:11:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-8072ede4-aff6-431d-b8b8-4fc078993fb6 req-04297e3f-5f42-46ed-8f29-e157ab57e766 service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Received event network-vif-unplugged-b98a0d98-dfbf-4307-a04b-23d585652343 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8072ede4-aff6-431d-b8b8-4fc078993fb6 req-04297e3f-5f42-46ed-8f29-e157ab57e766 service nova] Acquiring lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8072ede4-aff6-431d-b8b8-4fc078993fb6 req-04297e3f-5f42-46ed-8f29-e157ab57e766 service nova] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8072ede4-aff6-431d-b8b8-4fc078993fb6 req-04297e3f-5f42-46ed-8f29-e157ab57e766 service nova] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-8072ede4-aff6-431d-b8b8-4fc078993fb6 req-04297e3f-5f42-46ed-8f29-e157ab57e766 service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] No waiting events found dispatching network-vif-unplugged-b98a0d98-dfbf-4307-a04b-23d585652343 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-8072ede4-aff6-431d-b8b8-4fc078993fb6 req-04297e3f-5f42-46ed-8f29-e157ab57e766 service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Received event network-vif-unplugged-b98a0d98-dfbf-4307-a04b-23d585652343 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:39 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Instance destroyed successfully.
Oct 20 02:11:39 user nova-compute[74242]: DEBUG nova.objects.instance [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lazy-loading 'resources' on Instance uuid af9f3d52-79f0-4ce0-9b14-3373b30c2b26 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:02:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-263833210',display_name='tempest-ServersNegativeTestJSON-server-263833210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-263833210',id=1,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:02:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5a8561fb233b4571a47c188a1d9555dc',ramdisk_id='',reservation_id='r-npoqb0x8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-873263142',owner_user_name='tempest-ServersNegativeTestJSON-873263142-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:02:43Z,user_data=None,user_id='fee6d4bd2fe04600a6962eeca70b0645',uuid=af9f3d52-79f0-4ce0-9b14-3373b30c2b26,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b98a0d98-dfbf-4307-a04b-23d585652343", "address": "fa:16:3e:83:01:9b", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a0d98-df", "ovs_interfaceid": "b98a0d98-dfbf-4307-a04b-23d585652343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Converting VIF {"id": "b98a0d98-dfbf-4307-a04b-23d585652343", "address": "fa:16:3e:83:01:9b", "network": {"id": "1b405f0d-8443-4073-9a46-631015e6ac57", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1005144525-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5a8561fb233b4571a47c188a1d9555dc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb98a0d98-df", "ovs_interfaceid": "b98a0d98-dfbf-4307-a04b-23d585652343", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:83:01:9b,bridge_name='br-int',has_traffic_filtering=True,id=b98a0d98-dfbf-4307-a04b-23d585652343,network=Network(1b405f0d-8443-4073-9a46-631015e6ac57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98a0d98-df') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG os_vif [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:01:9b,bridge_name='br-int',has_traffic_filtering=True,id=b98a0d98-dfbf-4307-a04b-23d585652343,network=Network(1b405f0d-8443-4073-9a46-631015e6ac57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98a0d98-df') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb98a0d98-df, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1c8cffb-6b78-4b7f-884a-c4d97efdf97d) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:39 user nova-compute[74242]: INFO os_vif [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:83:01:9b,bridge_name='br-int',has_traffic_filtering=True,id=b98a0d98-dfbf-4307-a04b-23d585652343,network=Network(1b405f0d-8443-4073-9a46-631015e6ac57),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb98a0d98-df')
Oct 20 02:11:39 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Deleting instance files /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26_del
Oct 20 02:11:39 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Deletion of /opt/stack/data/nova/instances/af9f3d52-79f0-4ce0-9b14-3373b30c2b26_del complete
Oct 20 02:11:39 user nova-compute[74242]: INFO nova.compute.manager [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 20 02:11:39 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:11:39 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:11:40 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:11:40 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Took 0.68 seconds to deallocate network for instance.
Oct 20 02:11:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:41 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:11:41 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:11:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.482s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:41 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Deleted allocations for instance af9f3d52-79f0-4ce0-9b14-3373b30c2b26
Oct 20 02:11:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-5135a4d5-0ede-4e62-af64-796c1582b626 req-083d71ff-56c1-4182-9b2a-92b62ebec9a5 service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Received event network-vif-plugged-b98a0d98-dfbf-4307-a04b-23d585652343 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5135a4d5-0ede-4e62-af64-796c1582b626 req-083d71ff-56c1-4182-9b2a-92b62ebec9a5 service nova] Acquiring lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5135a4d5-0ede-4e62-af64-796c1582b626 req-083d71ff-56c1-4182-9b2a-92b62ebec9a5 service nova] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5135a4d5-0ede-4e62-af64-796c1582b626 req-083d71ff-56c1-4182-9b2a-92b62ebec9a5 service nova] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-5135a4d5-0ede-4e62-af64-796c1582b626 req-083d71ff-56c1-4182-9b2a-92b62ebec9a5 service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] No waiting events found dispatching network-vif-plugged-b98a0d98-dfbf-4307-a04b-23d585652343 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:11:41 user nova-compute[74242]: WARNING nova.compute.manager [req-5135a4d5-0ede-4e62-af64-796c1582b626 req-083d71ff-56c1-4182-9b2a-92b62ebec9a5 service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Received unexpected event network-vif-plugged-b98a0d98-dfbf-4307-a04b-23d585652343 for instance with vm_state deleted and task_state None.
Oct 20 02:11:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-5135a4d5-0ede-4e62-af64-796c1582b626 req-083d71ff-56c1-4182-9b2a-92b62ebec9a5 service nova] [instance: af9f3d52-79f0-4ce0-9b14-3373b30c2b26] Received event network-vif-deleted-b98a0d98-dfbf-4307-a04b-23d585652343 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f207e1a4-7859-4c56-a9c7-cd5a0898ca36 tempest-ServersNegativeTestJSON-873263142 tempest-ServersNegativeTestJSON-873263142-project-member] Lock "af9f3d52-79f0-4ce0-9b14-3373b30c2b26" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.394s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:11:47 user nova-compute[74242]: INFO nova.compute.manager [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] instance snapshotting
Oct 20 02:11:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Beginning live snapshot process
Oct 20 02:11:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json -f qcow2 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json -f qcow2" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json -f qcow2 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json -f qcow2" returned: 0 in 0.236s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.243s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppf5ef2b9/2b6b926943394db7b1d6e4403b7358f5.delta 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmppf5ef2b9/2b6b926943394db7b1d6e4403b7358f5.delta 1073741824" returned: 0 in 0.056s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 02:11:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:11:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:11:50 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 02:11:50 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:11:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppf5ef2b9/2b6b926943394db7b1d6e4403b7358f5.delta /opt/stack/data/nova/instances/snapshots/tmppf5ef2b9/2b6b926943394db7b1d6e4403b7358f5 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:11:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmppf5ef2b9/2b6b926943394db7b1d6e4403b7358f5.delta /opt/stack/data/nova/instances/snapshots/tmppf5ef2b9/2b6b926943394db7b1d6e4403b7358f5" returned: 0 in 0.392s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:11:50 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Snapshot extracted, beginning image upload
Oct 20 02:11:53 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Snapshot image upload complete
Oct 20 02:11:53 user nova-compute[74242]: INFO nova.compute.manager [None req-2ca0d85a-cba1-46ae-82d7-ba817d720e65 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Took 5.85 seconds to snapshot the instance on the hypervisor.
Oct 20 02:11:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-ed3bc7a3-6da1-4f94-bee9-7dc457bb6d0c req-02c492f0-2b90-42cc-954c-02a17e2b69a3 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-changed-a1593d20-a266-4958-ba9d-6f03899e6195 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-ed3bc7a3-6da1-4f94-bee9-7dc457bb6d0c req-02c492f0-2b90-42cc-954c-02a17e2b69a3 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing instance network info cache due to event network-changed-a1593d20-a266-4958-ba9d-6f03899e6195. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:11:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ed3bc7a3-6da1-4f94-bee9-7dc457bb6d0c req-02c492f0-2b90-42cc-954c-02a17e2b69a3 service nova] Acquiring lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:11:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ed3bc7a3-6da1-4f94-bee9-7dc457bb6d0c req-02c492f0-2b90-42cc-954c-02a17e2b69a3 service nova] Acquired lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:11:57 user nova-compute[74242]: DEBUG nova.network.neutron [req-ed3bc7a3-6da1-4f94-bee9-7dc457bb6d0c req-02c492f0-2b90-42cc-954c-02a17e2b69a3 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Refreshing network info cache for port a1593d20-a266-4958-ba9d-6f03899e6195 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:11:57 user nova-compute[74242]: DEBUG nova.network.neutron [req-ed3bc7a3-6da1-4f94-bee9-7dc457bb6d0c req-02c492f0-2b90-42cc-954c-02a17e2b69a3 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updated VIF entry in instance network info cache for port a1593d20-a266-4958-ba9d-6f03899e6195. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:11:57 user nova-compute[74242]: DEBUG nova.network.neutron [req-ed3bc7a3-6da1-4f94-bee9-7dc457bb6d0c req-02c492f0-2b90-42cc-954c-02a17e2b69a3 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updating instance_info_cache with network_info: [{"id": "a1593d20-a266-4958-ba9d-6f03899e6195", "address": "fa:16:3e:03:a4:17", "network": {"id": "35f39b1c-01dd-4269-bb70-ee2df8e0f279", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1724814878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1593d20-a2", "ovs_interfaceid": "a1593d20-a266-4958-ba9d-6f03899e6195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17f0118a-3e44-4d76-b03a-b06790728aec", "address": "fa:16:3e:b2:ee:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17f0118a-3e", "ovs_interfaceid": "17f0118a-3e44-4d76-b03a-b06790728aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a777aac-0d50-4036-823d-017f94a044b1", "address": "fa:16:3e:6f:b4:ee", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a777aac-0d", "ovs_interfaceid": "0a777aac-0d50-4036-823d-017f94a044b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "address": "fa:16:3e:af:aa:49", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4025d0ae-da", "ovs_interfaceid": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "address": "fa:16:3e:af:36:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69d4eef-6a", "ovs_interfaceid": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "address": "fa:16:3e:48:0b:b9", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c9e8a9-b1", "ovs_interfaceid": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "address": "fa:16:3e:c5:2f:3d", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3751e3f-04", "ovs_interfaceid": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:11:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ed3bc7a3-6da1-4f94-bee9-7dc457bb6d0c req-02c492f0-2b90-42cc-954c-02a17e2b69a3 service nova] Releasing lock "refresh_cache-626bb196-0e5e-4dfd-8ead-57306c828b13" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:59 user nova-compute[74242]: INFO nova.compute.manager [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Terminating instance
Oct 20 02:11:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-3aa80776-56a8-4dc2-a1d8-deeed374ff00 req-9e1ea846-6383-4a36-a734-5ec8faf5f4af service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-unplugged-a1593d20-a266-4958-ba9d-6f03899e6195 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3aa80776-56a8-4dc2-a1d8-deeed374ff00 req-9e1ea846-6383-4a36-a734-5ec8faf5f4af service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3aa80776-56a8-4dc2-a1d8-deeed374ff00 req-9e1ea846-6383-4a36-a734-5ec8faf5f4af service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3aa80776-56a8-4dc2-a1d8-deeed374ff00 req-9e1ea846-6383-4a36-a734-5ec8faf5f4af service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-3aa80776-56a8-4dc2-a1d8-deeed374ff00 req-9e1ea846-6383-4a36-a734-5ec8faf5f4af service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-unplugged-a1593d20-a266-4958-ba9d-6f03899e6195 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-3aa80776-56a8-4dc2-a1d8-deeed374ff00 req-9e1ea846-6383-4a36-a734-5ec8faf5f4af service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-unplugged-a1593d20-a266-4958-ba9d-6f03899e6195 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-5334c511-1e90-4ff6-a404-0de92ea879af req-d6741fd0-2109-4879-b483-f468f76154a8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-unplugged-17f0118a-3e44-4d76-b03a-b06790728aec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5334c511-1e90-4ff6-a404-0de92ea879af req-d6741fd0-2109-4879-b483-f468f76154a8 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5334c511-1e90-4ff6-a404-0de92ea879af req-d6741fd0-2109-4879-b483-f468f76154a8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5334c511-1e90-4ff6-a404-0de92ea879af req-d6741fd0-2109-4879-b483-f468f76154a8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-5334c511-1e90-4ff6-a404-0de92ea879af req-d6741fd0-2109-4879-b483-f468f76154a8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-unplugged-17f0118a-3e44-4d76-b03a-b06790728aec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-5334c511-1e90-4ff6-a404-0de92ea879af req-d6741fd0-2109-4879-b483-f468f76154a8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-unplugged-17f0118a-3e44-4d76-b03a-b06790728aec for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:11:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-13395a02-d447-46df-97e3-d718aaa69b2a req-8ac1f2d0-f14d-4dc5-933d-4f3ca5d4b3d2 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-unplugged-0a777aac-0d50-4036-823d-017f94a044b1 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-13395a02-d447-46df-97e3-d718aaa69b2a req-8ac1f2d0-f14d-4dc5-933d-4f3ca5d4b3d2 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-13395a02-d447-46df-97e3-d718aaa69b2a req-8ac1f2d0-f14d-4dc5-933d-4f3ca5d4b3d2 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-13395a02-d447-46df-97e3-d718aaa69b2a req-8ac1f2d0-f14d-4dc5-933d-4f3ca5d4b3d2 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-13395a02-d447-46df-97e3-d718aaa69b2a req-8ac1f2d0-f14d-4dc5-933d-4f3ca5d4b3d2 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-unplugged-0a777aac-0d50-4036-823d-017f94a044b1 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-13395a02-d447-46df-97e3-d718aaa69b2a req-8ac1f2d0-f14d-4dc5-933d-4f3ca5d4b3d2 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-unplugged-0a777aac-0d50-4036-823d-017f94a044b1 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Instance destroyed successfully.
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.objects.instance [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lazy-loading 'resources' on Instance uuid 626bb196-0e5e-4dfd-8ead-57306c828b13 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:10:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a1593d20-a266-4958-ba9d-6f03899e6195", "address": "fa:16:3e:03:a4:17", "network": {"id": "35f39b1c-01dd-4269-bb70-ee2df8e0f279", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1724814878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1593d20-a2", "ovs_interfaceid": "a1593d20-a266-4958-ba9d-6f03899e6195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "a1593d20-a266-4958-ba9d-6f03899e6195", "address": "fa:16:3e:03:a4:17", "network": {"id": "35f39b1c-01dd-4269-bb70-ee2df8e0f279", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1724814878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1593d20-a2", "ovs_interfaceid": "a1593d20-a266-4958-ba9d-6f03899e6195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:a4:17,bridge_name='br-int',has_traffic_filtering=True,id=a1593d20-a266-4958-ba9d-6f03899e6195,network=Network(35f39b1c-01dd-4269-bb70-ee2df8e0f279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1593d20-a2') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG os_vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:a4:17,bridge_name='br-int',has_traffic_filtering=True,id=a1593d20-a266-4958-ba9d-6f03899e6195,network=Network(35f39b1c-01dd-4269-bb70-ee2df8e0f279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1593d20-a2') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa1593d20-a2, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b58b943-181c-4447-91fd-9572d025ea4f) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: INFO os_vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:a4:17,bridge_name='br-int',has_traffic_filtering=True,id=a1593d20-a266-4958-ba9d-6f03899e6195,network=Network(35f39b1c-01dd-4269-bb70-ee2df8e0f279),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa1593d20-a2')
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:10:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17f0118a-3e44-4d76-b03a-b06790728aec", "address": "fa:16:3e:b2:ee:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17f0118a-3e", "ovs_interfaceid": "17f0118a-3e44-4d76-b03a-b06790728aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "17f0118a-3e44-4d76-b03a-b06790728aec", "address": "fa:16:3e:b2:ee:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17f0118a-3e", "ovs_interfaceid": "17f0118a-3e44-4d76-b03a-b06790728aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ee:46,bridge_name='br-int',has_traffic_filtering=True,id=17f0118a-3e44-4d76-b03a-b06790728aec,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17f0118a-3e') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG os_vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ee:46,bridge_name='br-int',has_traffic_filtering=True,id=17f0118a-3e44-4d76-b03a-b06790728aec,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17f0118a-3e') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17f0118a-3e, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3cf38c79-3ec4-48bc-b56d-366cab4a69b9) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: INFO os_vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b2:ee:46,bridge_name='br-int',has_traffic_filtering=True,id=17f0118a-3e44-4d76-b03a-b06790728aec,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap17f0118a-3e')
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:10:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0a777aac-0d50-4036-823d-017f94a044b1", "address": "fa:16:3e:6f:b4:ee", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a777aac-0d", "ovs_interfaceid": "0a777aac-0d50-4036-823d-017f94a044b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "0a777aac-0d50-4036-823d-017f94a044b1", "address": "fa:16:3e:6f:b4:ee", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a777aac-0d", "ovs_interfaceid": "0a777aac-0d50-4036-823d-017f94a044b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b4:ee,bridge_name='br-int',has_traffic_filtering=True,id=0a777aac-0d50-4036-823d-017f94a044b1,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0a777aac-0d') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG os_vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b4:ee,bridge_name='br-int',has_traffic_filtering=True,id=0a777aac-0d50-4036-823d-017f94a044b1,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0a777aac-0d') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0a777aac-0d, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81f9528d-feb7-4fe8-b737-f88d22cee93e) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-a1593d20-a266-4958-ba9d-6f03899e6195 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-a1593d20-a266-4958-ba9d-6f03899e6195 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:01 user nova-compute[74242]: WARNING nova.compute.manager [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-a1593d20-a266-4958-ba9d-6f03899e6195 for instance with vm_state active and task_state deleting.
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-unplugged-4025d0ae-da49-4ae1-93ca-5fb17863f713 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-unplugged-4025d0ae-da49-4ae1-93ca-5fb17863f713 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-unplugged-4025d0ae-da49-4ae1-93ca-5fb17863f713 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-4025d0ae-da49-4ae1-93ca-5fb17863f713 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-4025d0ae-da49-4ae1-93ca-5fb17863f713 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:01 user nova-compute[74242]: WARNING nova.compute.manager [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-4025d0ae-da49-4ae1-93ca-5fb17863f713 for instance with vm_state active and task_state deleting.
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-unplugged-a3751e3f-044b-44fc-94ab-9e54484b46cc {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-unplugged-a3751e3f-044b-44fc-94ab-9e54484b46cc {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-unplugged-a3751e3f-044b-44fc-94ab-9e54484b46cc for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-a3751e3f-044b-44fc-94ab-9e54484b46cc {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-a3751e3f-044b-44fc-94ab-9e54484b46cc {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:01 user nova-compute[74242]: WARNING nova.compute.manager [req-868ead8a-0637-43a4-8f82-2f3a11c5ae7d req-565412b4-13b6-45e6-b271-1f6018d536d8 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-a3751e3f-044b-44fc-94ab-9e54484b46cc for instance with vm_state active and task_state deleting.
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: INFO os_vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6f:b4:ee,bridge_name='br-int',has_traffic_filtering=True,id=0a777aac-0d50-4036-823d-017f94a044b1,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap0a777aac-0d')
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:10:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "address": "fa:16:3e:af:aa:49", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4025d0ae-da", "ovs_interfaceid": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "address": "fa:16:3e:af:aa:49", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4025d0ae-da", "ovs_interfaceid": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:aa:49,bridge_name='br-int',has_traffic_filtering=True,id=4025d0ae-da49-4ae1-93ca-5fb17863f713,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4025d0ae-da') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG os_vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:aa:49,bridge_name='br-int',has_traffic_filtering=True,id=4025d0ae-da49-4ae1-93ca-5fb17863f713,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4025d0ae-da') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4025d0ae-da, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5265d248-8148-487b-a93c-ee9ff4e9515e) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-17f0118a-3e44-4d76-b03a-b06790728aec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-17f0118a-3e44-4d76-b03a-b06790728aec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:01 user nova-compute[74242]: WARNING nova.compute.manager [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-17f0118a-3e44-4d76-b03a-b06790728aec for instance with vm_state active and task_state deleting.
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-unplugged-d69d4eef-6af5-4d1d-8e7e-49a60dc36111 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-unplugged-d69d4eef-6af5-4d1d-8e7e-49a60dc36111 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-unplugged-d69d4eef-6af5-4d1d-8e7e-49a60dc36111 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-d69d4eef-6af5-4d1d-8e7e-49a60dc36111 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-d69d4eef-6af5-4d1d-8e7e-49a60dc36111 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:01 user nova-compute[74242]: WARNING nova.compute.manager [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-d69d4eef-6af5-4d1d-8e7e-49a60dc36111 for instance with vm_state active and task_state deleting.
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-unplugged-a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-unplugged-a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-unplugged-a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:01 user nova-compute[74242]: WARNING nova.compute.manager [req-15dfe955-6423-4e11-9943-d514e38377cc req-27205dc8-fe39-4d8d-b285-ff42e567010c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 for instance with vm_state active and task_state deleting.
Oct 20 02:12:01 user nova-compute[74242]: INFO os_vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:aa:49,bridge_name='br-int',has_traffic_filtering=True,id=4025d0ae-da49-4ae1-93ca-5fb17863f713,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4025d0ae-da')
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:10:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "address": "fa:16:3e:af:36:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69d4eef-6a", "ovs_interfaceid": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "address": "fa:16:3e:af:36:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.148", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd69d4eef-6a", "ovs_interfaceid": "d69d4eef-6af5-4d1d-8e7e-49a60dc36111", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:af:36:46,bridge_name='br-int',has_traffic_filtering=True,id=d69d4eef-6af5-4d1d-8e7e-49a60dc36111,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69d4eef-6a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG os_vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:36:46,bridge_name='br-int',has_traffic_filtering=True,id=d69d4eef-6af5-4d1d-8e7e-49a60dc36111,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69d4eef-6a') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd69d4eef-6a, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51624fb2-cc85-40f3-bb7f-cc7552d0aadf) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: INFO os_vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:af:36:46,bridge_name='br-int',has_traffic_filtering=True,id=d69d4eef-6af5-4d1d-8e7e-49a60dc36111,network=Network(a339da53-12ab-48fe-9d37-84a6cc7fd7e8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd69d4eef-6a')
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:10:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "address": "fa:16:3e:48:0b:b9", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c9e8a9-b1", "ovs_interfaceid": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "address": "fa:16:3e:48:0b:b9", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c9e8a9-b1", "ovs_interfaceid": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:0b:b9,bridge_name='br-int',has_traffic_filtering=True,id=a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9,network=Network(14bf9904-61c1-4cbf-ab7c-e6458c827909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c9e8a9-b1') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG os_vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0b:b9,bridge_name='br-int',has_traffic_filtering=True,id=a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9,network=Network(14bf9904-61c1-4cbf-ab7c-e6458c827909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c9e8a9-b1') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3c9e8a9-b1, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=40fa1754-9bfd-4348-8299-2ab3ee1050b7) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:02 user nova-compute[74242]: INFO os_vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:0b:b9,bridge_name='br-int',has_traffic_filtering=True,id=a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9,network=Network(14bf9904-61c1-4cbf-ab7c-e6458c827909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3c9e8a9-b1')
Oct 20 02:12:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-20T02:07:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1429375259',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1429375259',id=14,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCk1k/33j7MdKn3ltdSVwFstLSR4D6zQ1grK20/KArcabdHgAjehNqZTeDHzREQZA4vHdzwFemH+C9QH8UOYzTt9E1a/Z0OoHVgCqo+uOd/8ueS05wGQiQgbShMnDG46A==',key_name='tempest-keypair-717950447',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:10:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='62401f86776f46bdba398c876de8a575',ramdisk_id='',reservation_id='r-x4u7rmol',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1934919575',owner_user_name='tempest-TaggedBootDevicesTest_v242-1934919575-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:10:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a1d648d2ff70456aaaa6f6cbeec5c565',uuid=626bb196-0e5e-4dfd-8ead-57306c828b13,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "address": "fa:16:3e:c5:2f:3d", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3751e3f-04", "ovs_interfaceid": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converting VIF {"id": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "address": "fa:16:3e:c5:2f:3d", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3751e3f-04", "ovs_interfaceid": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:2f:3d,bridge_name='br-int',has_traffic_filtering=True,id=a3751e3f-044b-44fc-94ab-9e54484b46cc,network=Network(14bf9904-61c1-4cbf-ab7c-e6458c827909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3751e3f-04') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:2f:3d,bridge_name='br-int',has_traffic_filtering=True,id=a3751e3f-044b-44fc-94ab-9e54484b46cc,network=Network(14bf9904-61c1-4cbf-ab7c-e6458c827909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3751e3f-04') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa3751e3f-04, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5200483d-3190-419d-9cf1-a1b79334124e) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:02 user nova-compute[74242]: INFO os_vif [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:2f:3d,bridge_name='br-int',has_traffic_filtering=True,id=a3751e3f-044b-44fc-94ab-9e54484b46cc,network=Network(14bf9904-61c1-4cbf-ab7c-e6458c827909),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa3751e3f-04')
Oct 20 02:12:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FxlJPBft', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:12:02 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-bf6c2c10-80fe-4037-a20d-94e9e9d73f30 req-d832d4e6-ffe2-4e84-be63-f1deafe39c4c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-plugged-0a777aac-0d50-4036-823d-017f94a044b1 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bf6c2c10-80fe-4037-a20d-94e9e9d73f30 req-d832d4e6-ffe2-4e84-be63-f1deafe39c4c service nova] Acquiring lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bf6c2c10-80fe-4037-a20d-94e9e9d73f30 req-d832d4e6-ffe2-4e84-be63-f1deafe39c4c service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bf6c2c10-80fe-4037-a20d-94e9e9d73f30 req-d832d4e6-ffe2-4e84-be63-f1deafe39c4c service nova] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-bf6c2c10-80fe-4037-a20d-94e9e9d73f30 req-d832d4e6-ffe2-4e84-be63-f1deafe39c4c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] No waiting events found dispatching network-vif-plugged-0a777aac-0d50-4036-823d-017f94a044b1 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:02 user nova-compute[74242]: WARNING nova.compute.manager [req-bf6c2c10-80fe-4037-a20d-94e9e9d73f30 req-d832d4e6-ffe2-4e84-be63-f1deafe39c4c service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received unexpected event network-vif-plugged-0a777aac-0d50-4036-823d-017f94a044b1 for instance with vm_state active and task_state deleting.
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd34eac7-6922-4677-b6d7-d85ec3a70f86]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:12:02 user nova-compute[74242]: No targets found.
Oct 20 02:12:02 user nova-compute[74242]: iSNS:
Oct 20 02:12:02 user nova-compute[74242]: No targets found.
Oct 20 02:12:02 user nova-compute[74242]: STATIC:
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: FIRMWARE:
Oct 20 02:12:02 user nova-compute[74242]: No targets found.
Oct 20 02:12:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:12:02 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:12:02 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb079778-7331-40d2-b132-f5510df9320a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c075ff1b-0492-41f7-833c-ed9717f80313]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d01896c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d'): ({'sdd'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Removing single pathed devices sdd {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde281a3-0246-4889-8c39-1ceb070d5c2f]: (4, ('path checker states:\nup                  7\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc6af75-f10e-4f18-8d95-5413518f0b3f]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Flushing IO for device /dev/sdd {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bf93173-88a9-48fd-8eb6-953a8543e22f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[497db33e-4557-49f5-a4b9-b0953c494c6d]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e395af7b-72e0-4538-95a6-8a66e485a804]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0879106b-d1aa-4ec9-abc0-b6823299624b]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d, portal: 172.16.0.220,3260]
Oct 20 02:12:02 user nova-compute[74242]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d, portal: 172.16.0.220,3260] successful.
Oct 20 02:12:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbb8694b-1d43-40e0-bacf-3b6217a16f5d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d7272e0-35e0-4f36-98ff-42fb9a1d9550]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.379s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] <== disconnect_volume: return (380ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MRvxCGTz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:12:02 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee4413f-352a-4738-b4e5-2c06bf946ceb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:12:02 user nova-compute[74242]: No targets found.
Oct 20 02:12:02 user nova-compute[74242]: iSNS:
Oct 20 02:12:02 user nova-compute[74242]: No targets found.
Oct 20 02:12:02 user nova-compute[74242]: STATIC:
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: FIRMWARE:
Oct 20 02:12:02 user nova-compute[74242]: No targets found.
Oct 20 02:12:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:12:02 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:12:02 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a4ce46-4240-4e81-88ab-afba05aa5153]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b02e568-a832-4c12-90ad-4b92ddaf9919]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b828dcf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c'): ({'sdf'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Removing single pathed devices sdf {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ada9a1-3aad-4170-a46d-0108952a860a]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f9488b-0e65-4e75-b2ce-206ed28ee465]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Flushing IO for device /dev/sdf {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[435be3e6-cc19-4628-8c70-3cce8d71e7a8]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.040s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[55534ba6-8931-4581-920e-8e9434db7c75]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] SCSI volumes sdf have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[12956e3d-d4c0-42ae-921f-dc89546cc97c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b9c522-e2f5-4a99-9e4d-d6abb2b772ea]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c, portal: 172.16.0.220,3260]
Oct 20 02:12:02 user nova-compute[74242]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c, portal: 172.16.0.220,3260] successful.
Oct 20 02:12:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e34d0dc-134e-4e91-84e6-d16394881d1c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae159be-2088-4479-971a-899475357f71]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] <== disconnect_volume: return (334ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iszRIhLt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:12:02 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3efdc7-dd14-434d-8cad-b84da08b3ce9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:12:02 user nova-compute[74242]: No targets found.
Oct 20 02:12:02 user nova-compute[74242]: iSNS:
Oct 20 02:12:02 user nova-compute[74242]: No targets found.
Oct 20 02:12:02 user nova-compute[74242]: STATIC:
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566
Oct 20 02:12:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:02 user nova-compute[74242]: FIRMWARE:
Oct 20 02:12:02 user nova-compute[74242]: No targets found.
Oct 20 02:12:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:12:02 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:12:02 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[479f7ff3-ae0d-48ae-ad1d-2265359fbee9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6ce722-1570-49e6-bc9e-0295b9969ebf]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b828e3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a'): ({'sdg'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Removing single pathed devices sdg {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a07761-c6a7-4ce9-a3e9-89797582fbbd]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[376c9658-89b9-49a3-a4ac-dc0ab7759794]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Flushing IO for device /dev/sdg {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e13e55e-9a67-4991-a409-c1b8e403afd6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:12:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[848a2eea-e1de-4b60-b86e-995caeedce36]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] SCSI volumes sdg have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3084607-8fbc-4988-be84-28df3f55d80c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[588ffde3-955f-42e8-b57e-2f7e9010cb8d]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a, portal: 172.16.0.220,3260]
Oct 20 02:12:03 user nova-compute[74242]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a, portal: 172.16.0.220,3260] successful.
Oct 20 02:12:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:962ae9c3-39bd-4f74-8bf4-958d7e547c7a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a881c34-e375-4baf-b4fd-a46ae90f10fa]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] <== disconnect_volume: return (351ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:12:03 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Deleting instance files /opt/stack/data/nova/instances/626bb196-0e5e-4dfd-8ead-57306c828b13_del
Oct 20 02:12:03 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Deletion of /opt/stack/data/nova/instances/626bb196-0e5e-4dfd-8ead-57306c828b13_del complete
Oct 20 02:12:03 user nova-compute[74242]: INFO nova.compute.manager [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Took 3.77 seconds to destroy the instance on the hypervisor.
Oct 20 02:12:03 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "c909c918-59a9-42fe-99fe-72431ba43443" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "c909c918-59a9-42fe-99fe-72431ba43443" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:03 user nova-compute[74242]: INFO nova.compute.manager [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Detaching volume 4af7b0a8-d384-4def-8ef9-0f2ec5dcf160
Oct 20 02:12:03 user nova-compute[74242]: INFO nova.virt.block_device [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Attempting to driver detach volume 4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 from mountpoint /dev/vdb
Oct 20 02:12:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Attempting to detach device vdb from instance c909c918-59a9-42fe-99fe-72431ba43443 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:12:03 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:12:03 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:12:03 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:12:03 user nova-compute[74242]:   <serial>4af7b0a8-d384-4def-8ef9-0f2ec5dcf160</serial>
Oct 20 02:12:03 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 02:12:03 user nova-compute[74242]: </disk>
Oct 20 02:12:03 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:12:03 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Successfully detached device vdb from instance c909c918-59a9-42fe-99fe-72431ba43443 from the persistent domain config.
Oct 20 02:12:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c909c918-59a9-42fe-99fe-72431ba43443 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:12:03 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:12:03 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:12:03 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:12:03 user nova-compute[74242]:   <serial>4af7b0a8-d384-4def-8ef9-0f2ec5dcf160</serial>
Oct 20 02:12:03 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 02:12:03 user nova-compute[74242]: </disk>
Oct 20 02:12:03 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:12:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c909c918-59a9-42fe-99fe-72431ba43443 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:12:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:04 user nova-compute[74242]: DEBUG nova.compute.manager [req-2b25ba12-2fbc-45af-a806-098f9171adac req-c1ba05ab-c3a3-42b6-80ab-e2f5acef3073 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-deleted-d69d4eef-6af5-4d1d-8e7e-49a60dc36111 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:04 user nova-compute[74242]: INFO nova.compute.manager [req-2b25ba12-2fbc-45af-a806-098f9171adac req-c1ba05ab-c3a3-42b6-80ab-e2f5acef3073 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Neutron deleted interface d69d4eef-6af5-4d1d-8e7e-49a60dc36111; detaching it from the instance and deleting it from the info cache
Oct 20 02:12:04 user nova-compute[74242]: DEBUG nova.network.neutron [req-2b25ba12-2fbc-45af-a806-098f9171adac req-c1ba05ab-c3a3-42b6-80ab-e2f5acef3073 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updating instance_info_cache with network_info: [{"id": "a1593d20-a266-4958-ba9d-6f03899e6195", "address": "fa:16:3e:03:a4:17", "network": {"id": "35f39b1c-01dd-4269-bb70-ee2df8e0f279", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1724814878-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.31", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa1593d20-a2", "ovs_interfaceid": "a1593d20-a266-4958-ba9d-6f03899e6195", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "17f0118a-3e44-4d76-b03a-b06790728aec", "address": "fa:16:3e:b2:ee:46", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.127", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17f0118a-3e", "ovs_interfaceid": "17f0118a-3e44-4d76-b03a-b06790728aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0a777aac-0d50-4036-823d-017f94a044b1", "address": "fa:16:3e:6f:b4:ee", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.78", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0a777aac-0d", "ovs_interfaceid": "0a777aac-0d50-4036-823d-017f94a044b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "address": "fa:16:3e:af:aa:49", "network": {"id": "a339da53-12ab-48fe-9d37-84a6cc7fd7e8", "bridge": "br-int", "label": "tempest-device-tagging-net1-268261349", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.204", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4025d0ae-da", "ovs_interfaceid": "4025d0ae-da49-4ae1-93ca-5fb17863f713", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "address": "fa:16:3e:48:0b:b9", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3c9e8a9-b1", "ovs_interfaceid": "a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "address": "fa:16:3e:c5:2f:3d", "network": {"id": "14bf9904-61c1-4cbf-ab7c-e6458c827909", "bridge": "br-int", "label": "tempest-device-tagging-net2-1765801346", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "62401f86776f46bdba398c876de8a575", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa3751e3f-04", "ovs_interfaceid": "a3751e3f-044b-44fc-94ab-9e54484b46cc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:12:04 user nova-compute[74242]: DEBUG nova.compute.manager [req-2b25ba12-2fbc-45af-a806-098f9171adac req-c1ba05ab-c3a3-42b6-80ab-e2f5acef3073 service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Detach interface failed, port_id=d69d4eef-6af5-4d1d-8e7e-49a60dc36111, reason: Instance 626bb196-0e5e-4dfd-8ead-57306c828b13 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:12:06 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:12:06 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Took 3.36 seconds to deallocate network for instance.
Oct 20 02:12:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-7eff3866-58dc-4178-be4c-f2b688fd53e1 req-b5f2c341-3cd3-455d-bb7b-7f4cdaa3d3ae service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-deleted-a1593d20-a266-4958-ba9d-6f03899e6195 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-7eff3866-58dc-4178-be4c-f2b688fd53e1 req-b5f2c341-3cd3-455d-bb7b-7f4cdaa3d3ae service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-deleted-a3c9e8a9-b1df-4529-ad29-f1f8120e1ca9 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-7eff3866-58dc-4178-be4c-f2b688fd53e1 req-b5f2c341-3cd3-455d-bb7b-7f4cdaa3d3ae service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-deleted-4025d0ae-da49-4ae1-93ca-5fb17863f713 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-7eff3866-58dc-4178-be4c-f2b688fd53e1 req-b5f2c341-3cd3-455d-bb7b-7f4cdaa3d3ae service nova] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Received event network-vif-deleted-a3751e3f-044b-44fc-94ab-9e54484b46cc {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:12:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:12:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:12:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:12:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:23 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c909c918-59a9-42fe-99fe-72431ba43443 is timed out.
Oct 20 02:12:23 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Successfully detached device vdb from instance c909c918-59a9-42fe-99fe-72431ba43443 from the live domain config.
Oct 20 02:12:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:12:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'aCVHudct', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:12:23 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:12:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:12:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:12:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[49241f77-23f5-4483-948a-6d1bf04e5e81]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:12:23 user nova-compute[74242]: No targets found.
Oct 20 02:12:23 user nova-compute[74242]: iSNS:
Oct 20 02:12:23 user nova-compute[74242]: No targets found.
Oct 20 02:12:23 user nova-compute[74242]: STATIC:
Oct 20 02:12:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4
Oct 20 02:12:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502
Oct 20 02:12:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a
Oct 20 02:12:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160
Oct 20 02:12:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566
Oct 20 02:12:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:23 user nova-compute[74242]: FIRMWARE:
Oct 20 02:12:23 user nova-compute[74242]: No targets found.
Oct 20 02:12:23 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:12:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:12:23 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:12:23 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:12:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:12:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[112a2da3-eb17-47a2-8100-608ded7262bf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dcb2994-24b6-45d4-b982-9d3942010619]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:24 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:12:24 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:12:24 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:24 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:24 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:24 user nova-compute[74242]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 (non-flash)
Oct 20 02:12:24 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:12:24 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:24 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:24 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b872c940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160'): ({'sdc'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Removing single pathed devices sdc {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf0a33f-03da-4eee-9e47-710309aac6ca]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7bb6b1-757e-4147-922a-7587db17c2f2]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Flushing IO for device /dev/sdc {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ee6d258-de7f-4904-9511-b213b51c5716]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.037s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8360bbc0-2ab3-49f0-b927-45278f8ac2c5]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b40909f-04c8-49e5-a41b-77fafd481369]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e706bd-b777-4a82-887d-18c294c0bbce]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260]
Oct 20 02:12:24 user nova-compute[74242]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160, portal: 172.16.0.220,3260] successful.
Oct 20 02:12:24 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4af7b0a8-d384-4def-8ef9-0f2ec5dcf160 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[956ecb55-18e8-4b6b-924e-89caf2351b6d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] <== disconnect_volume: return (306ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:12:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:12:25 user nova-compute[74242]: DEBUG nova.objects.instance [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lazy-loading 'flavor' on Instance uuid c909c918-59a9-42fe-99fe-72431ba43443 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:12:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c6483944-9c53-4d23-a9e3-9b48064d7231 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "c909c918-59a9-42fe-99fe-72431ba43443" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.936s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-88256f57-79d7-44b5-8d73-56ba3a9fea41 req-f3d2a33e-46b9-4c03-8c02-658cb7f62f47 service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Received event network-changed-063bd34a-5020-427a-94cc-51df3002af02 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-88256f57-79d7-44b5-8d73-56ba3a9fea41 req-f3d2a33e-46b9-4c03-8c02-658cb7f62f47 service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Refreshing instance network info cache due to event network-changed-063bd34a-5020-427a-94cc-51df3002af02. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:12:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-88256f57-79d7-44b5-8d73-56ba3a9fea41 req-f3d2a33e-46b9-4c03-8c02-658cb7f62f47 service nova] Acquiring lock "refresh_cache-7c68c0e0-fb73-4458-9dc0-e05560c0509f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:12:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-88256f57-79d7-44b5-8d73-56ba3a9fea41 req-f3d2a33e-46b9-4c03-8c02-658cb7f62f47 service nova] Acquired lock "refresh_cache-7c68c0e0-fb73-4458-9dc0-e05560c0509f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:12:27 user nova-compute[74242]: DEBUG nova.network.neutron [req-88256f57-79d7-44b5-8d73-56ba3a9fea41 req-f3d2a33e-46b9-4c03-8c02-658cb7f62f47 service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Refreshing network info cache for port 063bd34a-5020-427a-94cc-51df3002af02 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:12:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:12:27 user nova-compute[74242]: DEBUG nova.network.neutron [req-88256f57-79d7-44b5-8d73-56ba3a9fea41 req-f3d2a33e-46b9-4c03-8c02-658cb7f62f47 service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Updated VIF entry in instance network info cache for port 063bd34a-5020-427a-94cc-51df3002af02. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:12:27 user nova-compute[74242]: DEBUG nova.network.neutron [req-88256f57-79d7-44b5-8d73-56ba3a9fea41 req-f3d2a33e-46b9-4c03-8c02-658cb7f62f47 service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Updating instance_info_cache with network_info: [{"id": "063bd34a-5020-427a-94cc-51df3002af02", "address": "fa:16:3e:ab:01:76", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063bd34a-50", "ovs_interfaceid": "063bd34a-5020-427a-94cc-51df3002af02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:12:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-88256f57-79d7-44b5-8d73-56ba3a9fea41 req-f3d2a33e-46b9-4c03-8c02-658cb7f62f47 service nova] Releasing lock "refresh_cache-7c68c0e0-fb73-4458-9dc0-e05560c0509f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:28 user nova-compute[74242]: INFO nova.compute.manager [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Terminating instance
Oct 20 02:12:28 user nova-compute[74242]: DEBUG nova.compute.manager [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:28 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Instance destroyed successfully.
Oct 20 02:12:28 user nova-compute[74242]: DEBUG nova.objects.instance [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lazy-loading 'resources' on Instance uuid 7c68c0e0-fb73-4458-9dc0-e05560c0509f {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:10:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1424072206',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1424072206',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1424072206',id=20,image_ref='eb96aa2a-f2ed-4825-af78-8f7ebce11bcf',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD2lGnDkqYY3ry87H9q2zORHFlBl5aeXZ3sU9PBOLr7115V6HVVrvJc+5Q1CiAGg10U1NyzVuJdjs8eEgnEC+i8+1Wo0AT2HFqJQiLcmvIXQB8w3DePUJPo/KjrEwXGx/w==',key_name='tempest-keypair-1654096633',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:11:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-k52aqg4m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-882774340',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:11:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=7c68c0e0-fb73-4458-9dc0-e05560c0509f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "063bd34a-5020-427a-94cc-51df3002af02", "address": "fa:16:3e:ab:01:76", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063bd34a-50", "ovs_interfaceid": "063bd34a-5020-427a-94cc-51df3002af02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "063bd34a-5020-427a-94cc-51df3002af02", "address": "fa:16:3e:ab:01:76", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.85", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap063bd34a-50", "ovs_interfaceid": "063bd34a-5020-427a-94cc-51df3002af02", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:01:76,bridge_name='br-int',has_traffic_filtering=True,id=063bd34a-5020-427a-94cc-51df3002af02,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063bd34a-50') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG os_vif [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:01:76,bridge_name='br-int',has_traffic_filtering=True,id=063bd34a-5020-427a-94cc-51df3002af02,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063bd34a-50') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap063bd34a-50, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=feec4fef-1dfd-4052-982b-5bf9363845bf) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:28 user nova-compute[74242]: INFO os_vif [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:01:76,bridge_name='br-int',has_traffic_filtering=True,id=063bd34a-5020-427a-94cc-51df3002af02,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap063bd34a-50')
Oct 20 02:12:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ioMONpgP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:12:28 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:12:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eed33fb-0973-411d-8f7b-223a54ae7fb2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:12:28 user nova-compute[74242]: No targets found.
Oct 20 02:12:28 user nova-compute[74242]: iSNS:
Oct 20 02:12:28 user nova-compute[74242]: No targets found.
Oct 20 02:12:28 user nova-compute[74242]: STATIC:
Oct 20 02:12:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4
Oct 20 02:12:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502
Oct 20 02:12:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a
Oct 20 02:12:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566
Oct 20 02:12:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:28 user nova-compute[74242]: FIRMWARE:
Oct 20 02:12:28 user nova-compute[74242]: No targets found.
Oct 20 02:12:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:12:28 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:12:28 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f2523b-9e59-4bef-87b5-901c05f3e50b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e87ac66-d4fb-4beb-9dd5-f4579f681772]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:28 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:12:28 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:28 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:28 user nova-compute[74242]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a (non-flash)
Oct 20 02:12:28 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:28 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d029ad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a'): ({'sde'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Removing single pathed devices sde {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:12:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd6060a-403f-4eef-b9e0-8c36bb324ea0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc17bf9-0bad-41db-a3bc-b12b37a24e78]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flushing IO for device /dev/sde {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a3d975d-3c60-4600-a844-e61e4cfa0682]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-1a039565-39ff-4cd0-a5a6-4acd749a2ad8 req-90c96bc9-aadd-4f1d-849a-29e059eff22f service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Received event network-vif-unplugged-063bd34a-5020-427a-94cc-51df3002af02 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1a039565-39ff-4cd0-a5a6-4acd749a2ad8 req-90c96bc9-aadd-4f1d-849a-29e059eff22f service nova] Acquiring lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1a039565-39ff-4cd0-a5a6-4acd749a2ad8 req-90c96bc9-aadd-4f1d-849a-29e059eff22f service nova] Lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1a039565-39ff-4cd0-a5a6-4acd749a2ad8 req-90c96bc9-aadd-4f1d-849a-29e059eff22f service nova] Lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-1a039565-39ff-4cd0-a5a6-4acd749a2ad8 req-90c96bc9-aadd-4f1d-849a-29e059eff22f service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] No waiting events found dispatching network-vif-unplugged-063bd34a-5020-427a-94cc-51df3002af02 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-1a039565-39ff-4cd0-a5a6-4acd749a2ad8 req-90c96bc9-aadd-4f1d-849a-29e059eff22f service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Received event network-vif-unplugged-063bd34a-5020-427a-94cc-51df3002af02 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-1a039565-39ff-4cd0-a5a6-4acd749a2ad8 req-90c96bc9-aadd-4f1d-849a-29e059eff22f service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Received event network-vif-plugged-063bd34a-5020-427a-94cc-51df3002af02 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1a039565-39ff-4cd0-a5a6-4acd749a2ad8 req-90c96bc9-aadd-4f1d-849a-29e059eff22f service nova] Acquiring lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1a039565-39ff-4cd0-a5a6-4acd749a2ad8 req-90c96bc9-aadd-4f1d-849a-29e059eff22f service nova] Lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1a039565-39ff-4cd0-a5a6-4acd749a2ad8 req-90c96bc9-aadd-4f1d-849a-29e059eff22f service nova] Lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-1a039565-39ff-4cd0-a5a6-4acd749a2ad8 req-90c96bc9-aadd-4f1d-849a-29e059eff22f service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] No waiting events found dispatching network-vif-plugged-063bd34a-5020-427a-94cc-51df3002af02 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:29 user nova-compute[74242]: WARNING nova.compute.manager [req-1a039565-39ff-4cd0-a5a6-4acd749a2ad8 req-90c96bc9-aadd-4f1d-849a-29e059eff22f service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Received unexpected event network-vif-plugged-063bd34a-5020-427a-94cc-51df3002af02 for instance with vm_state active and task_state deleting.
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e11deb-d087-4dca-b472-117b5bfcc4d6]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23263623033383566', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7e3a1df5', '/dev/disk/by-id/scsi-1SCST_BIO7e3a1df5-2cb0385f5bb99954') {{(pid=85329) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4c6019-1c10-4c27-b58c-e350e8223f19]: (4, None) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4977e4d-2928-4dc9-a95a-d1a3dd816760]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5cee5a-8ec3-4b64-8869-54efb7c77963]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a, portal: 172.16.0.220,3260]
Oct 20 02:12:29 user nova-compute[74242]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a, portal: 172.16.0.220,3260] successful.
Oct 20 02:12:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a6789df0-c12d-4587-8be0-acbedfb5ba4a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19acba2-183a-4f8e-809f-1dba3c6bbb22]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.344s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== disconnect_volume: return (347ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:12:29 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Deleting instance files /opt/stack/data/nova/instances/7c68c0e0-fb73-4458-9dc0-e05560c0509f_del
Oct 20 02:12:29 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Deletion of /opt/stack/data/nova/instances/7c68c0e0-fb73-4458-9dc0-e05560c0509f_del complete
Oct 20 02:12:29 user nova-compute[74242]: INFO nova.compute.manager [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Took 1.43 seconds to destroy the instance on the hypervisor.
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:12:29 user nova-compute[74242]: INFO nova.compute.manager [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] [instance: 626bb196-0e5e-4dfd-8ead-57306c828b13] Took 22.94 seconds to detach 3 volumes for instance.
Oct 20 02:12:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:12:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.381s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:30 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Deleted allocations for instance 626bb196-0e5e-4dfd-8ead-57306c828b13
Oct 20 02:12:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7906adc-29f0-4e35-894d-fa5ffe9e476e tempest-TaggedBootDevicesTest_v242-1934919575 tempest-TaggedBootDevicesTest_v242-1934919575-project-member] Lock "626bb196-0e5e-4dfd-8ead-57306c828b13" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 30.690s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:30 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:12:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-8283655a-d25a-4dd0-bcda-b9664d50b15d req-cef7bb56-eac9-43a2-b187-c046fee02f0d service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Received event network-vif-deleted-063bd34a-5020-427a-94cc-51df3002af02 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:30 user nova-compute[74242]: INFO nova.compute.manager [req-8283655a-d25a-4dd0-bcda-b9664d50b15d req-cef7bb56-eac9-43a2-b187-c046fee02f0d service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Neutron deleted interface 063bd34a-5020-427a-94cc-51df3002af02; detaching it from the instance and deleting it from the info cache
Oct 20 02:12:30 user nova-compute[74242]: DEBUG nova.network.neutron [req-8283655a-d25a-4dd0-bcda-b9664d50b15d req-cef7bb56-eac9-43a2-b187-c046fee02f0d service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:12:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:12:30 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Took 0.80 seconds to deallocate network for instance.
Oct 20 02:12:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:12:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:12:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-8283655a-d25a-4dd0-bcda-b9664d50b15d req-cef7bb56-eac9-43a2-b187-c046fee02f0d service nova] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Detach interface failed, port_id=063bd34a-5020-427a-94cc-51df3002af02, reason: Instance 7c68c0e0-fb73-4458-9dc0-e05560c0509f could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:12:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:12:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:12:30 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:12:30 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updating instance_info_cache with network_info: [{"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:12:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:12:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:12:32 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:12:32 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:12:32 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:12:32 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:12:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:33 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:12:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:33 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:12:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:12:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdi (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:12:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:12:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:37 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:12:37 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:12:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7375MB free_disk=25.203792572021484GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c909c918-59a9-42fe-99fe-72431ba43443 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7e101002-a175-40fe-b5ca-04a58610f60d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 72003d17-9292-4bdd-acfc-0d3f7e40df80 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 07377280-e3f5-4edd-9501-678dcde42ef3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 9701b02d-0874-45f9-a599-8c1809f234c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7c68c0e0-fb73-4458-9dc0-e05560c0509f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d1559836-bd5f-402d-b7b2-1ea2e613b362 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 20b69222-b73f-4a7d-9807-d476439e1e2a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance a37dce3b-16e3-4f5f-8412-38291312b306 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:12:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:12:38 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:12:38 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:12:38 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:12:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.551s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGQhFZIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '72003d17-9292-4bdd-acfc-0d3f7e40df80', 'attached_at': '', 'detached_at': '', 'volume_id': 'a57d408c-853f-4859-bbe9-7608dc3157cb', 'serial': 'a57d408c-853f-4859-bbe9-7608dc3157cb'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmknUdXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '0eeba8c7-d10b-40aa-a048-5b18e5d6b502'}, 'status': 'reserved', 'instance': '72003d17-9292-4bdd-acfc-0d3f7e40df80', 'attached_at': '', 'detached_at': '', 'volume_id': '0eeba8c7-d10b-40aa-a048-5b18e5d6b502', 'serial'} {{(pid=74242) _swap_volume /opt/stack/nova/nova/compute/manager.py:7781}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGQhFZIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:12:39 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:12:39 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:12:39 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01d2060-4eb3-416a-9ca3-84d424fb9a34]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:12:39 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc573f96-185c-4833-98cd-4369ef4c1b76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb] added
Oct 20 02:12:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ca983c9-6eb3-48a2-b3ee-10a6adc09ac7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[820ea5a1-7ce3-4074-ae6c-fe2ac2cead4d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGQhFZIU {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oGQhFZIU" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fe12f4-94f4-431e-9a4a-cc084a96859c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oGQhFZIU'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ec8a61-6f46-407f-b7f8-36dd4ab73f9d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c849a6-eb33-4903-be62-b1aa269488c4]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:39 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:39 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:39 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:39 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44e2ce7-a7c8-4699-a06b-832668f7fb3f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260]
Oct 20 02:12:39 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260] successful.
Oct 20 02:12:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b319ee-361e-4bff-8393-bd11bce19e81]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a00849d-fbab-463b-887d-d81782320796]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:39 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:39 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:39 user nova-compute[74242]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:12:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:39 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:39 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:39 user nova-compute[74242]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:12:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] HCTL ('34', '-', '-', 0) found on session 25 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Scanning host 34 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5413b5-acf8-46c4-9eb6-399b2dac0a7e]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Searching for a device in session 25 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:12:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGQhFZIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:12:40 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:12:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:12:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26463633730623264', 'path': '/dev/sdc'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:12:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463633730623264', 'path': '/dev/sdc'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:12:40 user nova-compute[74242]: DEBUG nova.objects.instance [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lazy-loading 'flavor' on Instance uuid 72003d17-9292-4bdd-acfc-0d3f7e40df80 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:12:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:12:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 118489088 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:12:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 238026752 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:12:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 390070272 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:12:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 544210944 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:12:43 user nova-compute[74242]: INFO nova.compute.manager [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Took 13.08 seconds to detach 1 volumes for instance.
Oct 20 02:12:43 user nova-compute[74242]: DEBUG nova.compute.manager [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 7c68c0e0-fb73-4458-9dc0-e05560c0509f] Deleting volume: a6789df0-c12d-4587-8be0-acbedfb5ba4a {{(pid=74242) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 02:12:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 672137216 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:12:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 812646400 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:12:44 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:12:44 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:12:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.572s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:44 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Deleted allocations for instance 7c68c0e0-fb73-4458-9dc0-e05560c0509f
Oct 20 02:12:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fd16e2a0-9ff4-42c2-8109-de445d1b8d49 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "7c68c0e0-fb73-4458-9dc0-e05560c0509f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 16.433s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 948961280 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SmknUdXq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi', 'volume_id': '0eeba8c7-d10b-40aa-a048-5b18e5d6b502'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:12:45 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae6d570-a5d9-4958-8d7a-6f3a14776f82]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:12:45 user nova-compute[74242]: No targets found.
Oct 20 02:12:45 user nova-compute[74242]: iSNS:
Oct 20 02:12:45 user nova-compute[74242]: No targets found.
Oct 20 02:12:45 user nova-compute[74242]: STATIC:
Oct 20 02:12:45 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4
Oct 20 02:12:45 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:45 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:45 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502
Oct 20 02:12:45 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:45 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:45 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb
Oct 20 02:12:45 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:45 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:45 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566
Oct 20 02:12:45 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:12:45 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:12:45 user nova-compute[74242]: FIRMWARE:
Oct 20 02:12:45 user nova-compute[74242]: No targets found.
Oct 20 02:12:45 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:12:45 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:12:45 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a0cca0b-145f-49e1-b4e3-9536b9751793]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[752d0b25-a18f-4055-9486-4652c9ac7a82]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:45 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:45 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:45 user nova-compute[74242]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:12:45 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:12:45 user nova-compute[74242]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 (non-flash)
Oct 20 02:12:45 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:12:45 user nova-compute[74242]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:12:45 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d930a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502'): ({'sdi'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Removing single pathed devices sdi {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e270c7-35b6-4e55-86a7-e021fb9f3495]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cbafed9-b0b2-4b59-b6e8-ef7576c7f303]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Flushing IO for device /dev/sdi {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e1873d-5aa1-4169-a5a3-d9636d90a4cb]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.041s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[488c1913-ffb9-4fb5-adbb-206afcc1cf3e]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] SCSI volumes sdi have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf03d1f-760d-4af7-9f3b-aff27f8d47c7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cc1751-a263-4fe7-a5da-e70af9047ffe]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502, portal: 172.16.0.220,3260]
Oct 20 02:12:45 user nova-compute[74242]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502, portal: 172.16.0.220,3260] successful.
Oct 20 02:12:45 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0eeba8c7-d10b-40aa-a048-5b18e5d6b502 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a20b946a-4fbb-4905-bf45-0744959c1201]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] <== disconnect_volume: return (325ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG nova.compute.manager [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGQhFZIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '72003d17-9292-4bdd-acfc-0d3f7e40df80', 'attached_at': '', 'detached_at': '', 'volume_id': 'a57d408c-853f-4859-bbe9-7608dc3157cb', 'serial'} {{(pid=74242) _swap_volume /opt/stack/nova/nova/compute/manager.py:7790}}
Oct 20 02:12:45 user nova-compute[74242]: DEBUG nova.compute.manager [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] swap_volume: removing Cinder connection for volume 0eeba8c7-d10b-40aa-a048-5b18e5d6b502 {{(pid=74242) _swap_volume /opt/stack/nova/nova/compute/manager.py:7835}}
Oct 20 02:12:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] swap_volume: Updating volume 0eeba8c7-d10b-40aa-a048-5b18e5d6b502 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "oGQhFZIU", "auth_password": "0PlNjdqv64sLGM", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdc", "volume_id": "a57d408c-853f-4859-bbe9-7608dc3157cb"}, "status": "reserved", "instance": "72003d17-9292-4bdd-acfc-0d3f7e40df80", "attached_at": "", "detached_at": "", "volume_id": "a57d408c-853f-4859-bbe9-7608dc3157cb", "serial": "a57d408c-853f-4859-bbe9-7608dc3157cb"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a57d408c-853f-4859-bbe9-7608dc3157cb', 'no_device': None, 'attachment_id': 'df48be2b-6968-45ca-a26c-958a4bf4e9a0'} {{(pid=74242) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7983}}
Oct 20 02:12:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-921d527c-e51f-48ba-a6e0-193960f8f4a6 tempest-TestVolumeSwap-1629739676 tempest-TestVolumeSwap-1629739676-project-admin] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 75.660s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquiring lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:47 user nova-compute[74242]: INFO nova.compute.manager [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Detaching volume a57d408c-853f-4859-bbe9-7608dc3157cb
Oct 20 02:12:47 user nova-compute[74242]: INFO nova.virt.block_device [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Attempting to driver detach volume a57d408c-853f-4859-bbe9-7608dc3157cb from mountpoint /dev/vdb
Oct 20 02:12:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Attempting to detach device vdb from instance 72003d17-9292-4bdd-acfc-0d3f7e40df80 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:12:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:12:47 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:12:47 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:12:47 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:12:47 user nova-compute[74242]:   <serial>a57d408c-853f-4859-bbe9-7608dc3157cb</serial>
Oct 20 02:12:47 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:12:47 user nova-compute[74242]: </disk>
Oct 20 02:12:47 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:12:47 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Successfully detached device vdb from instance 72003d17-9292-4bdd-acfc-0d3f7e40df80 from the persistent domain config.
Oct 20 02:12:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 72003d17-9292-4bdd-acfc-0d3f7e40df80 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:12:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:12:47 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:12:47 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:12:47 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:12:47 user nova-compute[74242]:   <serial>a57d408c-853f-4859-bbe9-7608dc3157cb</serial>
Oct 20 02:12:47 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:12:47 user nova-compute[74242]: </disk>
Oct 20 02:12:47 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:12:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-82fe658b-4c4d-48af-b19c-c0fb7f82071b req-de269bc8-043e-4c0c-ae20-7c6ec8a5cb09 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received event network-changed-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-82fe658b-4c4d-48af-b19c-c0fb7f82071b req-de269bc8-043e-4c0c-ae20-7c6ec8a5cb09 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Refreshing instance network info cache due to event network-changed-75c2194c-b6fc-4b52-8643-2137bd1d1235. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:12:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-82fe658b-4c4d-48af-b19c-c0fb7f82071b req-de269bc8-043e-4c0c-ae20-7c6ec8a5cb09 service nova] Acquiring lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:12:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-82fe658b-4c4d-48af-b19c-c0fb7f82071b req-de269bc8-043e-4c0c-ae20-7c6ec8a5cb09 service nova] Acquired lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:12:47 user nova-compute[74242]: DEBUG nova.network.neutron [req-82fe658b-4c4d-48af-b19c-c0fb7f82071b req-de269bc8-043e-4c0c-ae20-7c6ec8a5cb09 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Refreshing network info cache for port 75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:12:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 72003d17-9292-4bdd-acfc-0d3f7e40df80 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:12:48 user nova-compute[74242]: DEBUG nova.network.neutron [req-82fe658b-4c4d-48af-b19c-c0fb7f82071b req-de269bc8-043e-4c0c-ae20-7c6ec8a5cb09 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Updated VIF entry in instance network info cache for port 75c2194c-b6fc-4b52-8643-2137bd1d1235. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:12:48 user nova-compute[74242]: DEBUG nova.network.neutron [req-82fe658b-4c4d-48af-b19c-c0fb7f82071b req-de269bc8-043e-4c0c-ae20-7c6ec8a5cb09 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Updating instance_info_cache with network_info: [{"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:12:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-82fe658b-4c4d-48af-b19c-c0fb7f82071b req-de269bc8-043e-4c0c-ae20-7c6ec8a5cb09 service nova] Releasing lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:12:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:12:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:12:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:12:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:12:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "c909c918-59a9-42fe-99fe-72431ba43443" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "c909c918-59a9-42fe-99fe-72431ba43443" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "c909c918-59a9-42fe-99fe-72431ba43443-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:53 user nova-compute[74242]: INFO nova.compute.manager [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Terminating instance
Oct 20 02:12:53 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:12:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-19983511-2d65-4e06-8be8-78eaccf38a51 req-fb6796e5-b2fd-4452-b460-005cbb71c4a8 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received event network-vif-unplugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-19983511-2d65-4e06-8be8-78eaccf38a51 req-fb6796e5-b2fd-4452-b460-005cbb71c4a8 service nova] Acquiring lock "c909c918-59a9-42fe-99fe-72431ba43443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-19983511-2d65-4e06-8be8-78eaccf38a51 req-fb6796e5-b2fd-4452-b460-005cbb71c4a8 service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-19983511-2d65-4e06-8be8-78eaccf38a51 req-fb6796e5-b2fd-4452-b460-005cbb71c4a8 service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-19983511-2d65-4e06-8be8-78eaccf38a51 req-fb6796e5-b2fd-4452-b460-005cbb71c4a8 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] No waiting events found dispatching network-vif-unplugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-19983511-2d65-4e06-8be8-78eaccf38a51 req-fb6796e5-b2fd-4452-b460-005cbb71c4a8 service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received event network-vif-unplugged-c358f4c8-2f05-4449-af69-dd6108ecf241 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:54 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Instance destroyed successfully.
Oct 20 02:12:54 user nova-compute[74242]: DEBUG nova.objects.instance [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lazy-loading 'resources' on Instance uuid c909c918-59a9-42fe-99fe-72431ba43443 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T02:06:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1170021543',display_name='tempest-ServerActionsTestOtherA-server-296753290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1170021543',id=13,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBrPBdfgfIOd9Bbgyl7XwDZEaA2/I2ig7YDFuATYsERYinJSZl+I4zqRDKdZ1kEG5DAM+H4I0B67KuA8LEv3daLR6RzgTmC0EkFXmvmntpdQWOjWI81e1VZVgofosnIjFA==',key_name='tempest-keypair-1122737131',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:09:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cf9b187fe8443aba57a8c629d78978e',ramdisk_id='',reservation_id='r-84vssbut',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2076229102',owner_user_name='tempest-ServerActionsTestOtherA-2076229102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:09:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1f488a444de49f5bed5351efd55dafa',uuid=c909c918-59a9-42fe-99fe-72431ba43443,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converting VIF {"id": "c358f4c8-2f05-4449-af69-dd6108ecf241", "address": "fa:16:3e:ba:d5:37", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.140", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc358f4c8-2f", "ovs_interfaceid": "c358f4c8-2f05-4449-af69-dd6108ecf241", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d5:37,bridge_name='br-int',has_traffic_filtering=True,id=c358f4c8-2f05-4449-af69-dd6108ecf241,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc358f4c8-2f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG os_vif [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d5:37,bridge_name='br-int',has_traffic_filtering=True,id=c358f4c8-2f05-4449-af69-dd6108ecf241,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc358f4c8-2f') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc358f4c8-2f, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef12875c-bcdb-4699-ab59-73a871b02af0) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:54 user nova-compute[74242]: INFO os_vif [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:d5:37,bridge_name='br-int',has_traffic_filtering=True,id=c358f4c8-2f05-4449-af69-dd6108ecf241,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc358f4c8-2f')
Oct 20 02:12:54 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Deleting instance files /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443_del
Oct 20 02:12:54 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Deletion of /opt/stack/data/nova/instances/c909c918-59a9-42fe-99fe-72431ba43443_del complete
Oct 20 02:12:54 user nova-compute[74242]: INFO nova.compute.manager [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 20 02:12:54 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:12:54 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: c909c918-59a9-42fe-99fe-72431ba43443] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "d1559836-bd5f-402d-b7b2-1ea2e613b362" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:56 user nova-compute[74242]: INFO nova.compute.manager [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Shelving
Oct 20 02:12:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-e36eea09-7f45-404d-9ea7-70b320a7be2f req-0559178b-607c-488c-a082-9c4e3b9924ca service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received event network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e36eea09-7f45-404d-9ea7-70b320a7be2f req-0559178b-607c-488c-a082-9c4e3b9924ca service nova] Acquiring lock "c909c918-59a9-42fe-99fe-72431ba43443-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e36eea09-7f45-404d-9ea7-70b320a7be2f req-0559178b-607c-488c-a082-9c4e3b9924ca service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e36eea09-7f45-404d-9ea7-70b320a7be2f req-0559178b-607c-488c-a082-9c4e3b9924ca service nova] Lock "c909c918-59a9-42fe-99fe-72431ba43443-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-e36eea09-7f45-404d-9ea7-70b320a7be2f req-0559178b-607c-488c-a082-9c4e3b9924ca service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] No waiting events found dispatching network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:56 user nova-compute[74242]: WARNING nova.compute.manager [req-e36eea09-7f45-404d-9ea7-70b320a7be2f req-0559178b-607c-488c-a082-9c4e3b9924ca service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received unexpected event network-vif-plugged-c358f4c8-2f05-4449-af69-dd6108ecf241 for instance with vm_state active and task_state deleting.
Oct 20 02:12:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:12:56 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Took 1.60 seconds to deallocate network for instance.
Oct 20 02:12:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-60bac553-c621-4105-a744-6afa0dd6febc req-7a377c29-57c1-4ffe-94e7-80a855d902ca service nova] [instance: c909c918-59a9-42fe-99fe-72431ba43443] Received event network-vif-deleted-c358f4c8-2f05-4449-af69-dd6108ecf241 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:12:56 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:12:56 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Instance destroyed successfully.
Oct 20 02:12:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.500s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.289s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:12:57 user nova-compute[74242]: INFO nova.compute.claims [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Claim successful on node user
Oct 20 02:12:57 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Deleted allocations for instance c909c918-59a9-42fe-99fe-72431ba43443
Oct 20 02:12:57 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Beginning cold snapshot process
Oct 20 02:12:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b2cebb2d-e3b7-413e-8ee5-256f8773a6b4 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "c909c918-59a9-42fe-99fe-72431ba43443" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.307s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:57 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:12:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk /opt/stack/data/nova/instances/snapshots/tmptc6t91wr/631a792e15234baaaabae1a28f2b1da7 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:12:57 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:12:57 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:12:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.652s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:12:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:12:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:12:57 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:12:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:12:57 user nova-compute[74242]: DEBUG nova.policy [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ac628a224fb4653932a27e33aa33c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112fda62d355421e80e674dc18bb5069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:12:57 user nova-compute[74242]: INFO nova.virt.block_device [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Booting with blank volume at /dev/vda
Oct 20 02:12:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk /opt/stack/data/nova/instances/snapshots/tmptc6t91wr/631a792e15234baaaabae1a28f2b1da7" returned: 0 in 0.859s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:12:58 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Snapshot extracted, beginning image upload
Oct 20 02:12:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-3fbc9111-022b-4039-bd0f-10d98fa4eed0 req-52c2d242-a0e8-4a5b-8350-6879f95b5306 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received event network-vif-unplugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3fbc9111-022b-4039-bd0f-10d98fa4eed0 req-52c2d242-a0e8-4a5b-8350-6879f95b5306 service nova] Acquiring lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3fbc9111-022b-4039-bd0f-10d98fa4eed0 req-52c2d242-a0e8-4a5b-8350-6879f95b5306 service nova] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3fbc9111-022b-4039-bd0f-10d98fa4eed0 req-52c2d242-a0e8-4a5b-8350-6879f95b5306 service nova] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-3fbc9111-022b-4039-bd0f-10d98fa4eed0 req-52c2d242-a0e8-4a5b-8350-6879f95b5306 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] No waiting events found dispatching network-vif-unplugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:58 user nova-compute[74242]: WARNING nova.compute.manager [req-3fbc9111-022b-4039-bd0f-10d98fa4eed0 req-52c2d242-a0e8-4a5b-8350-6879f95b5306 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received unexpected event network-vif-unplugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 02:12:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-3fbc9111-022b-4039-bd0f-10d98fa4eed0 req-52c2d242-a0e8-4a5b-8350-6879f95b5306 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received event network-vif-plugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3fbc9111-022b-4039-bd0f-10d98fa4eed0 req-52c2d242-a0e8-4a5b-8350-6879f95b5306 service nova] Acquiring lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:12:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3fbc9111-022b-4039-bd0f-10d98fa4eed0 req-52c2d242-a0e8-4a5b-8350-6879f95b5306 service nova] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:12:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3fbc9111-022b-4039-bd0f-10d98fa4eed0 req-52c2d242-a0e8-4a5b-8350-6879f95b5306 service nova] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:12:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-3fbc9111-022b-4039-bd0f-10d98fa4eed0 req-52c2d242-a0e8-4a5b-8350-6879f95b5306 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] No waiting events found dispatching network-vif-plugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:12:58 user nova-compute[74242]: WARNING nova.compute.manager [req-3fbc9111-022b-4039-bd0f-10d98fa4eed0 req-52c2d242-a0e8-4a5b-8350-6879f95b5306 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received unexpected event network-vif-plugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 for instance with vm_state active and task_state shelving_image_uploading.
Oct 20 02:12:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Successfully created port: 989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:12:59 user nova-compute[74242]: DEBUG nova.network.neutron [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Successfully updated port: 989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:12:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:12:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquired lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:12:59 user nova-compute[74242]: DEBUG nova.network.neutron [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:12:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-a6c9debb-0c6d-4300-925b-7e386467d248 req-c9754309-cf20-4aa3-b80d-467e5a16d986 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received event network-changed-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:12:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-a6c9debb-0c6d-4300-925b-7e386467d248 req-c9754309-cf20-4aa3-b80d-467e5a16d986 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Refreshing instance network info cache due to event network-changed-989425d9-6ff3-4460-9b24-aede590c961c. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:12:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a6c9debb-0c6d-4300-925b-7e386467d248 req-c9754309-cf20-4aa3-b80d-467e5a16d986 service nova] Acquiring lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:12:59 user nova-compute[74242]: DEBUG nova.network.neutron [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:12:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:12:59 user nova-compute[74242]: DEBUG nova.network.neutron [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Updating instance_info_cache with network_info: [{"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:12:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Releasing lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:12:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Instance network_info: |[{"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:12:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a6c9debb-0c6d-4300-925b-7e386467d248 req-c9754309-cf20-4aa3-b80d-467e5a16d986 service nova] Acquired lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:12:59 user nova-compute[74242]: DEBUG nova.network.neutron [req-a6c9debb-0c6d-4300-925b-7e386467d248 req-c9754309-cf20-4aa3-b80d-467e5a16d986 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Refreshing network info cache for port 989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:13:00 user nova-compute[74242]: DEBUG nova.network.neutron [req-a6c9debb-0c6d-4300-925b-7e386467d248 req-c9754309-cf20-4aa3-b80d-467e5a16d986 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Updated VIF entry in instance network info cache for port 989425d9-6ff3-4460-9b24-aede590c961c. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:13:00 user nova-compute[74242]: DEBUG nova.network.neutron [req-a6c9debb-0c6d-4300-925b-7e386467d248 req-c9754309-cf20-4aa3-b80d-467e5a16d986 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Updating instance_info_cache with network_info: [{"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:13:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a6c9debb-0c6d-4300-925b-7e386467d248 req-c9754309-cf20-4aa3-b80d-467e5a16d986 service nova] Releasing lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:13:01 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Snapshot image upload complete
Oct 20 02:13:01 user nova-compute[74242]: DEBUG nova.compute.manager [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:13:01 user nova-compute[74242]: INFO nova.compute.manager [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Shelve offloading
Oct 20 02:13:01 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Instance destroyed successfully.
Oct 20 02:13:01 user nova-compute[74242]: DEBUG nova.compute.manager [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:13:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:13:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquired lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:13:01 user nova-compute[74242]: DEBUG nova.network.neutron [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:13:01 user nova-compute[74242]: DEBUG nova.network.neutron [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Updating instance_info_cache with network_info: [{"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:13:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Releasing lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:13:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Instance destroyed successfully.
Oct 20 02:13:02 user nova-compute[74242]: DEBUG nova.objects.instance [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'resources' on Instance uuid d1559836-bd5f-402d-b7b2-1ea2e613b362 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1898730605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1898730605',id=21,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL45lC8uP88aLhPjVpFusc36EgxSMjXZFMi7kNkF3ISmf58aNyLJGlf6kN9rY1GLxONqaKngDD8N296JSE/ycrNLnxQHHeJNFHkBaGooBjeCsoqTZFQ43Lc0w8v+CVTfKQ==',key_name='tempest-keypair-1736999254',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:11:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a7a2695b5ad341e0afd133522f680bf9',ramdisk_id='',reservation_id='r-t0tvfa99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-750275147',owner_user_name='tempest-AttachVolumeShelveTestJSON-750275147-project-member',shelved_at='2023-10-20T02:13:01.233420',shelved_host='user',shelved_image_id='81c0076d-28e1-48d7-b100-4e4d1af67964'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:12:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d6645596e24f24a216d2b4e7809073',uuid=d1559836-bd5f-402d-b7b2-1ea2e613b362,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converting VIF {"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=75c2194c-b6fc-4b52-8643-2137bd1d1235,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c2194c-b6') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG os_vif [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=75c2194c-b6fc-4b52-8643-2137bd1d1235,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c2194c-b6') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75c2194c-b6, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=984c1836-b968-4d23-a8ab-aeed83e551e8) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-2a7e27b5-332d-4626-9a4a-6663c410b037 req-68fb1a4f-57b5-4a00-95c6-837086de650f service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received event network-changed-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-2a7e27b5-332d-4626-9a4a-6663c410b037 req-68fb1a4f-57b5-4a00-95c6-837086de650f service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Refreshing instance network info cache due to event network-changed-75c2194c-b6fc-4b52-8643-2137bd1d1235. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2a7e27b5-332d-4626-9a4a-6663c410b037 req-68fb1a4f-57b5-4a00-95c6-837086de650f service nova] Acquiring lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2a7e27b5-332d-4626-9a4a-6663c410b037 req-68fb1a4f-57b5-4a00-95c6-837086de650f service nova] Acquired lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG nova.network.neutron [req-2a7e27b5-332d-4626-9a4a-6663c410b037 req-68fb1a4f-57b5-4a00-95c6-837086de650f service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Refreshing network info cache for port 75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:13:02 user nova-compute[74242]: INFO os_vif [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=75c2194c-b6fc-4b52-8643-2137bd1d1235,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c2194c-b6')
Oct 20 02:13:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Deleting instance files /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362_del
Oct 20 02:13:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Deletion of /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362_del complete
Oct 20 02:13:02 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Deleted allocations for instance d1559836-bd5f-402d-b7b2-1ea2e613b362
Oct 20 02:13:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG nova.objects.instance [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'numa_topology' on Instance uuid d1559836-bd5f-402d-b7b2-1ea2e613b362 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:13:02 user nova-compute[74242]: DEBUG nova.objects.base [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Object Instance<d1559836-bd5f-402d-b7b2-1ea2e613b362> lazy-loaded attributes: resources,numa_topology {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:13:03 user nova-compute[74242]: DEBUG nova.network.neutron [req-2a7e27b5-332d-4626-9a4a-6663c410b037 req-68fb1a4f-57b5-4a00-95c6-837086de650f service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Updated VIF entry in instance network info cache for port 75c2194c-b6fc-4b52-8643-2137bd1d1235. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:13:03 user nova-compute[74242]: DEBUG nova.network.neutron [req-2a7e27b5-332d-4626-9a4a-6663c410b037 req-68fb1a4f-57b5-4a00-95c6-837086de650f service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Updating instance_info_cache with network_info: [{"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap75c2194c-b6", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:13:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2a7e27b5-332d-4626-9a4a-6663c410b037 req-68fb1a4f-57b5-4a00-95c6-837086de650f service nova] Releasing lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:13:03 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:13:03 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:13:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.402s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5dafe0aa-c79c-4369-afdf-2c206823c76d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.072s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:07 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 72003d17-9292-4bdd-acfc-0d3f7e40df80 is timed out.
Oct 20 02:13:07 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Successfully detached device vdb from instance 72003d17-9292-4bdd-acfc-0d3f7e40df80 from the live domain config.
Oct 20 02:13:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oGQhFZIU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc', 'volume_id': 'a57d408c-853f-4859-bbe9-7608dc3157cb'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:13:07 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:13:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dde65be-540a-4649-8be6-0ac8b5dd8383]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:13:07 user nova-compute[74242]: No targets found.
Oct 20 02:13:07 user nova-compute[74242]: iSNS:
Oct 20 02:13:07 user nova-compute[74242]: No targets found.
Oct 20 02:13:07 user nova-compute[74242]: STATIC:
Oct 20 02:13:07 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4
Oct 20 02:13:07 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:13:07 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:13:07 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb
Oct 20 02:13:07 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:13:07 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:13:07 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566
Oct 20 02:13:07 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:13:07 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:13:07 user nova-compute[74242]: FIRMWARE:
Oct 20 02:13:07 user nova-compute[74242]: No targets found.
Oct 20 02:13:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:13:07 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:13:07 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d490c623-c47c-4f28-82f4-1070d32e560a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bd9a5c-b8f8-44c6-a035-6a7532bded54]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:13:07 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:13:07 user nova-compute[74242]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:13:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:13:07 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:13:07 user nova-compute[74242]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb (non-flash)
Oct 20 02:13:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d81829e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb'): ({'sdc'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Removing single pathed devices sdc {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cddb7e8-2f59-4c4a-81f5-3b53c8cd3144]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba250844-5878-46c4-bf3a-f0be2643db81]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Flushing IO for device /dev/sdc {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2698fab0-4b57-4c15-848a-63e7fb3b627c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:13:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[34dcaf92-2c2c-44a5-b659-691edda10bd4]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef40c419-f4bb-4925-9228-f478b3c70dee]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8baa21-80d9-4231-81dc-eea3f42144b6]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260]
Oct 20 02:13:08 user nova-compute[74242]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb, portal: 172.16.0.220,3260] successful.
Oct 20 02:13:08 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a57d408c-853f-4859-bbe9-7608dc3157cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33517f4-ef22-4824-98d4-50b4e33342da]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] <== disconnect_volume: return (300ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG os_brick.utils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d418cf55-9b8e-446d-bcb3-db064b7a8d52]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6feeb819-abb0-41a2-8bae-012231114d13]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2085b6-5747-4911-b622-70d0dd66dde0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[821caae6-febf-4a60-a087-ce1b1d9f58af]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:13:08 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:13:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[12bda6f8-ab38-41f9-9977-10345860cdb3]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG os_brick.utils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:13:08 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Updating existing volume attachment record: dcf7a1bd-95e0-410b-b71e-a70dbe0ed4ac {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:13:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-bb08dc24-0d6f-4a90-bbbe-820ad5fcb8bc req-1225d329-9d26-44f5-aec1-ac12f6accb63 service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Received event network-changed-a85765e3-167b-4e18-9b8b-f8b4d306a53c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-bb08dc24-0d6f-4a90-bbbe-820ad5fcb8bc req-1225d329-9d26-44f5-aec1-ac12f6accb63 service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Refreshing instance network info cache due to event network-changed-a85765e3-167b-4e18-9b8b-f8b4d306a53c. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:13:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bb08dc24-0d6f-4a90-bbbe-820ad5fcb8bc req-1225d329-9d26-44f5-aec1-ac12f6accb63 service nova] Acquiring lock "refresh_cache-a37dce3b-16e3-4f5f-8412-38291312b306" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:13:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bb08dc24-0d6f-4a90-bbbe-820ad5fcb8bc req-1225d329-9d26-44f5-aec1-ac12f6accb63 service nova] Acquired lock "refresh_cache-a37dce3b-16e3-4f5f-8412-38291312b306" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:13:16 user nova-compute[74242]: DEBUG nova.network.neutron [req-bb08dc24-0d6f-4a90-bbbe-820ad5fcb8bc req-1225d329-9d26-44f5-aec1-ac12f6accb63 service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Refreshing network info cache for port a85765e3-167b-4e18-9b8b-f8b4d306a53c {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:13:16 user nova-compute[74242]: DEBUG nova.network.neutron [req-bb08dc24-0d6f-4a90-bbbe-820ad5fcb8bc req-1225d329-9d26-44f5-aec1-ac12f6accb63 service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Updated VIF entry in instance network info cache for port a85765e3-167b-4e18-9b8b-f8b4d306a53c. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:13:16 user nova-compute[74242]: DEBUG nova.network.neutron [req-bb08dc24-0d6f-4a90-bbbe-820ad5fcb8bc req-1225d329-9d26-44f5-aec1-ac12f6accb63 service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Updating instance_info_cache with network_info: [{"id": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "address": "fa:16:3e:30:f8:54", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.56", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85765e3-16", "ovs_interfaceid": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:13:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bb08dc24-0d6f-4a90-bbbe-820ad5fcb8bc req-1225d329-9d26-44f5-aec1-ac12f6accb63 service nova] Releasing lock "refresh_cache-a37dce3b-16e3-4f5f-8412-38291312b306" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:13:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "a37dce3b-16e3-4f5f-8412-38291312b306" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "a37dce3b-16e3-4f5f-8412-38291312b306" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "a37dce3b-16e3-4f5f-8412-38291312b306-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "a37dce3b-16e3-4f5f-8412-38291312b306-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "a37dce3b-16e3-4f5f-8412-38291312b306-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:16 user nova-compute[74242]: INFO nova.compute.manager [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Terminating instance
Oct 20 02:13:16 user nova-compute[74242]: DEBUG nova.compute.manager [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:13:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:17 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Instance destroyed successfully.
Oct 20 02:13:17 user nova-compute[74242]: DEBUG nova.objects.instance [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lazy-loading 'resources' on Instance uuid a37dce3b-16e3-4f5f-8412-38291312b306 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:11:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1902207886',display_name='tempest-AttachVolumeNegativeTest-server-1902207886',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1902207886',id=23,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLAQuzOuS3iEAG2ZrDio3Ny7e5nL47yYcPp4Vw8UXeHnuD/zwmZ/y2angwYuFOTXL2SOyAffRtfDAq/Bf6Kk4ZyZintope131hW7Nr3PJfRQErdk82SiZtTQTkGFhMX3Mg==',key_name='tempest-keypair-2092172209',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:11:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e74cc27f49384dc78190bd5d9ed7fab9',ramdisk_id='',reservation_id='r-5iao1ljh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1292543897',owner_user_name='tempest-AttachVolumeNegativeTest-1292543897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:11:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3069dcf63864aa08f632601c3a849c5',uuid=a37dce3b-16e3-4f5f-8412-38291312b306,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "address": "fa:16:3e:30:f8:54", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85765e3-16", "ovs_interfaceid": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converting VIF {"id": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "address": "fa:16:3e:30:f8:54", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa85765e3-16", "ovs_interfaceid": "a85765e3-167b-4e18-9b8b-f8b4d306a53c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:f8:54,bridge_name='br-int',has_traffic_filtering=True,id=a85765e3-167b-4e18-9b8b-f8b4d306a53c,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa85765e3-16') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG os_vif [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:f8:54,bridge_name='br-int',has_traffic_filtering=True,id=a85765e3-167b-4e18-9b8b-f8b4d306a53c,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa85765e3-16') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa85765e3-16, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d3013f2-cfa3-4bb3-9856-5b5500a96a05) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:17 user nova-compute[74242]: INFO os_vif [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:f8:54,bridge_name='br-int',has_traffic_filtering=True,id=a85765e3-167b-4e18-9b8b-f8b4d306a53c,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa85765e3-16')
Oct 20 02:13:17 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Deleting instance files /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306_del
Oct 20 02:13:17 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Deletion of /opt/stack/data/nova/instances/a37dce3b-16e3-4f5f-8412-38291312b306_del complete
Oct 20 02:13:17 user nova-compute[74242]: INFO nova.compute.manager [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Took 0.75 seconds to destroy the instance on the hypervisor.
Oct 20 02:13:17 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:13:17 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:13:18 user nova-compute[74242]: DEBUG nova.compute.manager [req-310cf129-6d7d-4398-be00-5b1ca4a9dc4e req-5dbdd1f5-7949-4d35-878c-b0223572357c service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Received event network-vif-unplugged-a85765e3-167b-4e18-9b8b-f8b4d306a53c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-310cf129-6d7d-4398-be00-5b1ca4a9dc4e req-5dbdd1f5-7949-4d35-878c-b0223572357c service nova] Acquiring lock "a37dce3b-16e3-4f5f-8412-38291312b306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-310cf129-6d7d-4398-be00-5b1ca4a9dc4e req-5dbdd1f5-7949-4d35-878c-b0223572357c service nova] Lock "a37dce3b-16e3-4f5f-8412-38291312b306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-310cf129-6d7d-4398-be00-5b1ca4a9dc4e req-5dbdd1f5-7949-4d35-878c-b0223572357c service nova] Lock "a37dce3b-16e3-4f5f-8412-38291312b306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:18 user nova-compute[74242]: DEBUG nova.compute.manager [req-310cf129-6d7d-4398-be00-5b1ca4a9dc4e req-5dbdd1f5-7949-4d35-878c-b0223572357c service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] No waiting events found dispatching network-vif-unplugged-a85765e3-167b-4e18-9b8b-f8b4d306a53c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:13:18 user nova-compute[74242]: DEBUG nova.compute.manager [req-310cf129-6d7d-4398-be00-5b1ca4a9dc4e req-5dbdd1f5-7949-4d35-878c-b0223572357c service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Received event network-vif-unplugged-a85765e3-167b-4e18-9b8b-f8b4d306a53c for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:13:18 user nova-compute[74242]: DEBUG nova.compute.manager [req-310cf129-6d7d-4398-be00-5b1ca4a9dc4e req-5dbdd1f5-7949-4d35-878c-b0223572357c service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Received event network-vif-plugged-a85765e3-167b-4e18-9b8b-f8b4d306a53c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-310cf129-6d7d-4398-be00-5b1ca4a9dc4e req-5dbdd1f5-7949-4d35-878c-b0223572357c service nova] Acquiring lock "a37dce3b-16e3-4f5f-8412-38291312b306-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-310cf129-6d7d-4398-be00-5b1ca4a9dc4e req-5dbdd1f5-7949-4d35-878c-b0223572357c service nova] Lock "a37dce3b-16e3-4f5f-8412-38291312b306-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-310cf129-6d7d-4398-be00-5b1ca4a9dc4e req-5dbdd1f5-7949-4d35-878c-b0223572357c service nova] Lock "a37dce3b-16e3-4f5f-8412-38291312b306-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:18 user nova-compute[74242]: DEBUG nova.compute.manager [req-310cf129-6d7d-4398-be00-5b1ca4a9dc4e req-5dbdd1f5-7949-4d35-878c-b0223572357c service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] No waiting events found dispatching network-vif-plugged-a85765e3-167b-4e18-9b8b-f8b4d306a53c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:13:18 user nova-compute[74242]: WARNING nova.compute.manager [req-310cf129-6d7d-4398-be00-5b1ca4a9dc4e req-5dbdd1f5-7949-4d35-878c-b0223572357c service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Received unexpected event network-vif-plugged-a85765e3-167b-4e18-9b8b-f8b4d306a53c for instance with vm_state active and task_state deleting.
Oct 20 02:13:18 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:13:18 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Took 1.20 seconds to deallocate network for instance.
Oct 20 02:13:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:19 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:13:19 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:13:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.489s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:19 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Deleted allocations for instance a37dce3b-16e3-4f5f-8412-38291312b306
Oct 20 02:13:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4cdec9f2-f02a-4f79-9538-f319647efa98 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "a37dce3b-16e3-4f5f-8412-38291312b306" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.739s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:20 user nova-compute[74242]: DEBUG nova.compute.manager [req-44445f5e-d782-4c26-85e7-be8d5f7c79e1 req-45148655-9176-4c9a-9dcc-76865913ff32 service nova] [instance: a37dce3b-16e3-4f5f-8412-38291312b306] Received event network-vif-deleted-a85765e3-167b-4e18-9b8b-f8b4d306a53c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "20b69222-b73f-4a7d-9807-d476439e1e2a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "20b69222-b73f-4a7d-9807-d476439e1e2a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "20b69222-b73f-4a7d-9807-d476439e1e2a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "20b69222-b73f-4a7d-9807-d476439e1e2a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "20b69222-b73f-4a7d-9807-d476439e1e2a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:24 user nova-compute[74242]: INFO nova.compute.manager [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Terminating instance
Oct 20 02:13:24 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:13:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-522bfb77-9361-4bc3-a10e-e9253383f709 req-69c74287-56fc-425c-8fcc-2b67e7e61dc9 service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Received event network-vif-unplugged-fcdb6d5c-aa2b-4505-8c78-599dc419e982 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-522bfb77-9361-4bc3-a10e-e9253383f709 req-69c74287-56fc-425c-8fcc-2b67e7e61dc9 service nova] Acquiring lock "20b69222-b73f-4a7d-9807-d476439e1e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-522bfb77-9361-4bc3-a10e-e9253383f709 req-69c74287-56fc-425c-8fcc-2b67e7e61dc9 service nova] Lock "20b69222-b73f-4a7d-9807-d476439e1e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-522bfb77-9361-4bc3-a10e-e9253383f709 req-69c74287-56fc-425c-8fcc-2b67e7e61dc9 service nova] Lock "20b69222-b73f-4a7d-9807-d476439e1e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-522bfb77-9361-4bc3-a10e-e9253383f709 req-69c74287-56fc-425c-8fcc-2b67e7e61dc9 service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] No waiting events found dispatching network-vif-unplugged-fcdb6d5c-aa2b-4505-8c78-599dc419e982 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:13:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-522bfb77-9361-4bc3-a10e-e9253383f709 req-69c74287-56fc-425c-8fcc-2b67e7e61dc9 service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Received event network-vif-unplugged-fcdb6d5c-aa2b-4505-8c78-599dc419e982 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:13:25 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Instance destroyed successfully.
Oct 20 02:13:25 user nova-compute[74242]: DEBUG nova.objects.instance [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lazy-loading 'resources' on Instance uuid 20b69222-b73f-4a7d-9807-d476439e1e2a {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:11:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1065833772',display_name='tempest-VolumesAdminNegativeTest-server-1065833772',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1065833772',id=22,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:11:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3c5bff2faf14b7887d0fa959c6e91ab',ramdisk_id='',reservation_id='r-tfg0u3g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1678070801',owner_user_name='tempest-VolumesAdminNegativeTest-1678070801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:11:12Z,user_data=None,user_id='5770dbda6dd84c99ada813b97a477f8a',uuid=20b69222-b73f-4a7d-9807-d476439e1e2a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "address": "fa:16:3e:0a:26:13", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcdb6d5c-aa", "ovs_interfaceid": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Converting VIF {"id": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "address": "fa:16:3e:0a:26:13", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfcdb6d5c-aa", "ovs_interfaceid": "fcdb6d5c-aa2b-4505-8c78-599dc419e982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0a:26:13,bridge_name='br-int',has_traffic_filtering=True,id=fcdb6d5c-aa2b-4505-8c78-599dc419e982,network=Network(a476089f-e2c5-41a8-8c01-0bfd9c9e280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcdb6d5c-aa') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG os_vif [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:26:13,bridge_name='br-int',has_traffic_filtering=True,id=fcdb6d5c-aa2b-4505-8c78-599dc419e982,network=Network(a476089f-e2c5-41a8-8c01-0bfd9c9e280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcdb6d5c-aa') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfcdb6d5c-aa, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e4ade93a-3197-44fd-acfc-8791508ff6b3) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:13:25 user nova-compute[74242]: INFO os_vif [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0a:26:13,bridge_name='br-int',has_traffic_filtering=True,id=fcdb6d5c-aa2b-4505-8c78-599dc419e982,network=Network(a476089f-e2c5-41a8-8c01-0bfd9c9e280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfcdb6d5c-aa')
Oct 20 02:13:25 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Deleting instance files /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a_del
Oct 20 02:13:25 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Deletion of /opt/stack/data/nova/instances/20b69222-b73f-4a7d-9807-d476439e1e2a_del complete
Oct 20 02:13:25 user nova-compute[74242]: INFO nova.compute.manager [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 20 02:13:25 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:13:25 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Took 0.56 seconds to deallocate network for instance.
Oct 20 02:13:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:26 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:13:26 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:13:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:26 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Deleted allocations for instance 20b69222-b73f-4a7d-9807-d476439e1e2a
Oct 20 02:13:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b180c029-5bd2-49b2-8081-ac9cb5da23cc tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "20b69222-b73f-4a7d-9807-d476439e1e2a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.094s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-5675fc83-5536-4699-9b49-85d1931eb97f req-8cca085b-3d10-40e3-880f-9de4124fd397 service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Received event network-vif-plugged-fcdb6d5c-aa2b-4505-8c78-599dc419e982 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5675fc83-5536-4699-9b49-85d1931eb97f req-8cca085b-3d10-40e3-880f-9de4124fd397 service nova] Acquiring lock "20b69222-b73f-4a7d-9807-d476439e1e2a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5675fc83-5536-4699-9b49-85d1931eb97f req-8cca085b-3d10-40e3-880f-9de4124fd397 service nova] Lock "20b69222-b73f-4a7d-9807-d476439e1e2a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5675fc83-5536-4699-9b49-85d1931eb97f req-8cca085b-3d10-40e3-880f-9de4124fd397 service nova] Lock "20b69222-b73f-4a7d-9807-d476439e1e2a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-5675fc83-5536-4699-9b49-85d1931eb97f req-8cca085b-3d10-40e3-880f-9de4124fd397 service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] No waiting events found dispatching network-vif-plugged-fcdb6d5c-aa2b-4505-8c78-599dc419e982 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:13:26 user nova-compute[74242]: WARNING nova.compute.manager [req-5675fc83-5536-4699-9b49-85d1931eb97f req-8cca085b-3d10-40e3-880f-9de4124fd397 service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Received unexpected event network-vif-plugged-fcdb6d5c-aa2b-4505-8c78-599dc419e982 for instance with vm_state deleted and task_state None.
Oct 20 02:13:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-5675fc83-5536-4699-9b49-85d1931eb97f req-8cca085b-3d10-40e3-880f-9de4124fd397 service nova] [instance: 20b69222-b73f-4a7d-9807-d476439e1e2a] Received event network-vif-deleted-fcdb6d5c-aa2b-4505-8c78-599dc419e982 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:27 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.compute.manager [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:13:28 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Creating image(s)
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Ensure instance console log exists: /opt/stack/data/nova/instances/c98e383a-e1e5-4130-9cc6-a9823db0b88c/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Start _get_guest_xml network_info=[{"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'dcf7a1bd-95e0-410b-b71e-a70dbe0ed4ac', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klugFvEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c98e383a-e1e5-4130-9cc6-a9823db0b88c', 'attached_at': '', 'detached_at': '', 'volume_id': '8236db11-4fd2-495a-b6ca-e0801bc01d26', 'serial': '8236db11-4fd2-495a-b6ca-e0801bc01d26'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:13:28 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:13:28 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klugFvEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:13:28 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:13:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:13:28 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:13:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:13:28 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:13:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ee33d4-6997-48f9-b1c0-4d31ca6b27a4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:13:28 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a424c3a-6782-4743-b240-6e8dc943e285]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26] added
Oct 20 02:13:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed5a24c-91e7-4b4a-957a-c6663f402bd7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:13:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[129892d7-821b-4273-9ee1-f119cb82ac0b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v klugFvEU {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v klugFvEU" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb552f3-2269-4c5e-8745-85196ea89ab4]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'klugFvEU'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[226c084e-c6d9-4129-bc38-d45ad177dafd]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b98ea8-4322-403f-bde3-7f7fc7453a2b]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:13:29 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:13:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:13:29 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:13:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa39b40-71ae-4e7a-944f-98a0d7371178]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26, portal: 172.16.0.220,3260]
Oct 20 02:13:29 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26, portal: 172.16.0.220,3260] successful.
Oct 20 02:13:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[58826e5e-3343-45ee-af46-0d96c9d236b7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a3fc46-5b77-48e6-8295-1c0599351622]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:13:29 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:13:29 user nova-compute[74242]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:13:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:13:29 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:13:29 user nova-compute[74242]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:13:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] HCTL ('34', '-', '-', 0) found on session 26 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f756629b-6f7b-4065-98cf-fc6dfa79f042]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching for a device in session 26 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klugFvEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] There are 0 instances to clean {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "07377280-e3f5-4edd-9501-678dcde42ef3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "07377280-e3f5-4edd-9501-678dcde42ef3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "07377280-e3f5-4edd-9501-678dcde42ef3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "07377280-e3f5-4edd-9501-678dcde42ef3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "07377280-e3f5-4edd-9501-678dcde42ef3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:29 user nova-compute[74242]: INFO nova.compute.manager [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Terminating instance
Oct 20 02:13:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-d710cc3b-8d18-4082-b732-6039401a6306 req-9ef1bbb1-755b-4d32-bc24-05622a9395b1 service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Received event network-vif-unplugged-350f4931-f460-4a25-a6b4-dd924304f1fa {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d710cc3b-8d18-4082-b732-6039401a6306 req-9ef1bbb1-755b-4d32-bc24-05622a9395b1 service nova] Acquiring lock "07377280-e3f5-4edd-9501-678dcde42ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d710cc3b-8d18-4082-b732-6039401a6306 req-9ef1bbb1-755b-4d32-bc24-05622a9395b1 service nova] Lock "07377280-e3f5-4edd-9501-678dcde42ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d710cc3b-8d18-4082-b732-6039401a6306 req-9ef1bbb1-755b-4d32-bc24-05622a9395b1 service nova] Lock "07377280-e3f5-4edd-9501-678dcde42ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-d710cc3b-8d18-4082-b732-6039401a6306 req-9ef1bbb1-755b-4d32-bc24-05622a9395b1 service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] No waiting events found dispatching network-vif-unplugged-350f4931-f460-4a25-a6b4-dd924304f1fa {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-d710cc3b-8d18-4082-b732-6039401a6306 req-9ef1bbb1-755b-4d32-bc24-05622a9395b1 service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Received event network-vif-unplugged-350f4931-f460-4a25-a6b4-dd924304f1fa for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:13:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23132643264333239', 'path': '/dev/sdc'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132643264333239', 'path': '/dev/sdc'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1676419618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1676419618',id=24,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112fda62d355421e80e674dc18bb5069',ramdisk_id='',reservation_id='r-zquvak2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:12:58Z,user_data=None,user_id='9ac628a224fb4653932a27e33aa33c9d',uuid=c98e383a-e1e5-4130-9cc6-a9823db0b88c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converting VIF {"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:6c:1f,bridge_name='br-int',has_traffic_filtering=True,id=989425d9-6ff3-4460-9b24-aede590c961c,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989425d9-6f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.objects.instance [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'pci_devices' on Instance uuid c98e383a-e1e5-4130-9cc6-a9823db0b88c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:13:30 user nova-compute[74242]:   <uuid>c98e383a-e1e5-4130-9cc6-a9823db0b88c</uuid>
Oct 20 02:13:30 user nova-compute[74242]:   <name>instance-00000018</name>
Oct 20 02:13:30 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:13:30 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:13:30 user nova-compute[74242]:   <metadata>
Oct 20 02:13:30 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:13:30 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:13:30 user nova-compute[74242]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1676419618</nova:name>
Oct 20 02:13:30 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:13:28</nova:creationTime>
Oct 20 02:13:30 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:13:30 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:13:30 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:13:30 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:13:30 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:13:30 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:13:30 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:13:30 user nova-compute[74242]:       <nova:owner>
Oct 20 02:13:30 user nova-compute[74242]:         <nova:user uuid="9ac628a224fb4653932a27e33aa33c9d">tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member</nova:user>
Oct 20 02:13:30 user nova-compute[74242]:         <nova:project uuid="112fda62d355421e80e674dc18bb5069">tempest-ServerBootFromVolumeStableRescueTest-1661425956</nova:project>
Oct 20 02:13:30 user nova-compute[74242]:       </nova:owner>
Oct 20 02:13:30 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:13:30 user nova-compute[74242]:       <nova:ports>
Oct 20 02:13:30 user nova-compute[74242]:         <nova:port uuid="989425d9-6ff3-4460-9b24-aede590c961c">
Oct 20 02:13:30 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 02:13:30 user nova-compute[74242]:         </nova:port>
Oct 20 02:13:30 user nova-compute[74242]:       </nova:ports>
Oct 20 02:13:30 user nova-compute[74242]:     </nova:instance>
Oct 20 02:13:30 user nova-compute[74242]:   </metadata>
Oct 20 02:13:30 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:13:30 user nova-compute[74242]:     <system>
Oct 20 02:13:30 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:13:30 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:13:30 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:13:30 user nova-compute[74242]:       <entry name="serial">c98e383a-e1e5-4130-9cc6-a9823db0b88c</entry>
Oct 20 02:13:30 user nova-compute[74242]:       <entry name="uuid">c98e383a-e1e5-4130-9cc6-a9823db0b88c</entry>
Oct 20 02:13:30 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:13:30 user nova-compute[74242]:     </system>
Oct 20 02:13:30 user nova-compute[74242]:   </sysinfo>
Oct 20 02:13:30 user nova-compute[74242]:   <os>
Oct 20 02:13:30 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:13:30 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:13:30 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:13:30 user nova-compute[74242]:   </os>
Oct 20 02:13:30 user nova-compute[74242]:   <features>
Oct 20 02:13:30 user nova-compute[74242]:     <acpi/>
Oct 20 02:13:30 user nova-compute[74242]:     <apic/>
Oct 20 02:13:30 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:13:30 user nova-compute[74242]:   </features>
Oct 20 02:13:30 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:13:30 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:13:30 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:13:30 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:13:30 user nova-compute[74242]:   </clock>
Oct 20 02:13:30 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:13:30 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:13:30 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:13:30 user nova-compute[74242]:   </cpu>
Oct 20 02:13:30 user nova-compute[74242]:   <devices>
Oct 20 02:13:30 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:13:30 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:13:30 user nova-compute[74242]:       <source dev="/dev/sdc"/>
Oct 20 02:13:30 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:13:30 user nova-compute[74242]:       <serial>8236db11-4fd2-495a-b6ca-e0801bc01d26</serial>
Oct 20 02:13:30 user nova-compute[74242]:     </disk>
Oct 20 02:13:30 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:13:30 user nova-compute[74242]:       <mac address="fa:16:3e:b6:6c:1f"/>
Oct 20 02:13:30 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:13:30 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:13:30 user nova-compute[74242]:       <target dev="tap989425d9-6f"/>
Oct 20 02:13:30 user nova-compute[74242]:     </interface>
Oct 20 02:13:30 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:13:30 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/c98e383a-e1e5-4130-9cc6-a9823db0b88c/console.log" append="off"/>
Oct 20 02:13:30 user nova-compute[74242]:     </serial>
Oct 20 02:13:30 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:13:30 user nova-compute[74242]:     <video>
Oct 20 02:13:30 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:13:30 user nova-compute[74242]:     </video>
Oct 20 02:13:30 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:13:30 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:13:30 user nova-compute[74242]:     </rng>
Oct 20 02:13:30 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:13:30 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:13:30 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:13:30 user nova-compute[74242]:     </memballoon>
Oct 20 02:13:30 user nova-compute[74242]:   </devices>
Oct 20 02:13:30 user nova-compute[74242]: </domain>
Oct 20 02:13:30 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1676419618',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1676419618',id=24,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112fda62d355421e80e674dc18bb5069',ramdisk_id='',reservation_id='r-zquvak2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:12:58Z,user_data=None,user_id='9ac628a224fb4653932a27e33aa33c9d',uuid=c98e383a-e1e5-4130-9cc6-a9823db0b88c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converting VIF {"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b6:6c:1f,bridge_name='br-int',has_traffic_filtering=True,id=989425d9-6ff3-4460-9b24-aede590c961c,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989425d9-6f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_vif [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:6c:1f,bridge_name='br-int',has_traffic_filtering=True,id=989425d9-6ff3-4460-9b24-aede590c961c,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989425d9-6f') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '44cf5988-3707-59c2-908f-ba2c9aaf0dd8', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap989425d9-6f, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap989425d9-6f, col_values=(('qos', UUID('2d260291-291d-4b12-9c99-8ca8da2d0e34')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap989425d9-6f, col_values=(('external_ids', {'iface-id': '989425d9-6ff3-4460-9b24-aede590c961c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b6:6c:1f', 'vm-uuid': 'c98e383a-e1e5-4130-9cc6-a9823db0b88c'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: INFO os_vif [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b6:6c:1f,bridge_name='br-int',has_traffic_filtering=True,id=989425d9-6ff3-4460-9b24-aede590c961c,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989425d9-6f')
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Instance destroyed successfully.
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.objects.instance [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lazy-loading 'resources' on Instance uuid 07377280-e3f5-4edd-9501-678dcde42ef3 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:08:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-634314520',display_name='tempest-TestVolumeBootPattern-volume-backed-server-634314520',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-634314520',id=17,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHOefACBNESIhBRfSc7v2UAdeZB/MUSdCyw436HH1ifDOPynC/IoShbLLSPIKB0UaN+tUuO6lVl0IuEPAeoFrxYCSiHp843fLX1kqum07o6bC6HrKCMhnTJ2YcC4nvEDEQ==',key_name='tempest-keypair-1754181026',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:08:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-qfxq3s8k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:08:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=07377280-e3f5-4edd-9501-678dcde42ef3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "350f4931-f460-4a25-a6b4-dd924304f1fa", "address": "fa:16:3e:4f:12:07", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f4931-f4", "ovs_interfaceid": "350f4931-f460-4a25-a6b4-dd924304f1fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "350f4931-f460-4a25-a6b4-dd924304f1fa", "address": "fa:16:3e:4f:12:07", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.36", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap350f4931-f4", "ovs_interfaceid": "350f4931-f460-4a25-a6b4-dd924304f1fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:12:07,bridge_name='br-int',has_traffic_filtering=True,id=350f4931-f460-4a25-a6b4-dd924304f1fa,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350f4931-f4') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_vif [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:12:07,bridge_name='br-int',has_traffic_filtering=True,id=350f4931-f460-4a25-a6b4-dd924304f1fa,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350f4931-f4') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] No VIF found with MAC fa:16:3e:b6:6c:1f, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap350f4931-f4, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5036ba7f-a4a5-41ca-8f52-7d168ee705b7) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:30 user nova-compute[74242]: INFO os_vif [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:12:07,bridge_name='br-int',has_traffic_filtering=True,id=350f4931-f460-4a25-a6b4-dd924304f1fa,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap350f4931-f4')
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZdPNHECz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:13:30 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2659cc4b-d933-4849-a3be-7bdf494d4b65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:13:30 user nova-compute[74242]: No targets found.
Oct 20 02:13:30 user nova-compute[74242]: iSNS:
Oct 20 02:13:30 user nova-compute[74242]: No targets found.
Oct 20 02:13:30 user nova-compute[74242]: STATIC:
Oct 20 02:13:30 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4
Oct 20 02:13:30 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:13:30 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:13:30 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566
Oct 20 02:13:30 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:13:30 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:13:30 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:13:30 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:13:30 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:13:30 user nova-compute[74242]: FIRMWARE:
Oct 20 02:13:30 user nova-compute[74242]: No targets found.
Oct 20 02:13:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:13:30 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:13:30 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e41ac67-ea45-453b-bf1c-e9b4605d84fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9884c96-7c6f-4b84-b7bd-fa667e8137d7]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:13:30 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:13:30 user nova-compute[74242]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:13:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 (non-flash)
Oct 20 02:13:30 user nova-compute[74242]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:13:30 user nova-compute[74242]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:13:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d029bbe0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566'): ({'sdb'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Removing single pathed devices sdb {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cb1f4c-a651-4b5f-83d2-8934def7f106]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b365b2-c8ad-496e-a4c1-624ff34273b7]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flushing IO for device /dev/sdb {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf66baa7-b44e-415b-b221-6033d41f92b9]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f44a96-0ac8-4bdb-82c7-eec01594d38e]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_fa8efd5e', '/dev/disk/by-id/scsi-1SCST_BIOfa8efd5e-9065eebd8cbc5065', '/dev/disk/by-id/scsi-23930363565656264') {{(pid=85329) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f8d815-097d-44e3-9957-7ce2e76d293d]: (4, None) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.052s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fc71a4-3196-4da2-b8f4-652f5ea02ec2]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa3bc34-b62e-4e41-b169-d78e43b2542d]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566, portal: 172.16.0.220,3260]
Oct 20 02:13:30 user nova-compute[74242]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566, portal: 172.16.0.220,3260] successful.
Oct 20 02:13:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4e016a8-0b88-4927-b8eb-7b746a8f1566 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f0f2847-863c-4d95-9ab6-ea67d15d847e]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.375s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== disconnect_volume: return (376ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:13:30 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Deleting instance files /opt/stack/data/nova/instances/07377280-e3f5-4edd-9501-678dcde42ef3_del
Oct 20 02:13:30 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Deletion of /opt/stack/data/nova/instances/07377280-e3f5-4edd-9501-678dcde42ef3_del complete
Oct 20 02:13:30 user nova-compute[74242]: INFO nova.compute.manager [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Took 1.33 seconds to destroy the instance on the hypervisor.
Oct 20 02:13:30 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:13:30 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:13:31 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:13:31 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:13:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:13:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-7e101002-a175-40fe-b5ca-04a58610f60d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:13:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-7e101002-a175-40fe-b5ca-04a58610f60d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:13:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:13:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-31cac4bf-3a1c-498e-8b89-699f5623ac58 req-67238233-baad-42a5-b641-79761e8fbc2d service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Received event network-vif-plugged-350f4931-f460-4a25-a6b4-dd924304f1fa {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-31cac4bf-3a1c-498e-8b89-699f5623ac58 req-67238233-baad-42a5-b641-79761e8fbc2d service nova] Acquiring lock "07377280-e3f5-4edd-9501-678dcde42ef3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-31cac4bf-3a1c-498e-8b89-699f5623ac58 req-67238233-baad-42a5-b641-79761e8fbc2d service nova] Lock "07377280-e3f5-4edd-9501-678dcde42ef3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-31cac4bf-3a1c-498e-8b89-699f5623ac58 req-67238233-baad-42a5-b641-79761e8fbc2d service nova] Lock "07377280-e3f5-4edd-9501-678dcde42ef3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-31cac4bf-3a1c-498e-8b89-699f5623ac58 req-67238233-baad-42a5-b641-79761e8fbc2d service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] No waiting events found dispatching network-vif-plugged-350f4931-f460-4a25-a6b4-dd924304f1fa {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:13:32 user nova-compute[74242]: WARNING nova.compute.manager [req-31cac4bf-3a1c-498e-8b89-699f5623ac58 req-67238233-baad-42a5-b641-79761e8fbc2d service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Received unexpected event network-vif-plugged-350f4931-f460-4a25-a6b4-dd924304f1fa for instance with vm_state active and task_state deleting.
Oct 20 02:13:32 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:13:32 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Took 1.13 seconds to deallocate network for instance.
Oct 20 02:13:32 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Updating instance_info_cache with network_info: [{"id": "4f154d45-5d20-4df0-bb42-5977772a98c4", "address": "fa:16:3e:72:d7:10", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f154d45-5d", "ovs_interfaceid": "4f154d45-5d20-4df0-bb42-5977772a98c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-7e101002-a175-40fe-b5ca-04a58610f60d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-aeb7513e-fad6-403c-9f2b-9be77abae470 req-c8c0104a-ef19-490b-a626-519c5d3089d2 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-aeb7513e-fad6-403c-9f2b-9be77abae470 req-c8c0104a-ef19-490b-a626-519c5d3089d2 service nova] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-aeb7513e-fad6-403c-9f2b-9be77abae470 req-c8c0104a-ef19-490b-a626-519c5d3089d2 service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-aeb7513e-fad6-403c-9f2b-9be77abae470 req-c8c0104a-ef19-490b-a626-519c5d3089d2 service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-aeb7513e-fad6-403c-9f2b-9be77abae470 req-c8c0104a-ef19-490b-a626-519c5d3089d2 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] No waiting events found dispatching network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:13:32 user nova-compute[74242]: WARNING nova.compute.manager [req-aeb7513e-fad6-403c-9f2b-9be77abae470 req-c8c0104a-ef19-490b-a626-519c5d3089d2 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received unexpected event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c for instance with vm_state building and task_state spawning.
Oct 20 02:13:32 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG nova.objects.instance [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lazy-loading 'flavor' on Instance uuid 72003d17-9292-4bdd-acfc-0d3f7e40df80 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:13:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3f3a50b0-639a-4b25-bf1f-4d0f7cb016fe tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 45.640s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:33 user nova-compute[74242]: INFO nova.compute.manager [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Took 1.32 seconds to detach 1 volumes for instance.
Oct 20 02:13:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Deleting volume: d4e016a8-0b88-4927-b8eb-7b746a8f1566 {{(pid=74242) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 02:13:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:33 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Refreshing inventories for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 02:13:33 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Updating ProviderTree inventory for provider 07b40460-b6ac-48c1-8447-e1778d50b26e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 02:13:33 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Updating inventory in ProviderTree for provider 07b40460-b6ac-48c1-8447-e1778d50b26e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 02:13:33 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Refreshing aggregate associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, aggregates: None {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 02:13:33 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Refreshing trait associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-ac7bc7f7-5cc3-4779-9bee-0b3a54e86291 req-ac5ca171-8cd9-4e5e-a92b-1bb2c6e56a15 service nova] [instance: 07377280-e3f5-4edd-9501-678dcde42ef3] Received event network-vif-deleted-350f4931-f460-4a25-a6b4-dd924304f1fa {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:13:34 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Instance spawned successfully.
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.720s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-8034cdf4-bd4b-4562-ae76-ad16e6c6e021 req-01f95076-3cb8-4e86-afdf-709967280dd9 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8034cdf4-bd4b-4562-ae76-ad16e6c6e021 req-01f95076-3cb8-4e86-afdf-709967280dd9 service nova] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8034cdf4-bd4b-4562-ae76-ad16e6c6e021 req-01f95076-3cb8-4e86-afdf-709967280dd9 service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8034cdf4-bd4b-4562-ae76-ad16e6c6e021 req-01f95076-3cb8-4e86-afdf-709967280dd9 service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-8034cdf4-bd4b-4562-ae76-ad16e6c6e021 req-01f95076-3cb8-4e86-afdf-709967280dd9 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] No waiting events found dispatching network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:13:34 user nova-compute[74242]: WARNING nova.compute.manager [req-8034cdf4-bd4b-4562-ae76-ad16e6c6e021 req-01f95076-3cb8-4e86-afdf-709967280dd9 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received unexpected event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c for instance with vm_state building and task_state spawning.
Oct 20 02:13:34 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Deleted allocations for instance 07377280-e3f5-4edd-9501-678dcde42ef3
Oct 20 02:13:34 user nova-compute[74242]: INFO nova.compute.manager [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Took 5.57 seconds to spawn the instance on the hypervisor.
Oct 20 02:13:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-97b0320a-e881-47c9-8a0e-3c26a8542d98 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "07377280-e3f5-4edd-9501-678dcde42ef3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.837s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:34 user nova-compute[74242]: INFO nova.compute.manager [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Took 37.84 seconds to build instance.
Oct 20 02:13:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ad492d3a-550a-4575-982d-bd6eaaf2f895 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.980s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:35 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:13:35 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:13:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:35 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:13:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdj (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:13:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:13:37 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:13:37 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:13:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8165MB free_disk=25.243515014648438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:13:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquiring lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquiring lock "72003d17-9292-4bdd-acfc-0d3f7e40df80-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:37 user nova-compute[74242]: INFO nova.compute.manager [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Terminating instance
Oct 20 02:13:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7e101002-a175-40fe-b5ca-04a58610f60d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 72003d17-9292-4bdd-acfc-0d3f7e40df80 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 9701b02d-0874-45f9-a599-8c1809f234c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c98e383a-e1e5-4130-9cc6-a9823db0b88c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-b82185de-4d90-47a4-9fc2-c6d54296b030 req-0b15efb3-c8be-4675-972d-c305f8efc214 service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Received event network-vif-unplugged-853cfa70-26ff-4bd6-ab16-8f13128cee00 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b82185de-4d90-47a4-9fc2-c6d54296b030 req-0b15efb3-c8be-4675-972d-c305f8efc214 service nova] Acquiring lock "72003d17-9292-4bdd-acfc-0d3f7e40df80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b82185de-4d90-47a4-9fc2-c6d54296b030 req-0b15efb3-c8be-4675-972d-c305f8efc214 service nova] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b82185de-4d90-47a4-9fc2-c6d54296b030 req-0b15efb3-c8be-4675-972d-c305f8efc214 service nova] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-b82185de-4d90-47a4-9fc2-c6d54296b030 req-0b15efb3-c8be-4675-972d-c305f8efc214 service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] No waiting events found dispatching network-vif-unplugged-853cfa70-26ff-4bd6-ab16-8f13128cee00 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-b82185de-4d90-47a4-9fc2-c6d54296b030 req-0b15efb3-c8be-4675-972d-c305f8efc214 service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Received event network-vif-unplugged-853cfa70-26ff-4bd6-ab16-8f13128cee00 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.583s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:38 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Instance destroyed successfully.
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.objects.instance [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lazy-loading 'resources' on Instance uuid 72003d17-9292-4bdd-acfc-0d3f7e40df80 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:07:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1518845441',display_name='tempest-TestVolumeSwap-server-1518845441',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1518845441',id=16,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCRMCcr8pkD89dGCKHlom+trNG9Up+Q4tKzAORb8vXkUcu0CLz8K4FH9IjKehFG/yTFo+9Sy4G3x3LMKzbVZA94aMIdLlj/Hi7GZEKoi6w/NlozMEFcqlPqtx0ugMVyJHg==',key_name='tempest-keypair-1369080920',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:07:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='589aa4f746cf410cba8fd345ed6f830f',ramdisk_id='',reservation_id='r-xo9kaa92',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1722680199',owner_user_name='tempest-TestVolumeSwap-1722680199-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce225357cc264fc98967e471723bd062',uuid=72003d17-9292-4bdd-acfc-0d3f7e40df80,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "address": "fa:16:3e:53:fc:43", "network": {"id": "35a08d69-02ac-4f3a-8a8c-6a8b41c2679a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2043622955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "589aa4f746cf410cba8fd345ed6f830f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853cfa70-26", "ovs_interfaceid": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Converting VIF {"id": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "address": "fa:16:3e:53:fc:43", "network": {"id": "35a08d69-02ac-4f3a-8a8c-6a8b41c2679a", "bridge": "br-int", "label": "tempest-TestVolumeSwap-2043622955-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.198", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "589aa4f746cf410cba8fd345ed6f830f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap853cfa70-26", "ovs_interfaceid": "853cfa70-26ff-4bd6-ab16-8f13128cee00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:53:fc:43,bridge_name='br-int',has_traffic_filtering=True,id=853cfa70-26ff-4bd6-ab16-8f13128cee00,network=Network(35a08d69-02ac-4f3a-8a8c-6a8b41c2679a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853cfa70-26') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG os_vif [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:fc:43,bridge_name='br-int',has_traffic_filtering=True,id=853cfa70-26ff-4bd6-ab16-8f13128cee00,network=Network(35a08d69-02ac-4f3a-8a8c-6a8b41c2679a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853cfa70-26') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap853cfa70-26, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d8e846b6-16f0-4284-89ff-a3bae17605cc) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:38 user nova-compute[74242]: INFO os_vif [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:53:fc:43,bridge_name='br-int',has_traffic_filtering=True,id=853cfa70-26ff-4bd6-ab16-8f13128cee00,network=Network(35a08d69-02ac-4f3a-8a8c-6a8b41c2679a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap853cfa70-26')
Oct 20 02:13:38 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Deleting instance files /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80_del
Oct 20 02:13:38 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Deletion of /opt/stack/data/nova/instances/72003d17-9292-4bdd-acfc-0d3f7e40df80_del complete
Oct 20 02:13:38 user nova-compute[74242]: INFO nova.compute.manager [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 20 02:13:38 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:13:38 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:13:39 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:13:39 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Took 0.79 seconds to deallocate network for instance.
Oct 20 02:13:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-fb537137-221a-497e-958f-8d2525bb9411 req-57f8e332-badf-4257-9f31-b21153b128b5 service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Received event network-vif-deleted-853cfa70-26ff-4bd6-ab16-8f13128cee00 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:39 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:13:39 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:13:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:39 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Deleted allocations for instance 72003d17-9292-4bdd-acfc-0d3f7e40df80
Oct 20 02:13:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0b3f70a1-09e4-4220-b552-097aac10e56c tempest-TestVolumeSwap-1722680199 tempest-TestVolumeSwap-1722680199-project-member] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.125s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-54989ae8-d094-4d53-a7c1-b2d0f1075f7c req-9f4c46d2-3938-457c-b937-07f3e564c3b6 service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Received event network-vif-plugged-853cfa70-26ff-4bd6-ab16-8f13128cee00 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-54989ae8-d094-4d53-a7c1-b2d0f1075f7c req-9f4c46d2-3938-457c-b937-07f3e564c3b6 service nova] Acquiring lock "72003d17-9292-4bdd-acfc-0d3f7e40df80-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-54989ae8-d094-4d53-a7c1-b2d0f1075f7c req-9f4c46d2-3938-457c-b937-07f3e564c3b6 service nova] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-54989ae8-d094-4d53-a7c1-b2d0f1075f7c req-9f4c46d2-3938-457c-b937-07f3e564c3b6 service nova] Lock "72003d17-9292-4bdd-acfc-0d3f7e40df80-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-54989ae8-d094-4d53-a7c1-b2d0f1075f7c req-9f4c46d2-3938-457c-b937-07f3e564c3b6 service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] No waiting events found dispatching network-vif-plugged-853cfa70-26ff-4bd6-ab16-8f13128cee00 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:13:40 user nova-compute[74242]: WARNING nova.compute.manager [req-54989ae8-d094-4d53-a7c1-b2d0f1075f7c req-9f4c46d2-3938-457c-b937-07f3e564c3b6 service nova] [instance: 72003d17-9292-4bdd-acfc-0d3f7e40df80] Received unexpected event network-vif-plugged-853cfa70-26ff-4bd6-ab16-8f13128cee00 for instance with vm_state deleted and task_state None.
Oct 20 02:13:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:41 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:13:41 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:13:41 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74242) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 02:13:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:45 user nova-compute[74242]: DEBUG nova.compute.manager [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:13:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:13:46 user nova-compute[74242]: INFO nova.compute.claims [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Claim successful on node user
Oct 20 02:13:46 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG nova.network.neutron [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:13:46 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:13:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG nova.policy [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7de983dabe464ac8a720fc45fc311bf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f72d19ab869b4bdeb6798f12ca2ef6ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:13:46 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Creating image(s)
Oct 20 02:13:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "/opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "/opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "/opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.223s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk 1073741824" returned: 0 in 0.053s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Successfully created port: bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.209s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Cannot resize image /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Ensure instance console log exists: /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Successfully updated port: bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquired lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.network.neutron [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-4378660a-6f9c-4e71-ae6d-988529d91931 req-13988e87-4f1e-4b35-88f7-fb64c72e3fba service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-changed-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-4378660a-6f9c-4e71-ae6d-988529d91931 req-13988e87-4f1e-4b35-88f7-fb64c72e3fba service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Refreshing instance network info cache due to event network-changed-bfec951d-2a9f-4fec-98a8-e9683bc83787. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4378660a-6f9c-4e71-ae6d-988529d91931 req-13988e87-4f1e-4b35-88f7-fb64c72e3fba service nova] Acquiring lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.network.neutron [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.network.neutron [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updating instance_info_cache with network_info: [{"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Releasing lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Instance network_info: |[{"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4378660a-6f9c-4e71-ae6d-988529d91931 req-13988e87-4f1e-4b35-88f7-fb64c72e3fba service nova] Acquired lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.network.neutron [req-4378660a-6f9c-4e71-ae6d-988529d91931 req-13988e87-4f1e-4b35-88f7-fb64c72e3fba service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Refreshing network info cache for port bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Start _get_guest_xml network_info=[{"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:13:48 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:13:48 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-346873381',display_name='tempest-ServerActionsTestOtherB-server-346873381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-346873381',id=25,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIglcMR+peRa0oE4XH1xEQPQIqhuBje0KSTUzv/TpZRtBBqkKyYxWmNpC0JGbnCtrC95IJdTO6AdIgwEwg+bzGJkzWbXrKT8XXGF365xukpUOAemIbyOpaYNjhmP5ri2Q==',key_name='tempest-keypair-921939156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f72d19ab869b4bdeb6798f12ca2ef6ae',ramdisk_id='',reservation_id='r-r3xavz7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-215383043',owner_user_name='tempest-ServerActionsTestOtherB-215383043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:13:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de983dabe464ac8a720fc45fc311bf5',uuid=2645af84-8ba4-4a34-beb1-9676cce3dc5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converting VIF {"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.objects.instance [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lazy-loading 'pci_devices' on Instance uuid 2645af84-8ba4-4a34-beb1-9676cce3dc5f {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:13:48 user nova-compute[74242]:   <uuid>2645af84-8ba4-4a34-beb1-9676cce3dc5f</uuid>
Oct 20 02:13:48 user nova-compute[74242]:   <name>instance-00000019</name>
Oct 20 02:13:48 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:13:48 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:13:48 user nova-compute[74242]:   <metadata>
Oct 20 02:13:48 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:13:48 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:13:48 user nova-compute[74242]:       <nova:name>tempest-ServerActionsTestOtherB-server-346873381</nova:name>
Oct 20 02:13:48 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:13:48</nova:creationTime>
Oct 20 02:13:48 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:13:48 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:13:48 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:13:48 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:13:48 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:13:48 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:13:48 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:13:48 user nova-compute[74242]:       <nova:owner>
Oct 20 02:13:48 user nova-compute[74242]:         <nova:user uuid="7de983dabe464ac8a720fc45fc311bf5">tempest-ServerActionsTestOtherB-215383043-project-member</nova:user>
Oct 20 02:13:48 user nova-compute[74242]:         <nova:project uuid="f72d19ab869b4bdeb6798f12ca2ef6ae">tempest-ServerActionsTestOtherB-215383043</nova:project>
Oct 20 02:13:48 user nova-compute[74242]:       </nova:owner>
Oct 20 02:13:48 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:13:48 user nova-compute[74242]:       <nova:ports>
Oct 20 02:13:48 user nova-compute[74242]:         <nova:port uuid="bfec951d-2a9f-4fec-98a8-e9683bc83787">
Oct 20 02:13:48 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 02:13:48 user nova-compute[74242]:         </nova:port>
Oct 20 02:13:48 user nova-compute[74242]:       </nova:ports>
Oct 20 02:13:48 user nova-compute[74242]:     </nova:instance>
Oct 20 02:13:48 user nova-compute[74242]:   </metadata>
Oct 20 02:13:48 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:13:48 user nova-compute[74242]:     <system>
Oct 20 02:13:48 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:13:48 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:13:48 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:13:48 user nova-compute[74242]:       <entry name="serial">2645af84-8ba4-4a34-beb1-9676cce3dc5f</entry>
Oct 20 02:13:48 user nova-compute[74242]:       <entry name="uuid">2645af84-8ba4-4a34-beb1-9676cce3dc5f</entry>
Oct 20 02:13:48 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:13:48 user nova-compute[74242]:     </system>
Oct 20 02:13:48 user nova-compute[74242]:   </sysinfo>
Oct 20 02:13:48 user nova-compute[74242]:   <os>
Oct 20 02:13:48 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:13:48 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:13:48 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:13:48 user nova-compute[74242]:   </os>
Oct 20 02:13:48 user nova-compute[74242]:   <features>
Oct 20 02:13:48 user nova-compute[74242]:     <acpi/>
Oct 20 02:13:48 user nova-compute[74242]:     <apic/>
Oct 20 02:13:48 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:13:48 user nova-compute[74242]:   </features>
Oct 20 02:13:48 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:13:48 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:13:48 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:13:48 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:13:48 user nova-compute[74242]:   </clock>
Oct 20 02:13:48 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:13:48 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:13:48 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:13:48 user nova-compute[74242]:   </cpu>
Oct 20 02:13:48 user nova-compute[74242]:   <devices>
Oct 20 02:13:48 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:13:48 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:13:48 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk"/>
Oct 20 02:13:48 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:13:48 user nova-compute[74242]:     </disk>
Oct 20 02:13:48 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:13:48 user nova-compute[74242]:       <mac address="fa:16:3e:1f:ee:0a"/>
Oct 20 02:13:48 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:13:48 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:13:48 user nova-compute[74242]:       <target dev="tapbfec951d-2a"/>
Oct 20 02:13:48 user nova-compute[74242]:     </interface>
Oct 20 02:13:48 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:13:48 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/console.log" append="off"/>
Oct 20 02:13:48 user nova-compute[74242]:     </serial>
Oct 20 02:13:48 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:13:48 user nova-compute[74242]:     <video>
Oct 20 02:13:48 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:13:48 user nova-compute[74242]:     </video>
Oct 20 02:13:48 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:13:48 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:13:48 user nova-compute[74242]:     </rng>
Oct 20 02:13:48 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:13:48 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:13:48 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:13:48 user nova-compute[74242]:     </memballoon>
Oct 20 02:13:48 user nova-compute[74242]:   </devices>
Oct 20 02:13:48 user nova-compute[74242]: </domain>
Oct 20 02:13:48 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-346873381',display_name='tempest-ServerActionsTestOtherB-server-346873381',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-346873381',id=25,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIglcMR+peRa0oE4XH1xEQPQIqhuBje0KSTUzv/TpZRtBBqkKyYxWmNpC0JGbnCtrC95IJdTO6AdIgwEwg+bzGJkzWbXrKT8XXGF365xukpUOAemIbyOpaYNjhmP5ri2Q==',key_name='tempest-keypair-921939156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f72d19ab869b4bdeb6798f12ca2ef6ae',ramdisk_id='',reservation_id='r-r3xavz7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-215383043',owner_user_name='tempest-ServerActionsTestOtherB-215383043-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:13:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de983dabe464ac8a720fc45fc311bf5',uuid=2645af84-8ba4-4a34-beb1-9676cce3dc5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converting VIF {"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG os_vif [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71336896-7a38-5f9b-8f8b-61b4705073c9', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfec951d-2a, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfec951d-2a, col_values=(('qos', UUID('4d7a56f9-710d-4f3b-ad78-ca4fcb921ed8')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfec951d-2a, col_values=(('external_ids', {'iface-id': 'bfec951d-2a9f-4fec-98a8-e9683bc83787', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:ee:0a', 'vm-uuid': '2645af84-8ba4-4a34-beb1-9676cce3dc5f'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:48 user nova-compute[74242]: INFO os_vif [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a')
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] No VIF found with MAC fa:16:3e:1f:ee:0a, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.network.neutron [req-4378660a-6f9c-4e71-ae6d-988529d91931 req-13988e87-4f1e-4b35-88f7-fb64c72e3fba service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updated VIF entry in instance network info cache for port bfec951d-2a9f-4fec-98a8-e9683bc83787. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG nova.network.neutron [req-4378660a-6f9c-4e71-ae6d-988529d91931 req-13988e87-4f1e-4b35-88f7-fb64c72e3fba service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updating instance_info_cache with network_info: [{"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:13:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4378660a-6f9c-4e71-ae6d-988529d91931 req-13988e87-4f1e-4b35-88f7-fb64c72e3fba service nova] Releasing lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:13:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-a1f53e10-46de-4351-94d6-623f32fcc272 req-1a75a3ff-62b4-4bbe-a01a-3cf7198116a2 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a1f53e10-46de-4351-94d6-623f32fcc272 req-1a75a3ff-62b4-4bbe-a01a-3cf7198116a2 service nova] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a1f53e10-46de-4351-94d6-623f32fcc272 req-1a75a3ff-62b4-4bbe-a01a-3cf7198116a2 service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a1f53e10-46de-4351-94d6-623f32fcc272 req-1a75a3ff-62b4-4bbe-a01a-3cf7198116a2 service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-a1f53e10-46de-4351-94d6-623f32fcc272 req-1a75a3ff-62b4-4bbe-a01a-3cf7198116a2 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] No waiting events found dispatching network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:13:50 user nova-compute[74242]: WARNING nova.compute.manager [req-a1f53e10-46de-4351-94d6-623f32fcc272 req-1a75a3ff-62b4-4bbe-a01a-3cf7198116a2 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received unexpected event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 for instance with vm_state building and task_state spawning.
Oct 20 02:13:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:52 user nova-compute[74242]: DEBUG nova.compute.manager [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:13:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:13:52 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Instance spawned successfully.
Oct 20 02:13:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:13:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:13:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:13:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:13:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:13:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:13:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:13:52 user nova-compute[74242]: INFO nova.compute.manager [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Took 5.59 seconds to spawn the instance on the hypervisor.
Oct 20 02:13:52 user nova-compute[74242]: DEBUG nova.compute.manager [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:13:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-f56ee039-ca47-4f87-a660-c0e517e2a1ef req-1c7b023b-1096-449f-8642-11c585036b82 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:13:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f56ee039-ca47-4f87-a660-c0e517e2a1ef req-1c7b023b-1096-449f-8642-11c585036b82 service nova] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:13:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f56ee039-ca47-4f87-a660-c0e517e2a1ef req-1c7b023b-1096-449f-8642-11c585036b82 service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:13:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f56ee039-ca47-4f87-a660-c0e517e2a1ef req-1c7b023b-1096-449f-8642-11c585036b82 service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-f56ee039-ca47-4f87-a660-c0e517e2a1ef req-1c7b023b-1096-449f-8642-11c585036b82 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] No waiting events found dispatching network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:13:52 user nova-compute[74242]: WARNING nova.compute.manager [req-f56ee039-ca47-4f87-a660-c0e517e2a1ef req-1c7b023b-1096-449f-8642-11c585036b82 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received unexpected event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 for instance with vm_state building and task_state spawning.
Oct 20 02:13:52 user nova-compute[74242]: INFO nova.compute.manager [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Took 6.38 seconds to build instance.
Oct 20 02:13:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7e07f823-e1df-4d2a-938f-b213a5c39d00 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.547s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:13:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:13:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "9701b02d-0874-45f9-a599-8c1809f234c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "9701b02d-0874-45f9-a599-8c1809f234c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:08 user nova-compute[74242]: INFO nova.compute.manager [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Detaching volume 5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4
Oct 20 02:14:08 user nova-compute[74242]: INFO nova.virt.block_device [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Attempting to driver detach volume 5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 from mountpoint /dev/vdb
Oct 20 02:14:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Attempting to detach device vdb from instance 9701b02d-0874-45f9-a599-8c1809f234c4 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:14:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:14:08 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:14:08 user nova-compute[74242]:   <source dev="/dev/sdj"/>
Oct 20 02:14:08 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:14:08 user nova-compute[74242]:   <serial>5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4</serial>
Oct 20 02:14:08 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:14:08 user nova-compute[74242]: </disk>
Oct 20 02:14:08 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:14:08 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Successfully detached device vdb from instance 9701b02d-0874-45f9-a599-8c1809f234c4 from the persistent domain config.
Oct 20 02:14:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9701b02d-0874-45f9-a599-8c1809f234c4 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:14:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:14:08 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:14:08 user nova-compute[74242]:   <source dev="/dev/sdj"/>
Oct 20 02:14:08 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:14:08 user nova-compute[74242]:   <serial>5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4</serial>
Oct 20 02:14:08 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:14:08 user nova-compute[74242]: </disk>
Oct 20 02:14:08 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:14:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:14:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9701b02d-0874-45f9-a599-8c1809f234c4 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:14:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "7e101002-a175-40fe-b5ca-04a58610f60d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "7e101002-a175-40fe-b5ca-04a58610f60d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "7e101002-a175-40fe-b5ca-04a58610f60d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "7e101002-a175-40fe-b5ca-04a58610f60d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "7e101002-a175-40fe-b5ca-04a58610f60d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:24 user nova-compute[74242]: INFO nova.compute.manager [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Terminating instance
Oct 20 02:14:24 user nova-compute[74242]: DEBUG nova.compute.manager [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:14:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-8e82ab11-4ace-4a03-804f-bfd64d83dc4f req-6a64c1cb-1bde-4c22-a49e-b85dab74f040 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Received event network-vif-unplugged-4f154d45-5d20-4df0-bb42-5977772a98c4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:14:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8e82ab11-4ace-4a03-804f-bfd64d83dc4f req-6a64c1cb-1bde-4c22-a49e-b85dab74f040 service nova] Acquiring lock "7e101002-a175-40fe-b5ca-04a58610f60d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8e82ab11-4ace-4a03-804f-bfd64d83dc4f req-6a64c1cb-1bde-4c22-a49e-b85dab74f040 service nova] Lock "7e101002-a175-40fe-b5ca-04a58610f60d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8e82ab11-4ace-4a03-804f-bfd64d83dc4f req-6a64c1cb-1bde-4c22-a49e-b85dab74f040 service nova] Lock "7e101002-a175-40fe-b5ca-04a58610f60d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-8e82ab11-4ace-4a03-804f-bfd64d83dc4f req-6a64c1cb-1bde-4c22-a49e-b85dab74f040 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] No waiting events found dispatching network-vif-unplugged-4f154d45-5d20-4df0-bb42-5977772a98c4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:14:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-8e82ab11-4ace-4a03-804f-bfd64d83dc4f req-6a64c1cb-1bde-4c22-a49e-b85dab74f040 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Received event network-vif-unplugged-4f154d45-5d20-4df0-bb42-5977772a98c4 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:14:25 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Instance destroyed successfully.
Oct 20 02:14:25 user nova-compute[74242]: DEBUG nova.objects.instance [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lazy-loading 'resources' on Instance uuid 7e101002-a175-40fe-b5ca-04a58610f60d {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:14:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:07:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1239626496',display_name='tempest-VolumesAdminNegativeTest-server-1239626496',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1239626496',id=15,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBGvhfoDRrK1BvTrWtEDoX3vJSABvTjZwKKBLIjGFj1+h82G4MnBbBJp+Hl1unm+kewyEi+fjbEGNA4rzeG8nR0aWFbZSe9NsmTf1yEvetOOwHVu+vYk4cwUGfHrRcAuDw==',key_name='tempest-keypair-314473153',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:07:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3c5bff2faf14b7887d0fa959c6e91ab',ramdisk_id='',reservation_id='r-kzdkf9tn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1678070801',owner_user_name='tempest-VolumesAdminNegativeTest-1678070801-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:07:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5770dbda6dd84c99ada813b97a477f8a',uuid=7e101002-a175-40fe-b5ca-04a58610f60d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4f154d45-5d20-4df0-bb42-5977772a98c4", "address": "fa:16:3e:72:d7:10", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f154d45-5d", "ovs_interfaceid": "4f154d45-5d20-4df0-bb42-5977772a98c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:14:25 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Converting VIF {"id": "4f154d45-5d20-4df0-bb42-5977772a98c4", "address": "fa:16:3e:72:d7:10", "network": {"id": "a476089f-e2c5-41a8-8c01-0bfd9c9e280e", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1868670144-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3c5bff2faf14b7887d0fa959c6e91ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4f154d45-5d", "ovs_interfaceid": "4f154d45-5d20-4df0-bb42-5977772a98c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:14:25 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:d7:10,bridge_name='br-int',has_traffic_filtering=True,id=4f154d45-5d20-4df0-bb42-5977772a98c4,network=Network(a476089f-e2c5-41a8-8c01-0bfd9c9e280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f154d45-5d') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:14:25 user nova-compute[74242]: DEBUG os_vif [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:d7:10,bridge_name='br-int',has_traffic_filtering=True,id=4f154d45-5d20-4df0-bb42-5977772a98c4,network=Network(a476089f-e2c5-41a8-8c01-0bfd9c9e280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f154d45-5d') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:14:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4f154d45-5d, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:14:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:14:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48e16996-770f-472b-8acc-f2a818086c09) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:14:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:14:25 user nova-compute[74242]: INFO os_vif [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:d7:10,bridge_name='br-int',has_traffic_filtering=True,id=4f154d45-5d20-4df0-bb42-5977772a98c4,network=Network(a476089f-e2c5-41a8-8c01-0bfd9c9e280e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4f154d45-5d')
Oct 20 02:14:25 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Deleting instance files /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d_del
Oct 20 02:14:25 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Deletion of /opt/stack/data/nova/instances/7e101002-a175-40fe-b5ca-04a58610f60d_del complete
Oct 20 02:14:25 user nova-compute[74242]: INFO nova.compute.manager [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 20 02:14:25 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:14:25 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:14:25 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:14:26 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:14:26 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Took 0.70 seconds to deallocate network for instance.
Oct 20 02:14:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-90c15055-a68e-4c2c-9b6f-34349909ba1c req-90cee54b-7818-4d34-83be-649f8904a26e service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Received event network-vif-deleted-4f154d45-5d20-4df0-bb42-5977772a98c4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:14:26 user nova-compute[74242]: INFO nova.compute.manager [req-90c15055-a68e-4c2c-9b6f-34349909ba1c req-90cee54b-7818-4d34-83be-649f8904a26e service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Neutron deleted interface 4f154d45-5d20-4df0-bb42-5977772a98c4; detaching it from the instance and deleting it from the info cache
Oct 20 02:14:26 user nova-compute[74242]: DEBUG nova.network.neutron [req-90c15055-a68e-4c2c-9b6f-34349909ba1c req-90cee54b-7818-4d34-83be-649f8904a26e service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:14:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-90c15055-a68e-4c2c-9b6f-34349909ba1c req-90cee54b-7818-4d34-83be-649f8904a26e service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Detach interface failed, port_id=4f154d45-5d20-4df0-bb42-5977772a98c4, reason: Instance 7e101002-a175-40fe-b5ca-04a58610f60d could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:14:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:26 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:14:26 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:14:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.594s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:26 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Deleted allocations for instance 7e101002-a175-40fe-b5ca-04a58610f60d
Oct 20 02:14:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-1effd588-3a90-491e-aa59-e0aa4955ea44 req-96a4ba03-3c47-497a-bd96-ccb6ed875f13 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Received event network-vif-plugged-4f154d45-5d20-4df0-bb42-5977772a98c4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:14:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1effd588-3a90-491e-aa59-e0aa4955ea44 req-96a4ba03-3c47-497a-bd96-ccb6ed875f13 service nova] Acquiring lock "7e101002-a175-40fe-b5ca-04a58610f60d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1effd588-3a90-491e-aa59-e0aa4955ea44 req-96a4ba03-3c47-497a-bd96-ccb6ed875f13 service nova] Lock "7e101002-a175-40fe-b5ca-04a58610f60d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1effd588-3a90-491e-aa59-e0aa4955ea44 req-96a4ba03-3c47-497a-bd96-ccb6ed875f13 service nova] Lock "7e101002-a175-40fe-b5ca-04a58610f60d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-1effd588-3a90-491e-aa59-e0aa4955ea44 req-96a4ba03-3c47-497a-bd96-ccb6ed875f13 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] No waiting events found dispatching network-vif-plugged-4f154d45-5d20-4df0-bb42-5977772a98c4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:14:26 user nova-compute[74242]: WARNING nova.compute.manager [req-1effd588-3a90-491e-aa59-e0aa4955ea44 req-96a4ba03-3c47-497a-bd96-ccb6ed875f13 service nova] [instance: 7e101002-a175-40fe-b5ca-04a58610f60d] Received unexpected event network-vif-plugged-4f154d45-5d20-4df0-bb42-5977772a98c4 for instance with vm_state deleted and task_state None.
Oct 20 02:14:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-70e0d4af-dab2-4b33-bcc6-98c5d913c948 tempest-VolumesAdminNegativeTest-1678070801 tempest-VolumesAdminNegativeTest-1678070801-project-member] Lock "7e101002-a175-40fe-b5ca-04a58610f60d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.420s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:28 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9701b02d-0874-45f9-a599-8c1809f234c4 is timed out.
Oct 20 02:14:28 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Successfully detached device vdb from instance 9701b02d-0874-45f9-a599-8c1809f234c4 from the live domain config.
Oct 20 02:14:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vXwKlSdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdj'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:14:28 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:14:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[78237df6-8592-4eba-9283-5781dd4c146b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:75ce2806-7467-4135-b71a-e8475497c39b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:14:28 user nova-compute[74242]: No targets found.
Oct 20 02:14:28 user nova-compute[74242]: iSNS:
Oct 20 02:14:28 user nova-compute[74242]: No targets found.
Oct 20 02:14:28 user nova-compute[74242]: STATIC:
Oct 20 02:14:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4
Oct 20 02:14:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:14:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:14:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:75ce2806-7467-4135-b71a-e8475497c39b
Oct 20 02:14:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:14:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:14:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:14:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:14:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:14:28 user nova-compute[74242]: FIRMWARE:
Oct 20 02:14:28 user nova-compute[74242]: No targets found.
Oct 20 02:14:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:14:28 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:14:28 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b250771e-86ba-4222-b0d9-a6e6099a5967]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:75ce2806-7467-4135-b71a-e8475497c39b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[383e1504-2c2e-4f20-8773-783efa5a4fa1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ce2806-7467-4135-b71a-e8475497c39b (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:14:28 user nova-compute[74242]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:14:28 user nova-compute[74242]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ce2806-7467-4135-b71a-e8475497c39b (non-flash)
Oct 20 02:14:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 (non-flash)
Oct 20 02:14:28 user nova-compute[74242]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:14:28 user nova-compute[74242]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:75ce2806-7467-4135-b71a-e8475497c39b (non-flash)
Oct 20 02:14:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b87cd000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4'): ({'sdj'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Removing single pathed devices sdj {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:14:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3185aa7d-9414-48e0-9d5d-7e543e57ce42]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdj {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdj" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab09672-e3e0-4b55-8d4c-6afc5a53262a]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Flushing IO for device /dev/sdj {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdj {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdj" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d48aff-6457-4e5e-bb9a-5f33e261483d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdj/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdj/device/delete" returned: 0 in 0.046s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[04bb519e-ea9f-4304-9235-1c0deb2e75cf]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Checking to see if SCSI volumes sdj have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] SCSI volumes sdj have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[726ed6bf-0f49-4375-b10f-5ec1cd46f71c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb1b4ea-99bf-4549-b53e-fcf80cbbc80b]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4, portal: 172.16.0.220,3260]
Oct 20 02:14:29 user nova-compute[74242]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4, portal: 172.16.0.220,3260] successful.
Oct 20 02:14:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5b29e0b4-f15a-40df-9ccd-1247b4a3e5d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d44eefd-7514-4efc-98b6-04e9e2be51fd]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] <== disconnect_volume: return (344ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:14:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:14:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:14:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:31 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:14:33 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:14:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:14:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-9701b02d-0874-45f9-a599-8c1809f234c4" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:14:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-9701b02d-0874-45f9-a599-8c1809f234c4" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:14:33 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:14:34 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Updating instance_info_cache with network_info: [{"id": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "address": "fa:16:3e:e1:15:28", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e139d5-eb", "ovs_interfaceid": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:14:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-9701b02d-0874-45f9-a599-8c1809f234c4" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:14:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:14:34 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:14:34 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:14:37 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:14:37 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:14:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8234MB free_disk=25.266197204589844GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:14:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:14:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 9701b02d-0874-45f9-a599-8c1809f234c4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:14:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:14:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c98e383a-e1e5-4130-9cc6-a9823db0b88c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:14:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2645af84-8ba4-4a34-beb1-9676cce3dc5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:14:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:14:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:14:37 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:14:37 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:14:38 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:14:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.425s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:38 user nova-compute[74242]: DEBUG nova.objects.instance [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lazy-loading 'flavor' on Instance uuid 9701b02d-0874-45f9-a599-8c1809f234c4 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:14:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4827b5db-8deb-4267-8111-339217cf8eed tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "9701b02d-0874-45f9-a599-8c1809f234c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 30.370s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:14:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:14:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:14:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:14:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "b7b32e72-08ce-4afd-929c-6985b572767d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "b7b32e72-08ce-4afd-929c-6985b572767d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:40 user nova-compute[74242]: DEBUG nova.compute.manager [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:14:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:14:40 user nova-compute[74242]: INFO nova.compute.claims [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Claim successful on node user
Oct 20 02:14:41 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.411s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG nova.compute.manager [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG nova.compute.manager [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG nova.network.neutron [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:14:41 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:14:41 user nova-compute[74242]: DEBUG nova.compute.manager [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG nova.policy [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00ea297f598040fbb338b9ab2e1a1d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e137c75824d7429585ddd2245f86a6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:14:41 user nova-compute[74242]: INFO nova.virt.block_device [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Booting with volume 81a7b30b-0424-4656-b2f1-5fd1f6617155 at /dev/vda
Oct 20 02:14:41 user nova-compute[74242]: DEBUG os_brick.utils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c55e9ca-2751-43d1-abd0-7b0c50ef2c95]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc63006-4dad-4ca4-9161-6b27b659d62d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ea367b-7158-4769-9317-9d98e5180609]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d02b1fef-09a2-46f0-a095-fb1ce4e971a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:14:41 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:14:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43e937d-b934-43d8-84fd-365caf6c52a1]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG os_brick.utils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:14:41 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Updating existing volume attachment record: 60181e90-1b11-4a1e-834b-7cdb4c425f53 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:14:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:42 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:14:42 user nova-compute[74242]: DEBUG nova.network.neutron [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Successfully created port: 60eff229-2859-4d2b-a9c9-f9539da0c608 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:14:43 user nova-compute[74242]: DEBUG nova.network.neutron [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Successfully updated port: 60eff229-2859-4d2b-a9c9-f9539da0c608 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:14:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "refresh_cache-b7b32e72-08ce-4afd-929c-6985b572767d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:14:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquired lock "refresh_cache-b7b32e72-08ce-4afd-929c-6985b572767d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:14:43 user nova-compute[74242]: DEBUG nova.network.neutron [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:14:43 user nova-compute[74242]: DEBUG nova.compute.manager [req-fe64fd8a-6448-40cb-82af-5e4990605c34 req-b2afa9ad-ece2-4d34-8c5c-7c97b74d6a02 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Received event network-changed-60eff229-2859-4d2b-a9c9-f9539da0c608 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:14:43 user nova-compute[74242]: DEBUG nova.compute.manager [req-fe64fd8a-6448-40cb-82af-5e4990605c34 req-b2afa9ad-ece2-4d34-8c5c-7c97b74d6a02 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Refreshing instance network info cache due to event network-changed-60eff229-2859-4d2b-a9c9-f9539da0c608. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:14:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fe64fd8a-6448-40cb-82af-5e4990605c34 req-b2afa9ad-ece2-4d34-8c5c-7c97b74d6a02 service nova] Acquiring lock "refresh_cache-b7b32e72-08ce-4afd-929c-6985b572767d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:14:43 user nova-compute[74242]: DEBUG nova.network.neutron [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:14:43 user nova-compute[74242]: DEBUG nova.network.neutron [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Updating instance_info_cache with network_info: [{"id": "60eff229-2859-4d2b-a9c9-f9539da0c608", "address": "fa:16:3e:f8:99:0a", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60eff229-28", "ovs_interfaceid": "60eff229-2859-4d2b-a9c9-f9539da0c608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:14:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Releasing lock "refresh_cache-b7b32e72-08ce-4afd-929c-6985b572767d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:14:43 user nova-compute[74242]: DEBUG nova.compute.manager [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Instance network_info: |[{"id": "60eff229-2859-4d2b-a9c9-f9539da0c608", "address": "fa:16:3e:f8:99:0a", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60eff229-28", "ovs_interfaceid": "60eff229-2859-4d2b-a9c9-f9539da0c608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:14:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fe64fd8a-6448-40cb-82af-5e4990605c34 req-b2afa9ad-ece2-4d34-8c5c-7c97b74d6a02 service nova] Acquired lock "refresh_cache-b7b32e72-08ce-4afd-929c-6985b572767d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:14:43 user nova-compute[74242]: DEBUG nova.network.neutron [req-fe64fd8a-6448-40cb-82af-5e4990605c34 req-b2afa9ad-ece2-4d34-8c5c-7c97b74d6a02 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Refreshing network info cache for port 60eff229-2859-4d2b-a9c9-f9539da0c608 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:14:44 user nova-compute[74242]: DEBUG nova.network.neutron [req-fe64fd8a-6448-40cb-82af-5e4990605c34 req-b2afa9ad-ece2-4d34-8c5c-7c97b74d6a02 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Updated VIF entry in instance network info cache for port 60eff229-2859-4d2b-a9c9-f9539da0c608. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:14:44 user nova-compute[74242]: DEBUG nova.network.neutron [req-fe64fd8a-6448-40cb-82af-5e4990605c34 req-b2afa9ad-ece2-4d34-8c5c-7c97b74d6a02 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Updating instance_info_cache with network_info: [{"id": "60eff229-2859-4d2b-a9c9-f9539da0c608", "address": "fa:16:3e:f8:99:0a", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60eff229-28", "ovs_interfaceid": "60eff229-2859-4d2b-a9c9-f9539da0c608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:14:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fe64fd8a-6448-40cb-82af-5e4990605c34 req-b2afa9ad-ece2-4d34-8c5c-7c97b74d6a02 service nova] Releasing lock "refresh_cache-b7b32e72-08ce-4afd-929c-6985b572767d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:14:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:47 user nova-compute[74242]: INFO nova.compute.manager [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Rescuing
Oct 20 02:14:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:14:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquired lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:14:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:14:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Updating instance_info_cache with network_info: [{"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:14:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Releasing lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:14:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-3381129a-7962-4723-ab51-4fc5320e5229 req-d9b1509b-5b7f-440c-8907-26ec38086ccd service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received event network-vif-unplugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:14:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3381129a-7962-4723-ab51-4fc5320e5229 req-d9b1509b-5b7f-440c-8907-26ec38086ccd service nova] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3381129a-7962-4723-ab51-4fc5320e5229 req-d9b1509b-5b7f-440c-8907-26ec38086ccd service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3381129a-7962-4723-ab51-4fc5320e5229 req-d9b1509b-5b7f-440c-8907-26ec38086ccd service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-3381129a-7962-4723-ab51-4fc5320e5229 req-d9b1509b-5b7f-440c-8907-26ec38086ccd service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] No waiting events found dispatching network-vif-unplugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:14:48 user nova-compute[74242]: WARNING nova.compute.manager [req-3381129a-7962-4723-ab51-4fc5320e5229 req-d9b1509b-5b7f-440c-8907-26ec38086ccd service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received unexpected event network-vif-unplugged-989425d9-6ff3-4460-9b24-aede590c961c for instance with vm_state active and task_state rescuing.
Oct 20 02:14:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Instance destroyed successfully.
Oct 20 02:14:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Attempting a stable device rescue
Oct 20 02:14:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74242) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 02:14:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Instance directory exists: not creating {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 02:14:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Creating image(s)
Oct 20 02:14:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "/opt/stack/data/nova/instances/c98e383a-e1e5-4130-9cc6-a9823db0b88c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "/opt/stack/data/nova/instances/c98e383a-e1e5-4130-9cc6-a9823db0b88c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "/opt/stack/data/nova/instances/c98e383a-e1e5-4130-9cc6-a9823db0b88c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:48 user nova-compute[74242]: DEBUG nova.objects.instance [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'trusted_certs' on Instance uuid c98e383a-e1e5-4130-9cc6-a9823db0b88c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:14:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "0f749ef091c96ff64e36feb9aff791da1d5db7ee" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "0f749ef091c96ff64e36feb9aff791da1d5db7ee" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f749ef091c96ff64e36feb9aff791da1d5db7ee.part --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "d1559836-bd5f-402d-b7b2-1ea2e613b362" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:49 user nova-compute[74242]: INFO nova.compute.manager [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Unshelving
Oct 20 02:14:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f749ef091c96ff64e36feb9aff791da1d5db7ee.part --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:49 user nova-compute[74242]: DEBUG nova.virt.images [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] b8d7100d-005a-4027-8e87-182fb959b100 was qcow2, converting to raw {{(pid=74242) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 02:14:49 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:14:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0f749ef091c96ff64e36feb9aff791da1d5db7ee.part /opt/stack/data/nova/instances/_base/0f749ef091c96ff64e36feb9aff791da1d5db7ee.converted {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.objects.instance [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'pci_requests' on Instance uuid d1559836-bd5f-402d-b7b2-1ea2e613b362 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0f749ef091c96ff64e36feb9aff791da1d5db7ee.part /opt/stack/data/nova/instances/_base/0f749ef091c96ff64e36feb9aff791da1d5db7ee.converted" returned: 0 in 0.302s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f749ef091c96ff64e36feb9aff791da1d5db7ee.converted --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-dd213080-7321-42ac-89d4-6f114f1bca9e req-8f5c692d-f12c-4b8c-9f6c-29dd7737df2a service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dd213080-7321-42ac-89d4-6f114f1bca9e req-8f5c692d-f12c-4b8c-9f6c-29dd7737df2a service nova] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dd213080-7321-42ac-89d4-6f114f1bca9e req-8f5c692d-f12c-4b8c-9f6c-29dd7737df2a service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dd213080-7321-42ac-89d4-6f114f1bca9e req-8f5c692d-f12c-4b8c-9f6c-29dd7737df2a service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-dd213080-7321-42ac-89d4-6f114f1bca9e req-8f5c692d-f12c-4b8c-9f6c-29dd7737df2a service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] No waiting events found dispatching network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:14:50 user nova-compute[74242]: WARNING nova.compute.manager [req-dd213080-7321-42ac-89d4-6f114f1bca9e req-8f5c692d-f12c-4b8c-9f6c-29dd7737df2a service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received unexpected event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c for instance with vm_state active and task_state rescuing.
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.objects.instance [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'numa_topology' on Instance uuid d1559836-bd5f-402d-b7b2-1ea2e613b362 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:14:50 user nova-compute[74242]: INFO nova.compute.claims [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Claim successful on node user
Oct 20 02:14:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f749ef091c96ff64e36feb9aff791da1d5db7ee.converted --force-share --output=json" returned: 0 in 0.228s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "0f749ef091c96ff64e36feb9aff791da1d5db7ee" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.723s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "0f749ef091c96ff64e36feb9aff791da1d5db7ee" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "0f749ef091c96ff64e36feb9aff791da1d5db7ee" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f749ef091c96ff64e36feb9aff791da1d5db7ee --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0f749ef091c96ff64e36feb9aff791da1d5db7ee --force-share --output=json" returned: 0 in 0.228s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f749ef091c96ff64e36feb9aff791da1d5db7ee,backing_fmt=raw /opt/stack/data/nova/instances/c98e383a-e1e5-4130-9cc6-a9823db0b88c/disk.rescue {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0f749ef091c96ff64e36feb9aff791da1d5db7ee,backing_fmt=raw /opt/stack/data/nova/instances/c98e383a-e1e5-4130-9cc6-a9823db0b88c/disk.rescue" returned: 0 in 0.060s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "0f749ef091c96ff64e36feb9aff791da1d5db7ee" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.objects.instance [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'migration_context' on Instance uuid c98e383a-e1e5-4130-9cc6-a9823db0b88c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.objects.base [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Object Instance<c98e383a-e1e5-4130-9cc6-a9823db0b88c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Start _get_guest_xml network_info=[{"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "vif_mac": "fa:16:3e:b6:6c:1f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b8d7100d-005a-4027-8e87-182fb959b100', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'dcf7a1bd-95e0-410b-b71e-a70dbe0ed4ac', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klugFvEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'c98e383a-e1e5-4130-9cc6-a9823db0b88c', 'attached_at': '', 'detached_at': '', 'volume_id': '8236db11-4fd2-495a-b6ca-e0801bc01d26', 'serial': '8236db11-4fd2-495a-b6ca-e0801bc01d26'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.objects.instance [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'resources' on Instance uuid c98e383a-e1e5-4130-9cc6-a9823db0b88c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.objects.base [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Object Instance<c98e383a-e1e5-4130-9cc6-a9823db0b88c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.objects.instance [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'numa_topology' on Instance uuid c98e383a-e1e5-4130-9cc6-a9823db0b88c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.objects.base [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Object Instance<c98e383a-e1e5-4130-9cc6-a9823db0b88c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:14:50 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:14:50 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.objects.instance [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'vcpu_model' on Instance uuid c98e383a-e1e5-4130-9cc6-a9823db0b88c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.objects.base [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Object Instance<c98e383a-e1e5-4130-9cc6-a9823db0b88c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klugFvEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:14:50 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:14:50 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:14:50 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:14:50 user nova-compute[74242]: INFO nova.network.neutron [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Updating port 75c2194c-b6fc-4b52-8643-2137bd1d1235 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbaee16-243a-46b0-8084-71751bda22f2]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = klugFvEU\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 02:14:50 user nova-compute[74242]: node.name = iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:14:50 user nova-compute[74242]: node.tpgt = -1
Oct 20 02:14:50 user nova-compute[74242]: node.startup = automatic
Oct 20 02:14:50 user nova-compute[74242]: node.leading_login = No
Oct 20 02:14:50 user nova-compute[74242]: iface.iscsi_ifacename = default
Oct 20 02:14:50 user nova-compute[74242]: iface.net_ifacename = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.ipaddress = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.prefix_len = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.hwaddress = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.transport_name = tcp
Oct 20 02:14:50 user nova-compute[74242]: iface.initiatorname = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.state = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.vlan_id = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.vlan_priority = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.vlan_state = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.iface_num = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.mtu = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.port = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.bootproto = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.subnet_mask = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.gateway = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.dhcp_alt_client_id = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.dhcp_dns = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.dhcp_learn_iqn = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.dhcp_vendor_id_state = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.dhcp_vendor_id = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.dhcp_slp_da = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.fragmentation = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.gratuitous_arp = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.incoming_forwarding = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.tos_state = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.tos = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.ttl = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.delayed_ack = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.tcp_nagle = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.tcp_wsf_state = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.tcp_wsf = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.tcp_timer_scale = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.tcp_timestamp = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.redirect = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.def_task_mgmt_timeout = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.header_digest = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.data_digest = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.immediate_data = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.initial_r2t = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.data_seq_inorder = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.data_pdu_inorder = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.erl = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.max_receive_data_len = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.first_burst_len = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.max_outstanding_r2t = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.max_burst_len = 0
Oct 20 02:14:50 user nova-compute[74242]: iface.chap_auth = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.bidi_chap = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.strict_login_compliance = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.discovery_auth = <empty>
Oct 20 02:14:50 user nova-compute[74242]: iface.discovery_logout = <empty>
Oct 20 02:14:50 user nova-compute[74242]: node.discovery_address = <empty>
Oct 20 02:14:50 user nova-compute[74242]: node.discovery_port = 0
Oct 20 02:14:50 user nova-compute[74242]: node.discovery_type = static
Oct 20 02:14:50 user nova-compute[74242]: node.session.initial_cmdsn = 0
Oct 20 02:14:50 user nova-compute[74242]: node.session.initial_login_retry_max = 8
Oct 20 02:14:50 user nova-compute[74242]: node.session.xmit_thread_priority = -20
Oct 20 02:14:50 user nova-compute[74242]: node.session.cmds_max = 128
Oct 20 02:14:50 user nova-compute[74242]: node.session.queue_depth = 32
Oct 20 02:14:50 user nova-compute[74242]: node.session.nr_sessions = 1
Oct 20 02:14:50 user nova-compute[74242]: node.session.auth.authmethod = CHAP
Oct 20 02:14:50 user nova-compute[74242]: node.session.auth.username = klugFvEU
Oct 20 02:14:50 user nova-compute[74242]: node.session.auth.password = ***
Oct 20 02:14:50 user nova-compute[74242]: node.session.auth.username_in = <empty>
Oct 20 02:14:50 user nova-compute[74242]: node.session.auth.password_in = <empty>
Oct 20 02:14:50 user nova-compute[74242]: node.session.auth.chap_algs = MD5
Oct 20 02:14:50 user nova-compute[74242]: node.session.timeo.replacement_timeout = 120
Oct 20 02:14:50 user nova-compute[74242]: node.session.err_timeo.abort_timeout = 15
Oct 20 02:14:50 user nova-compute[74242]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 02:14:50 user nova-compute[74242]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 02:14:50 user nova-compute[74242]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 02:14:50 user nova-compute[74242]: node.session.iscsi.FastAbort = Yes
Oct 20 02:14:50 user nova-compute[74242]: node.session.iscsi.InitialR2T = No
Oct 20 02:14:50 user nova-compute[74242]: node.session.iscsi.ImmediateData = Yes
Oct 20 02:14:50 user nova-compute[74242]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 02:14:50 user nova-compute[74242]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 02:14:50 user nova-compute[74242]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 02:14:50 user nova-compute[74242]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 02:14:50 user nova-compute[74242]: node.session.iscsi.MaxConnections = 1
Oct 20 02:14:50 user nova-compute[74242]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 02:14:50 user nova-compute[74242]: node.session.iscsi.ERL = 0
Oct 20 02:14:50 user nova-compute[74242]: node.session.scan = manual
Oct 20 02:14:50 user nova-compute[74242]: node.session.reopen_max = 0
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].address = 172.16.0.220
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].port = 3260
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].startup = manual
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].tcp.window_size = 524288
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].tcp.type_of_service = 0
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].timeo.logout_timeout = 15
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].timeo.login_timeout = 15
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].timeo.auth_timeout = 45
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].iscsi.DataDigest = None
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].iscsi.IFMarker = No
Oct 20 02:14:50 user nova-compute[74242]: node.conn[0].iscsi.OFMarker = No
Oct 20 02:14:50 user nova-compute[74242]: # END RECORD
Oct 20 02:14:50 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[145601ac-275e-4905-86cc-0ad8b801b9fb]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[181d36e8-70cf-42c7-9952-2091fa06d696]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v klugFvEU {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v klugFvEU" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c55d8473-25dc-43e2-a4ee-9ad931e6da45]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'klugFvEU'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c2fe9b-7b45-414f-9417-38d3432104be]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a355f8-2d29-4adb-95b5-ea66bb6b730e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88cd5c3-f65c-4fbb-9e1f-94ffb479298d (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:14:50 user nova-compute[74242]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88cd5c3-f65c-4fbb-9e1f-94ffb479298d (non-flash)
Oct 20 02:14:50 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:14:50 user nova-compute[74242]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e88cd5c3-f65c-4fbb-9e1f-94ffb479298d (non-flash)
Oct 20 02:14:50 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.156s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] HCTL ('34', '0', '0', 0) found on session 26 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[533d8622-9a0e-4f9f-a533-1a6fad54ea0b]: (4, ('0 0 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching for a device in session 26 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klugFvEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.183s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] <== connect_volume: return (185ms) {'type': 'block', 'scsi_wwn': '23132643264333239', 'path': '/dev/sdc'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:14:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23132643264333239', 'path': '/dev/sdc'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:14:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1676419618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1676419618',id=24,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:13:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112fda62d355421e80e674dc18bb5069',ramdisk_id='',reservation_id='r-zquvak2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:13:34Z,user_data=None,user_id='9ac628a224fb4653932a27e33aa33c9d',uuid=c98e383a-e1e5-4130-9cc6-a9823db0b88c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "vif_mac": "fa:16:3e:b6:6c:1f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:14:51 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converting VIF {"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "vif_mac": "fa:16:3e:b6:6c:1f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:14:51 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:6c:1f,bridge_name='br-int',has_traffic_filtering=True,id=989425d9-6ff3-4460-9b24-aede590c961c,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989425d9-6f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:14:51 user nova-compute[74242]: DEBUG nova.objects.instance [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'pci_devices' on Instance uuid c98e383a-e1e5-4130-9cc6-a9823db0b88c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:14:51 user nova-compute[74242]: DEBUG nova.objects.base [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Object Instance<c98e383a-e1e5-4130-9cc6-a9823db0b88c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:14:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:14:51 user nova-compute[74242]:   <uuid>c98e383a-e1e5-4130-9cc6-a9823db0b88c</uuid>
Oct 20 02:14:51 user nova-compute[74242]:   <name>instance-00000018</name>
Oct 20 02:14:51 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:14:51 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:14:51 user nova-compute[74242]:   <metadata>
Oct 20 02:14:51 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:14:51 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:14:51 user nova-compute[74242]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1676419618</nova:name>
Oct 20 02:14:51 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:14:50</nova:creationTime>
Oct 20 02:14:51 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:14:51 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:14:51 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:14:51 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:14:51 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:14:51 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:14:51 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:14:51 user nova-compute[74242]:       <nova:owner>
Oct 20 02:14:51 user nova-compute[74242]:         <nova:user uuid="9ac628a224fb4653932a27e33aa33c9d">tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member</nova:user>
Oct 20 02:14:51 user nova-compute[74242]:         <nova:project uuid="112fda62d355421e80e674dc18bb5069">tempest-ServerBootFromVolumeStableRescueTest-1661425956</nova:project>
Oct 20 02:14:51 user nova-compute[74242]:       </nova:owner>
Oct 20 02:14:51 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:14:51 user nova-compute[74242]:       <nova:ports>
Oct 20 02:14:51 user nova-compute[74242]:         <nova:port uuid="989425d9-6ff3-4460-9b24-aede590c961c">
Oct 20 02:14:51 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 20 02:14:51 user nova-compute[74242]:         </nova:port>
Oct 20 02:14:51 user nova-compute[74242]:       </nova:ports>
Oct 20 02:14:51 user nova-compute[74242]:     </nova:instance>
Oct 20 02:14:51 user nova-compute[74242]:   </metadata>
Oct 20 02:14:51 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:14:51 user nova-compute[74242]:     <system>
Oct 20 02:14:51 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:14:51 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:14:51 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:14:51 user nova-compute[74242]:       <entry name="serial">c98e383a-e1e5-4130-9cc6-a9823db0b88c</entry>
Oct 20 02:14:51 user nova-compute[74242]:       <entry name="uuid">c98e383a-e1e5-4130-9cc6-a9823db0b88c</entry>
Oct 20 02:14:51 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:14:51 user nova-compute[74242]:     </system>
Oct 20 02:14:51 user nova-compute[74242]:   </sysinfo>
Oct 20 02:14:51 user nova-compute[74242]:   <os>
Oct 20 02:14:51 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:14:51 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:14:51 user nova-compute[74242]:   </os>
Oct 20 02:14:51 user nova-compute[74242]:   <features>
Oct 20 02:14:51 user nova-compute[74242]:     <acpi/>
Oct 20 02:14:51 user nova-compute[74242]:     <apic/>
Oct 20 02:14:51 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:14:51 user nova-compute[74242]:   </features>
Oct 20 02:14:51 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:14:51 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:14:51 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:14:51 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:14:51 user nova-compute[74242]:   </clock>
Oct 20 02:14:51 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:14:51 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:14:51 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:14:51 user nova-compute[74242]:   </cpu>
Oct 20 02:14:51 user nova-compute[74242]:   <devices>
Oct 20 02:14:51 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:14:51 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:14:51 user nova-compute[74242]:       <source dev="/dev/sdc"/>
Oct 20 02:14:51 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:14:51 user nova-compute[74242]:       <serial>8236db11-4fd2-495a-b6ca-e0801bc01d26</serial>
Oct 20 02:14:51 user nova-compute[74242]:     </disk>
Oct 20 02:14:51 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:14:51 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:14:51 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/c98e383a-e1e5-4130-9cc6-a9823db0b88c/disk.rescue"/>
Oct 20 02:14:51 user nova-compute[74242]:       <target dev="vdb" bus="virtio"/>
Oct 20 02:14:51 user nova-compute[74242]:       <boot order="1"/>
Oct 20 02:14:51 user nova-compute[74242]:     </disk>
Oct 20 02:14:51 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:14:51 user nova-compute[74242]:       <mac address="fa:16:3e:b6:6c:1f"/>
Oct 20 02:14:51 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:14:51 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:14:51 user nova-compute[74242]:       <target dev="tap989425d9-6f"/>
Oct 20 02:14:51 user nova-compute[74242]:     </interface>
Oct 20 02:14:51 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:14:51 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/c98e383a-e1e5-4130-9cc6-a9823db0b88c/console.log" append="off"/>
Oct 20 02:14:51 user nova-compute[74242]:     </serial>
Oct 20 02:14:51 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:14:51 user nova-compute[74242]:     <video>
Oct 20 02:14:51 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:14:51 user nova-compute[74242]:     </video>
Oct 20 02:14:51 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:14:51 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:14:51 user nova-compute[74242]:     </rng>
Oct 20 02:14:51 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:14:51 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:14:51 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:14:51 user nova-compute[74242]:     </memballoon>
Oct 20 02:14:51 user nova-compute[74242]:   </devices>
Oct 20 02:14:51 user nova-compute[74242]: </domain>
Oct 20 02:14:51 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:14:51 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Instance destroyed successfully.
Oct 20 02:14:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:14:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:14:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] No VIF found with MAC fa:16:3e:b6:6c:1f, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:14:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:14:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquired lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:14:51 user nova-compute[74242]: DEBUG nova.network.neutron [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:14:52 user nova-compute[74242]: DEBUG nova.network.neutron [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Updating instance_info_cache with network_info: [{"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:14:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Releasing lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:14:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:14:52 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Creating image(s)
Oct 20 02:14:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "/opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "/opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "/opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:52 user nova-compute[74242]: DEBUG nova.objects.instance [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'trusted_certs' on Instance uuid d1559836-bd5f-402d-b7b2-1ea2e613b362 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:14:52 user nova-compute[74242]: DEBUG nova.objects.base [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Object Instance<d1559836-bd5f-402d-b7b2-1ea2e613b362> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:14:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "db50a97e3c82d405a251f3d9b8548591a890c25e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "db50a97e3c82d405a251f3d9b8548591a890c25e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e.part --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG nova.compute.manager [req-81a6b605-c2a3-4027-9f9c-86ae0c5ecde8 req-3b3d4cba-2209-4f1f-a002-0ffe75f3cc7e service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received event network-changed-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG nova.compute.manager [req-81a6b605-c2a3-4027-9f9c-86ae0c5ecde8 req-3b3d4cba-2209-4f1f-a002-0ffe75f3cc7e service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Refreshing instance network info cache due to event network-changed-75c2194c-b6fc-4b52-8643-2137bd1d1235. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-81a6b605-c2a3-4027-9f9c-86ae0c5ecde8 req-3b3d4cba-2209-4f1f-a002-0ffe75f3cc7e service nova] Acquiring lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-81a6b605-c2a3-4027-9f9c-86ae0c5ecde8 req-3b3d4cba-2209-4f1f-a002-0ffe75f3cc7e service nova] Acquired lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG nova.network.neutron [req-81a6b605-c2a3-4027-9f9c-86ae0c5ecde8 req-3b3d4cba-2209-4f1f-a002-0ffe75f3cc7e service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Refreshing network info cache for port 75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e.part --force-share --output=json" returned: 0 in 0.213s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG nova.virt.images [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] 81c0076d-28e1-48d7-b100-4e4d1af67964 was qcow2, converting to raw {{(pid=74242) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e.part /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e.converted {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e.part /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e.converted" returned: 0 in 0.334s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e.converted --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e.converted --force-share --output=json" returned: 0 in 0.212s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "db50a97e3c82d405a251f3d9b8548591a890c25e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.900s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG nova.network.neutron [req-81a6b605-c2a3-4027-9f9c-86ae0c5ecde8 req-3b3d4cba-2209-4f1f-a002-0ffe75f3cc7e service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Updated VIF entry in instance network info cache for port 75c2194c-b6fc-4b52-8643-2137bd1d1235. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG nova.network.neutron [req-81a6b605-c2a3-4027-9f9c-86ae0c5ecde8 req-3b3d4cba-2209-4f1f-a002-0ffe75f3cc7e service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Updating instance_info_cache with network_info: [{"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-81a6b605-c2a3-4027-9f9c-86ae0c5ecde8 req-3b3d4cba-2209-4f1f-a002-0ffe75f3cc7e service nova] Releasing lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-18d4dc64-3cba-4612-9ad8-6bbc2c8e916e req-f790d150-374c-44ba-a3f2-a90bbdceaf7c service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-18d4dc64-3cba-4612-9ad8-6bbc2c8e916e req-f790d150-374c-44ba-a3f2-a90bbdceaf7c service nova] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-18d4dc64-3cba-4612-9ad8-6bbc2c8e916e req-f790d150-374c-44ba-a3f2-a90bbdceaf7c service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-18d4dc64-3cba-4612-9ad8-6bbc2c8e916e req-f790d150-374c-44ba-a3f2-a90bbdceaf7c service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-18d4dc64-3cba-4612-9ad8-6bbc2c8e916e req-f790d150-374c-44ba-a3f2-a90bbdceaf7c service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] No waiting events found dispatching network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:14:54 user nova-compute[74242]: WARNING nova.compute.manager [req-18d4dc64-3cba-4612-9ad8-6bbc2c8e916e req-f790d150-374c-44ba-a3f2-a90bbdceaf7c service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received unexpected event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c for instance with vm_state active and task_state rescuing.
Oct 20 02:14:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-18d4dc64-3cba-4612-9ad8-6bbc2c8e916e req-f790d150-374c-44ba-a3f2-a90bbdceaf7c service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-18d4dc64-3cba-4612-9ad8-6bbc2c8e916e req-f790d150-374c-44ba-a3f2-a90bbdceaf7c service nova] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-18d4dc64-3cba-4612-9ad8-6bbc2c8e916e req-f790d150-374c-44ba-a3f2-a90bbdceaf7c service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-18d4dc64-3cba-4612-9ad8-6bbc2c8e916e req-f790d150-374c-44ba-a3f2-a90bbdceaf7c service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-18d4dc64-3cba-4612-9ad8-6bbc2c8e916e req-f790d150-374c-44ba-a3f2-a90bbdceaf7c service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] No waiting events found dispatching network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:14:54 user nova-compute[74242]: WARNING nova.compute.manager [req-18d4dc64-3cba-4612-9ad8-6bbc2c8e916e req-f790d150-374c-44ba-a3f2-a90bbdceaf7c service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received unexpected event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c for instance with vm_state active and task_state rescuing.
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e --force-share --output=json" returned: 0 in 0.266s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "db50a97e3c82d405a251f3d9b8548591a890c25e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "db50a97e3c82d405a251f3d9b8548591a890c25e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e --force-share --output=json" returned: 0 in 0.209s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e,backing_fmt=raw /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e,backing_fmt=raw /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk 1073741824" returned: 0 in 0.064s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "db50a97e3c82d405a251f3d9b8548591a890c25e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e --force-share --output=json" returned: 0 in 0.219s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG nova.objects.instance [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'migration_context' on Instance uuid d1559836-bd5f-402d-b7b2-1ea2e613b362 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:14:54 user nova-compute[74242]: DEBUG nova.objects.base [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Object Instance<d1559836-bd5f-402d-b7b2-1ea2e613b362> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:14:54 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Rebasing disk image.
Oct 20 02:14:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.233s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 -F raw /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:14:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:55 user nova-compute[74242]: DEBUG nova.compute.manager [None req-fad96ae6-da55-4bef-b38a-e01e2efc80b2 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 -F raw /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk" returned: 0 in 2.663s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Ensure instance console log exists: /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Start _get_guest_xml network_info=[{"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='e4e9c159ccbea1b0c05561602b501736',container_format='bare',created_at=2023-10-20T02:12:56Z,direct_url=<?>,disk_format='qcow2',id=81c0076d-28e1-48d7-b100-4e4d1af67964,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1898730605-shelved',owner='a7a2695b5ad341e0afd133522f680bf9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T02:13:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:14:57 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:14:57 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='e4e9c159ccbea1b0c05561602b501736',container_format='bare',created_at=2023-10-20T02:12:56Z,direct_url=<?>,disk_format='qcow2',id=81c0076d-28e1-48d7-b100-4e4d1af67964,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1898730605-shelved',owner='a7a2695b5ad341e0afd133522f680bf9',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T02:13:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.objects.instance [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'vcpu_model' on Instance uuid d1559836-bd5f-402d-b7b2-1ea2e613b362 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.objects.base [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Object Instance<d1559836-bd5f-402d-b7b2-1ea2e613b362> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T02:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1898730605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1898730605',id=21,image_ref='81c0076d-28e1-48d7-b100-4e4d1af67964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1736999254',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:11:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a7a2695b5ad341e0afd133522f680bf9',ramdisk_id='',reservation_id='r-t0tvfa99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-750275147',owner_user_name='tempest-AttachVolumeShelveTestJSON-750275147-project-member',shelved_at='2023-10-20T02:13:01.233420',shelved_host='user',shelved_image_id='81c0076d-28e1-48d7-b100-4e4d1af67964'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:14:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d6645596e24f24a216d2b4e7809073',uuid=d1559836-bd5f-402d-b7b2-1ea2e613b362,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converting VIF {"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=75c2194c-b6fc-4b52-8643-2137bd1d1235,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c2194c-b6') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.objects.instance [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'pci_devices' on Instance uuid d1559836-bd5f-402d-b7b2-1ea2e613b362 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.objects.base [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Object Instance<d1559836-bd5f-402d-b7b2-1ea2e613b362> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:14:57 user nova-compute[74242]:   <uuid>d1559836-bd5f-402d-b7b2-1ea2e613b362</uuid>
Oct 20 02:14:57 user nova-compute[74242]:   <name>instance-00000015</name>
Oct 20 02:14:57 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:14:57 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:14:57 user nova-compute[74242]:   <metadata>
Oct 20 02:14:57 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:14:57 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:14:57 user nova-compute[74242]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1898730605</nova:name>
Oct 20 02:14:57 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:14:57</nova:creationTime>
Oct 20 02:14:57 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:14:57 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:14:57 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:14:57 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:14:57 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:14:57 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:14:57 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:14:57 user nova-compute[74242]:       <nova:owner>
Oct 20 02:14:57 user nova-compute[74242]:         <nova:user uuid="a3d6645596e24f24a216d2b4e7809073">tempest-AttachVolumeShelveTestJSON-750275147-project-member</nova:user>
Oct 20 02:14:57 user nova-compute[74242]:         <nova:project uuid="a7a2695b5ad341e0afd133522f680bf9">tempest-AttachVolumeShelveTestJSON-750275147</nova:project>
Oct 20 02:14:57 user nova-compute[74242]:       </nova:owner>
Oct 20 02:14:57 user nova-compute[74242]:       <nova:root type="image" uuid="81c0076d-28e1-48d7-b100-4e4d1af67964"/>
Oct 20 02:14:57 user nova-compute[74242]:       <nova:ports>
Oct 20 02:14:57 user nova-compute[74242]:         <nova:port uuid="75c2194c-b6fc-4b52-8643-2137bd1d1235">
Oct 20 02:14:57 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 02:14:57 user nova-compute[74242]:         </nova:port>
Oct 20 02:14:57 user nova-compute[74242]:       </nova:ports>
Oct 20 02:14:57 user nova-compute[74242]:     </nova:instance>
Oct 20 02:14:57 user nova-compute[74242]:   </metadata>
Oct 20 02:14:57 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:14:57 user nova-compute[74242]:     <system>
Oct 20 02:14:57 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:14:57 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:14:57 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:14:57 user nova-compute[74242]:       <entry name="serial">d1559836-bd5f-402d-b7b2-1ea2e613b362</entry>
Oct 20 02:14:57 user nova-compute[74242]:       <entry name="uuid">d1559836-bd5f-402d-b7b2-1ea2e613b362</entry>
Oct 20 02:14:57 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:14:57 user nova-compute[74242]:     </system>
Oct 20 02:14:57 user nova-compute[74242]:   </sysinfo>
Oct 20 02:14:57 user nova-compute[74242]:   <os>
Oct 20 02:14:57 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:14:57 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:14:57 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:14:57 user nova-compute[74242]:   </os>
Oct 20 02:14:57 user nova-compute[74242]:   <features>
Oct 20 02:14:57 user nova-compute[74242]:     <acpi/>
Oct 20 02:14:57 user nova-compute[74242]:     <apic/>
Oct 20 02:14:57 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:14:57 user nova-compute[74242]:   </features>
Oct 20 02:14:57 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:14:57 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:14:57 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:14:57 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:14:57 user nova-compute[74242]:   </clock>
Oct 20 02:14:57 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:14:57 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:14:57 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:14:57 user nova-compute[74242]:   </cpu>
Oct 20 02:14:57 user nova-compute[74242]:   <devices>
Oct 20 02:14:57 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:14:57 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:14:57 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk"/>
Oct 20 02:14:57 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:14:57 user nova-compute[74242]:     </disk>
Oct 20 02:14:57 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:14:57 user nova-compute[74242]:       <mac address="fa:16:3e:4e:a2:94"/>
Oct 20 02:14:57 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:14:57 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:14:57 user nova-compute[74242]:       <target dev="tap75c2194c-b6"/>
Oct 20 02:14:57 user nova-compute[74242]:     </interface>
Oct 20 02:14:57 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:14:57 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/console.log" append="off"/>
Oct 20 02:14:57 user nova-compute[74242]:     </serial>
Oct 20 02:14:57 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:14:57 user nova-compute[74242]:     <video>
Oct 20 02:14:57 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:14:57 user nova-compute[74242]:     </video>
Oct 20 02:14:57 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:14:57 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:14:57 user nova-compute[74242]:     </rng>
Oct 20 02:14:57 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:14:57 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:14:57 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:14:57 user nova-compute[74242]:     </memballoon>
Oct 20 02:14:57 user nova-compute[74242]:   </devices>
Oct 20 02:14:57 user nova-compute[74242]: </domain>
Oct 20 02:14:57 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T02:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1898730605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1898730605',id=21,image_ref='81c0076d-28e1-48d7-b100-4e4d1af67964',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1736999254',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:11:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a7a2695b5ad341e0afd133522f680bf9',ramdisk_id='',reservation_id='r-t0tvfa99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-750275147',owner_user_name='tempest-AttachVolumeShelveTestJSON-750275147-project-member',shelved_at='2023-10-20T02:13:01.233420',shelved_host='user',shelved_image_id='81c0076d-28e1-48d7-b100-4e4d1af67964'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:14:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d6645596e24f24a216d2b4e7809073',uuid=d1559836-bd5f-402d-b7b2-1ea2e613b362,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converting VIF {"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=75c2194c-b6fc-4b52-8643-2137bd1d1235,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c2194c-b6') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG os_vif [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=75c2194c-b6fc-4b52-8643-2137bd1d1235,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c2194c-b6') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '98ebf3b9-2f63-5c1e-83af-f6b3f6a8bf71', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75c2194c-b6, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75c2194c-b6, col_values=(('qos', UUID('a7e27bb8-7310-4a0d-a0f7-a28f7d997708')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:14:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75c2194c-b6, col_values=(('external_ids', {'iface-id': '75c2194c-b6fc-4b52-8643-2137bd1d1235', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:a2:94', 'vm-uuid': 'd1559836-bd5f-402d-b7b2-1ea2e613b362'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:14:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:14:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:58 user nova-compute[74242]: INFO os_vif [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=75c2194c-b6fc-4b52-8643-2137bd1d1235,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c2194c-b6')
Oct 20 02:14:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:14:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] No VIF found with MAC fa:16:3e:4e:a2:94, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:14:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "9701b02d-0874-45f9-a599-8c1809f234c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "9701b02d-0874-45f9-a599-8c1809f234c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "9701b02d-0874-45f9-a599-8c1809f234c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "9701b02d-0874-45f9-a599-8c1809f234c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "9701b02d-0874-45f9-a599-8c1809f234c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:58 user nova-compute[74242]: INFO nova.compute.manager [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Terminating instance
Oct 20 02:14:58 user nova-compute[74242]: DEBUG nova.compute.manager [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:14:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:14:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-854b2385-9f63-40ba-bcad-9e1e10d10b73 req-87eafb5a-2fce-4480-b938-a7692b05057f service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Received event network-vif-unplugged-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:14:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-854b2385-9f63-40ba-bcad-9e1e10d10b73 req-87eafb5a-2fce-4480-b938-a7692b05057f service nova] Acquiring lock "9701b02d-0874-45f9-a599-8c1809f234c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:14:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-854b2385-9f63-40ba-bcad-9e1e10d10b73 req-87eafb5a-2fce-4480-b938-a7692b05057f service nova] Lock "9701b02d-0874-45f9-a599-8c1809f234c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:14:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-854b2385-9f63-40ba-bcad-9e1e10d10b73 req-87eafb5a-2fce-4480-b938-a7692b05057f service nova] Lock "9701b02d-0874-45f9-a599-8c1809f234c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:14:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-854b2385-9f63-40ba-bcad-9e1e10d10b73 req-87eafb5a-2fce-4480-b938-a7692b05057f service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] No waiting events found dispatching network-vif-unplugged-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:14:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-854b2385-9f63-40ba-bcad-9e1e10d10b73 req-87eafb5a-2fce-4480-b938-a7692b05057f service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Received event network-vif-unplugged-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:15:00 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Instance destroyed successfully.
Oct 20 02:15:00 user nova-compute[74242]: DEBUG nova.objects.instance [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lazy-loading 'resources' on Instance uuid 9701b02d-0874-45f9-a599-8c1809f234c4 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:08:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-63314056',display_name='tempest-AttachVolumeNegativeTest-server-63314056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-63314056',id=18,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVvyBGciRCF5fdmnYrWGYf7HiyXj14nRIrjn/qDT8dE6QmmwdELLokrSQV3HZ69aNjb7Mc190xXKFoZzBdV9yqR3oa1xG3SwLr8v5ik6tErR5erIFmdaPKYsScJT/pM5Q==',key_name='tempest-keypair-1358821306',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:08:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e74cc27f49384dc78190bd5d9ed7fab9',ramdisk_id='',reservation_id='r-wh6jvh6m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1292543897',owner_user_name='tempest-AttachVolumeNegativeTest-1292543897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:08:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3069dcf63864aa08f632601c3a849c5',uuid=9701b02d-0874-45f9-a599-8c1809f234c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "address": "fa:16:3e:e1:15:28", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e139d5-eb", "ovs_interfaceid": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converting VIF {"id": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "address": "fa:16:3e:e1:15:28", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap43e139d5-eb", "ovs_interfaceid": "43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:15:28,bridge_name='br-int',has_traffic_filtering=True,id=43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e139d5-eb') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG os_vif [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:15:28,bridge_name='br-int',has_traffic_filtering=True,id=43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e139d5-eb') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap43e139d5-eb, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3507b63a-b37a-494c-938d-f3498a9400ab) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:15:00 user nova-compute[74242]: INFO os_vif [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:15:28,bridge_name='br-int',has_traffic_filtering=True,id=43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43e139d5-eb')
Oct 20 02:15:00 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Deleting instance files /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4_del
Oct 20 02:15:00 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Deletion of /opt/stack/data/nova/instances/9701b02d-0874-45f9-a599-8c1809f234c4_del complete
Oct 20 02:15:00 user nova-compute[74242]: INFO nova.compute.manager [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Took 1.39 seconds to destroy the instance on the hypervisor.
Oct 20 02:15:00 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-8fe47a26-9043-41f1-84e2-635a575b3694 req-eec95901-74c9-40be-a44b-a63baf2ee583 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received event network-vif-plugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8fe47a26-9043-41f1-84e2-635a575b3694 req-eec95901-74c9-40be-a44b-a63baf2ee583 service nova] Acquiring lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8fe47a26-9043-41f1-84e2-635a575b3694 req-eec95901-74c9-40be-a44b-a63baf2ee583 service nova] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8fe47a26-9043-41f1-84e2-635a575b3694 req-eec95901-74c9-40be-a44b-a63baf2ee583 service nova] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-8fe47a26-9043-41f1-84e2-635a575b3694 req-eec95901-74c9-40be-a44b-a63baf2ee583 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] No waiting events found dispatching network-vif-plugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:15:00 user nova-compute[74242]: WARNING nova.compute.manager [req-8fe47a26-9043-41f1-84e2-635a575b3694 req-eec95901-74c9-40be-a44b-a63baf2ee583 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received unexpected event network-vif-plugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 02:15:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-6bb784d2-70f1-4960-90d6-7a420d79fff5 req-ccb4e080-c6d6-4d45-8f4c-14eb0ad6f009 service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Received event network-vif-plugged-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:15:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6bb784d2-70f1-4960-90d6-7a420d79fff5 req-ccb4e080-c6d6-4d45-8f4c-14eb0ad6f009 service nova] Acquiring lock "9701b02d-0874-45f9-a599-8c1809f234c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6bb784d2-70f1-4960-90d6-7a420d79fff5 req-ccb4e080-c6d6-4d45-8f4c-14eb0ad6f009 service nova] Lock "9701b02d-0874-45f9-a599-8c1809f234c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6bb784d2-70f1-4960-90d6-7a420d79fff5 req-ccb4e080-c6d6-4d45-8f4c-14eb0ad6f009 service nova] Lock "9701b02d-0874-45f9-a599-8c1809f234c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:01 user nova-compute[74242]: DEBUG nova.compute.manager [req-6bb784d2-70f1-4960-90d6-7a420d79fff5 req-ccb4e080-c6d6-4d45-8f4c-14eb0ad6f009 service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] No waiting events found dispatching network-vif-plugged-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:15:01 user nova-compute[74242]: WARNING nova.compute.manager [req-6bb784d2-70f1-4960-90d6-7a420d79fff5 req-ccb4e080-c6d6-4d45-8f4c-14eb0ad6f009 service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Received unexpected event network-vif-plugged-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb for instance with vm_state active and task_state deleting.
Oct 20 02:15:01 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:15:01 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Took 1.67 seconds to deallocate network for instance.
Oct 20 02:15:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:02 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:15:02 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:15:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.308s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:02 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Deleted allocations for instance 9701b02d-0874-45f9-a599-8c1809f234c4
Oct 20 02:15:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-14f77a55-42ae-41db-99d5-e381cba3ed60 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "9701b02d-0874-45f9-a599-8c1809f234c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.627s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-ca955325-57a2-47c3-aa60-6e11199e5b46 req-062eaa8b-34cf-4290-9f4d-726910187ff4 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received event network-vif-plugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:15:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ca955325-57a2-47c3-aa60-6e11199e5b46 req-062eaa8b-34cf-4290-9f4d-726910187ff4 service nova] Acquiring lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ca955325-57a2-47c3-aa60-6e11199e5b46 req-062eaa8b-34cf-4290-9f4d-726910187ff4 service nova] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ca955325-57a2-47c3-aa60-6e11199e5b46 req-062eaa8b-34cf-4290-9f4d-726910187ff4 service nova] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-ca955325-57a2-47c3-aa60-6e11199e5b46 req-062eaa8b-34cf-4290-9f4d-726910187ff4 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] No waiting events found dispatching network-vif-plugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:15:02 user nova-compute[74242]: WARNING nova.compute.manager [req-ca955325-57a2-47c3-aa60-6e11199e5b46 req-062eaa8b-34cf-4290-9f4d-726910187ff4 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received unexpected event network-vif-plugged-75c2194c-b6fc-4b52-8643-2137bd1d1235 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 02:15:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-ca955325-57a2-47c3-aa60-6e11199e5b46 req-062eaa8b-34cf-4290-9f4d-726910187ff4 service nova] [instance: 9701b02d-0874-45f9-a599-8c1809f234c4] Received event network-vif-deleted-43e139d5-eb16-44b9-b9cf-54d0ae9cf5eb {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:15:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:15:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:15:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Instance spawned successfully.
Oct 20 02:15:03 user nova-compute[74242]: DEBUG nova.compute.manager [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:15:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4746bd76-711e-4b26-9851-dfc01d6da100 tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.321s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:03 user nova-compute[74242]: DEBUG nova.compute.manager [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:15:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:03 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:15:03 user nova-compute[74242]: INFO nova.compute.claims [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Claim successful on node user
Oct 20 02:15:03 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:15:03 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:15:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:03 user nova-compute[74242]: DEBUG nova.compute.manager [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:15:03 user nova-compute[74242]: DEBUG nova.compute.manager [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:15:03 user nova-compute[74242]: DEBUG nova.network.neutron [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:15:03 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:15:03 user nova-compute[74242]: DEBUG nova.compute.manager [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG nova.policy [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c1f488a444de49f5bed5351efd55dafa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5cf9b187fe8443aba57a8c629d78978e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:15:04 user nova-compute[74242]: INFO nova.virt.block_device [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Booting with volume 611b143e-0c8f-4e29-a344-97df041319f1 at /dev/vda
Oct 20 02:15:04 user nova-compute[74242]: DEBUG os_brick.utils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c72636-0970-4dd0-8908-ed30c74e6c12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2586d4e8-6508-4848-9d94-003152dc32f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a045af-7b7b-4190-8cb6-fef3b6e24f83]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[124a8318-6d61-461d-b02a-f5ace9457783]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:15:04 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:15:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[462fcabd-fdcf-47d6-bb64-ed4428043961]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG os_brick.utils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Updating existing volume attachment record: 7a21ee95-d25a-4008-adb2-0151cff8562d {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:04 user nova-compute[74242]: DEBUG nova.network.neutron [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Successfully created port: a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:15:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:05 user nova-compute[74242]: DEBUG nova.network.neutron [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Successfully updated port: a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:15:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:15:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquired lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:15:05 user nova-compute[74242]: DEBUG nova.network.neutron [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:15:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-d5a54cb5-7d96-4d16-b6bd-ba4efa786bf4 req-b779ab5e-e2fb-4113-8634-8d9dd544bb2c service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received event network-changed-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:15:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-d5a54cb5-7d96-4d16-b6bd-ba4efa786bf4 req-b779ab5e-e2fb-4113-8634-8d9dd544bb2c service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Refreshing instance network info cache due to event network-changed-a8a2c2c1-7401-4115-8479-bb8939c1397f. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:15:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d5a54cb5-7d96-4d16-b6bd-ba4efa786bf4 req-b779ab5e-e2fb-4113-8634-8d9dd544bb2c service nova] Acquiring lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:15:05 user nova-compute[74242]: DEBUG nova.network.neutron [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:15:06 user nova-compute[74242]: DEBUG nova.network.neutron [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Updating instance_info_cache with network_info: [{"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:15:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Releasing lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:15:06 user nova-compute[74242]: DEBUG nova.compute.manager [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Instance network_info: |[{"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:15:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d5a54cb5-7d96-4d16-b6bd-ba4efa786bf4 req-b779ab5e-e2fb-4113-8634-8d9dd544bb2c service nova] Acquired lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:15:06 user nova-compute[74242]: DEBUG nova.network.neutron [req-d5a54cb5-7d96-4d16-b6bd-ba4efa786bf4 req-b779ab5e-e2fb-4113-8634-8d9dd544bb2c service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Refreshing network info cache for port a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:15:06 user nova-compute[74242]: DEBUG nova.network.neutron [req-d5a54cb5-7d96-4d16-b6bd-ba4efa786bf4 req-b779ab5e-e2fb-4113-8634-8d9dd544bb2c service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Updated VIF entry in instance network info cache for port a8a2c2c1-7401-4115-8479-bb8939c1397f. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:15:06 user nova-compute[74242]: DEBUG nova.network.neutron [req-d5a54cb5-7d96-4d16-b6bd-ba4efa786bf4 req-b779ab5e-e2fb-4113-8634-8d9dd544bb2c service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Updating instance_info_cache with network_info: [{"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:15:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d5a54cb5-7d96-4d16-b6bd-ba4efa786bf4 req-b779ab5e-e2fb-4113-8634-8d9dd544bb2c service nova] Releasing lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:15:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:15:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:15:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:15:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:15:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.compute.manager [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:15:12 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Creating image(s)
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Ensure instance console log exists: /opt/stack/data/nova/instances/b7b32e72-08ce-4afd-929c-6985b572767d/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Start _get_guest_xml network_info=[{"id": "60eff229-2859-4d2b-a9c9-f9539da0c608", "address": "fa:16:3e:f8:99:0a", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60eff229-28", "ovs_interfaceid": "60eff229-2859-4d2b-a9c9-f9539da0c608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '60181e90-1b11-4a1e-834b-7cdb4c425f53', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlohPgye', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b7b32e72-08ce-4afd-929c-6985b572767d', 'attached_at': '', 'detached_at': '', 'volume_id': '81a7b30b-0424-4656-b2f1-5fd1f6617155', 'serial': '81a7b30b-0424-4656-b2f1-5fd1f6617155'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:15:12 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:15:12 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlohPgye', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:15:12 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:15:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:15:12 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:15:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:15:12 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e41b0fa-0600-49fd-b527-64d3f66ded16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:15:12 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[39abff76-62b9-4359-89dd-ac7cd287cda4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155] added
Oct 20 02:15:12 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ba2397-b85d-4eda-83da-f75a02585191]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7c3ad0-7fc5-4cc4-84d1-08feb0acfc23]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WlohPgye {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WlohPgye" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[689b5dbd-6551-43d2-96e4-cec3fda2dc14]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WlohPgye'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbe9a07-4a00-4c18-b46a-af9ff8e58860]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[12de147f-424c-4782-a393-0e6d92d94d92]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:15:12 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:15:12 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42e1fbb-c350-4194-a43a-f2fd046fefea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260]
Oct 20 02:15:12 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260] successful.
Oct 20 02:15:12 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7984dd8e-6183-432a-95c0-a108991162c1]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3634bff1-deb6-4425-a877-e4dcb6d95561]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:15:13 user nova-compute[74242]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:15:13 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:15:13 user nova-compute[74242]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:15:13 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] HCTL ('33', '-', '-', 0) found on session 29 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[21df7353-6d51-496c-b52a-f78c9a8144b2]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:13 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching for a device in session 29 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlohPgye', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== connect_volume: return (1339ms) {'type': 'block', 'scsi_wwn': '26637613835313933', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637613835313933', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1251057833',display_name='tempest-TestVolumeBootPattern-server-1251057833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1251057833',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYHgQrnRlQ4jBKzblQ3DfxaEfVjuxo/NC6O+ICak+0aaFoFY7UzIhNxrdgQLtBAfBOsL0Lu2xLtyVpinmCCfqmljj/P6GdvFSKRfnZG4N6/Y2tUqR86uaxeDlehlPmATw==',key_name='tempest-TestVolumeBootPattern-887907135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-htfbbarl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:14:41Z,user_data=None,user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=b7b32e72-08ce-4afd-929c-6985b572767d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60eff229-2859-4d2b-a9c9-f9539da0c608", "address": "fa:16:3e:f8:99:0a", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60eff229-28", "ovs_interfaceid": "60eff229-2859-4d2b-a9c9-f9539da0c608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "60eff229-2859-4d2b-a9c9-f9539da0c608", "address": "fa:16:3e:f8:99:0a", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60eff229-28", "ovs_interfaceid": "60eff229-2859-4d2b-a9c9-f9539da0c608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:99:0a,bridge_name='br-int',has_traffic_filtering=True,id=60eff229-2859-4d2b-a9c9-f9539da0c608,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60eff229-28') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG nova.objects.instance [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lazy-loading 'pci_devices' on Instance uuid b7b32e72-08ce-4afd-929c-6985b572767d {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:15:14 user nova-compute[74242]:   <uuid>b7b32e72-08ce-4afd-929c-6985b572767d</uuid>
Oct 20 02:15:14 user nova-compute[74242]:   <name>instance-0000001a</name>
Oct 20 02:15:14 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:15:14 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:15:14 user nova-compute[74242]:   <metadata>
Oct 20 02:15:14 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:15:14 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:15:14 user nova-compute[74242]:       <nova:name>tempest-TestVolumeBootPattern-server-1251057833</nova:name>
Oct 20 02:15:14 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:15:12</nova:creationTime>
Oct 20 02:15:14 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:15:14 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:15:14 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:15:14 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:15:14 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:15:14 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:15:14 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:15:14 user nova-compute[74242]:       <nova:owner>
Oct 20 02:15:14 user nova-compute[74242]:         <nova:user uuid="00ea297f598040fbb338b9ab2e1a1d3a">tempest-TestVolumeBootPattern-882774340-project-member</nova:user>
Oct 20 02:15:14 user nova-compute[74242]:         <nova:project uuid="e137c75824d7429585ddd2245f86a6d0">tempest-TestVolumeBootPattern-882774340</nova:project>
Oct 20 02:15:14 user nova-compute[74242]:       </nova:owner>
Oct 20 02:15:14 user nova-compute[74242]:       <nova:ports>
Oct 20 02:15:14 user nova-compute[74242]:         <nova:port uuid="60eff229-2859-4d2b-a9c9-f9539da0c608">
Oct 20 02:15:14 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 02:15:14 user nova-compute[74242]:         </nova:port>
Oct 20 02:15:14 user nova-compute[74242]:       </nova:ports>
Oct 20 02:15:14 user nova-compute[74242]:     </nova:instance>
Oct 20 02:15:14 user nova-compute[74242]:   </metadata>
Oct 20 02:15:14 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:15:14 user nova-compute[74242]:     <system>
Oct 20 02:15:14 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:15:14 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:15:14 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:15:14 user nova-compute[74242]:       <entry name="serial">b7b32e72-08ce-4afd-929c-6985b572767d</entry>
Oct 20 02:15:14 user nova-compute[74242]:       <entry name="uuid">b7b32e72-08ce-4afd-929c-6985b572767d</entry>
Oct 20 02:15:14 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:15:14 user nova-compute[74242]:     </system>
Oct 20 02:15:14 user nova-compute[74242]:   </sysinfo>
Oct 20 02:15:14 user nova-compute[74242]:   <os>
Oct 20 02:15:14 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:15:14 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:15:14 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:15:14 user nova-compute[74242]:   </os>
Oct 20 02:15:14 user nova-compute[74242]:   <features>
Oct 20 02:15:14 user nova-compute[74242]:     <acpi/>
Oct 20 02:15:14 user nova-compute[74242]:     <apic/>
Oct 20 02:15:14 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:15:14 user nova-compute[74242]:   </features>
Oct 20 02:15:14 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:15:14 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:15:14 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:15:14 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:15:14 user nova-compute[74242]:   </clock>
Oct 20 02:15:14 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:15:14 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:15:14 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:15:14 user nova-compute[74242]:   </cpu>
Oct 20 02:15:14 user nova-compute[74242]:   <devices>
Oct 20 02:15:14 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:15:14 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:15:14 user nova-compute[74242]:       <source dev="/dev/sdb"/>
Oct 20 02:15:14 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:15:14 user nova-compute[74242]:       <serial>81a7b30b-0424-4656-b2f1-5fd1f6617155</serial>
Oct 20 02:15:14 user nova-compute[74242]:     </disk>
Oct 20 02:15:14 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:15:14 user nova-compute[74242]:       <mac address="fa:16:3e:f8:99:0a"/>
Oct 20 02:15:14 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:15:14 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:15:14 user nova-compute[74242]:       <target dev="tap60eff229-28"/>
Oct 20 02:15:14 user nova-compute[74242]:     </interface>
Oct 20 02:15:14 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:15:14 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/b7b32e72-08ce-4afd-929c-6985b572767d/console.log" append="off"/>
Oct 20 02:15:14 user nova-compute[74242]:     </serial>
Oct 20 02:15:14 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:15:14 user nova-compute[74242]:     <video>
Oct 20 02:15:14 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:15:14 user nova-compute[74242]:     </video>
Oct 20 02:15:14 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:15:14 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:15:14 user nova-compute[74242]:     </rng>
Oct 20 02:15:14 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:15:14 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:15:14 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:15:14 user nova-compute[74242]:     </memballoon>
Oct 20 02:15:14 user nova-compute[74242]:   </devices>
Oct 20 02:15:14 user nova-compute[74242]: </domain>
Oct 20 02:15:14 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1251057833',display_name='tempest-TestVolumeBootPattern-server-1251057833',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1251057833',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYHgQrnRlQ4jBKzblQ3DfxaEfVjuxo/NC6O+ICak+0aaFoFY7UzIhNxrdgQLtBAfBOsL0Lu2xLtyVpinmCCfqmljj/P6GdvFSKRfnZG4N6/Y2tUqR86uaxeDlehlPmATw==',key_name='tempest-TestVolumeBootPattern-887907135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-htfbbarl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:14:41Z,user_data=None,user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=b7b32e72-08ce-4afd-929c-6985b572767d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "60eff229-2859-4d2b-a9c9-f9539da0c608", "address": "fa:16:3e:f8:99:0a", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60eff229-28", "ovs_interfaceid": "60eff229-2859-4d2b-a9c9-f9539da0c608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "60eff229-2859-4d2b-a9c9-f9539da0c608", "address": "fa:16:3e:f8:99:0a", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60eff229-28", "ovs_interfaceid": "60eff229-2859-4d2b-a9c9-f9539da0c608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:99:0a,bridge_name='br-int',has_traffic_filtering=True,id=60eff229-2859-4d2b-a9c9-f9539da0c608,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60eff229-28') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG os_vif [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:99:0a,bridge_name='br-int',has_traffic_filtering=True,id=60eff229-2859-4d2b-a9c9-f9539da0c608,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60eff229-28') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc623045-1af6-57c1-86af-785f847ecafc', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap60eff229-28, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap60eff229-28, col_values=(('qos', UUID('5f5113e7-1918-44a9-8124-a6b000a32cf1')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap60eff229-28, col_values=(('external_ids', {'iface-id': '60eff229-2859-4d2b-a9c9-f9539da0c608', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:99:0a', 'vm-uuid': 'b7b32e72-08ce-4afd-929c-6985b572767d'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:14 user nova-compute[74242]: INFO os_vif [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:99:0a,bridge_name='br-int',has_traffic_filtering=True,id=60eff229-2859-4d2b-a9c9-f9539da0c608,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60eff229-28')
Oct 20 02:15:14 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] No VIF found with MAC fa:16:3e:f8:99:0a, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:15:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-16bab5fd-8a71-400a-ba5d-2dc26dedae7f req-8a9250bd-486e-4610-b2e4-61d35d487ac2 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Received event network-vif-plugged-60eff229-2859-4d2b-a9c9-f9539da0c608 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:15:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-16bab5fd-8a71-400a-ba5d-2dc26dedae7f req-8a9250bd-486e-4610-b2e4-61d35d487ac2 service nova] Acquiring lock "b7b32e72-08ce-4afd-929c-6985b572767d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-16bab5fd-8a71-400a-ba5d-2dc26dedae7f req-8a9250bd-486e-4610-b2e4-61d35d487ac2 service nova] Lock "b7b32e72-08ce-4afd-929c-6985b572767d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-16bab5fd-8a71-400a-ba5d-2dc26dedae7f req-8a9250bd-486e-4610-b2e4-61d35d487ac2 service nova] Lock "b7b32e72-08ce-4afd-929c-6985b572767d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-16bab5fd-8a71-400a-ba5d-2dc26dedae7f req-8a9250bd-486e-4610-b2e4-61d35d487ac2 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] No waiting events found dispatching network-vif-plugged-60eff229-2859-4d2b-a9c9-f9539da0c608 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:15:15 user nova-compute[74242]: WARNING nova.compute.manager [req-16bab5fd-8a71-400a-ba5d-2dc26dedae7f req-8a9250bd-486e-4610-b2e4-61d35d487ac2 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Received unexpected event network-vif-plugged-60eff229-2859-4d2b-a9c9-f9539da0c608 for instance with vm_state building and task_state spawning.
Oct 20 02:15:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:17 user nova-compute[74242]: DEBUG nova.compute.manager [req-fe76fbde-94a9-4e8a-a295-82b3f46d2e09 req-45a949eb-ab91-4f52-bf3f-8bc638f9121e service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Received event network-vif-plugged-60eff229-2859-4d2b-a9c9-f9539da0c608 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:15:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fe76fbde-94a9-4e8a-a295-82b3f46d2e09 req-45a949eb-ab91-4f52-bf3f-8bc638f9121e service nova] Acquiring lock "b7b32e72-08ce-4afd-929c-6985b572767d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fe76fbde-94a9-4e8a-a295-82b3f46d2e09 req-45a949eb-ab91-4f52-bf3f-8bc638f9121e service nova] Lock "b7b32e72-08ce-4afd-929c-6985b572767d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fe76fbde-94a9-4e8a-a295-82b3f46d2e09 req-45a949eb-ab91-4f52-bf3f-8bc638f9121e service nova] Lock "b7b32e72-08ce-4afd-929c-6985b572767d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:17 user nova-compute[74242]: DEBUG nova.compute.manager [req-fe76fbde-94a9-4e8a-a295-82b3f46d2e09 req-45a949eb-ab91-4f52-bf3f-8bc638f9121e service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] No waiting events found dispatching network-vif-plugged-60eff229-2859-4d2b-a9c9-f9539da0c608 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:15:17 user nova-compute[74242]: WARNING nova.compute.manager [req-fe76fbde-94a9-4e8a-a295-82b3f46d2e09 req-45a949eb-ab91-4f52-bf3f-8bc638f9121e service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Received unexpected event network-vif-plugged-60eff229-2859-4d2b-a9c9-f9539da0c608 for instance with vm_state building and task_state spawning.
Oct 20 02:15:18 user nova-compute[74242]: DEBUG nova.compute.manager [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:15:18 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:15:18 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Instance spawned successfully.
Oct 20 02:15:18 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:15:18 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:15:18 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:15:18 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:15:18 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:15:18 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:15:18 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:15:18 user nova-compute[74242]: INFO nova.compute.manager [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Took 5.59 seconds to spawn the instance on the hypervisor.
Oct 20 02:15:18 user nova-compute[74242]: DEBUG nova.compute.manager [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:15:18 user nova-compute[74242]: INFO nova.compute.manager [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Took 37.83 seconds to build instance.
Oct 20 02:15:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-87d3c30c-ef9f-464d-90d2-5e305eee031c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "b7b32e72-08ce-4afd-929c-6985b572767d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.959s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:31 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.compute.manager [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:15:32 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Creating image(s)
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Ensure instance console log exists: /opt/stack/data/nova/instances/3038a67c-0ffd-4652-a3d1-23e4bfda10fe/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Start _get_guest_xml network_info=[{"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '7a21ee95-d25a-4008-adb2-0151cff8562d', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AsWrHYCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3038a67c-0ffd-4652-a3d1-23e4bfda10fe', 'attached_at': '', 'detached_at': '', 'volume_id': '611b143e-0c8f-4e29-a344-97df041319f1', 'serial': '611b143e-0c8f-4e29-a344-97df041319f1'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:15:32 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:15:32 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AsWrHYCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:15:32 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:15:32 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:15:32 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ab9ef4f-9f15-4b2d-823c-de3d77987a12]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:15:32 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfabe72e-bc9a-4a63-bc7e-77d702fcef5c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1] added
Oct 20 02:15:32 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5b85ef-4614-4cdc-b4cb-bf5c8625c280]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4375ace8-39f1-4929-87f7-31c718276136]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AsWrHYCU {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AsWrHYCU" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc8a72f-483e-4014-ada2-e3bd56b8eb37]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AsWrHYCU'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c4d471-5e11-4e38-8072-8a13c5e21220]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[28f58bdf-a621-46a9-840e-9025a1eafbfd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:15:32 user nova-compute[74242]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:15:32 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:15:32 user nova-compute[74242]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:15:32 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c3db19e-18e0-4612-bf3c-25c219c96fc2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260]
Oct 20 02:15:32 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260] successful.
Oct 20 02:15:32 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[046ab092-3fef-4ffa-b7aa-611a679d20c7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8a18a6-8738-433f-baa9-d16874109c87]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:15:32 user nova-compute[74242]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:15:32 user nova-compute[74242]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:15:32 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:15:32 user nova-compute[74242]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:15:32 user nova-compute[74242]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:15:32 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] HCTL ('35', '-', '-', 0) found on session 30 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b371d31-853c-4e60-900c-d0a128ee8901]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Searching for a device in session 30 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:15:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AsWrHYCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23530663730306462', 'path': '/dev/sdd'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530663730306462', 'path': '/dev/sdd'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1719894790',display_name='tempest-ServerActionsTestOtherA-server-1719894790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1719894790',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB7bL+2x0x/JgolwV73wEpn90TfE93HD11kN8fWTUdskLHr/+qGh8YX2pmWaISRSrg9SBRQDQmulufko6eTLMYIA5vcJ4clYCIWnNXj2Hp2S/9mOnMK73v45XTwiydUrQ==',key_name='tempest-keypair-1706623376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cf9b187fe8443aba57a8c629d78978e',ramdisk_id='',reservation_id='r-z5rlmmsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2076229102',owner_user_name='tempest-ServerActionsTestOtherA-2076229102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:15:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1f488a444de49f5bed5351efd55dafa',uuid=3038a67c-0ffd-4652-a3d1-23e4bfda10fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converting VIF {"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:1a:d8,bridge_name='br-int',has_traffic_filtering=True,id=a8a2c2c1-7401-4115-8479-bb8939c1397f,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a2c2c1-74') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG nova.objects.instance [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lazy-loading 'pci_devices' on Instance uuid 3038a67c-0ffd-4652-a3d1-23e4bfda10fe {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:15:33 user nova-compute[74242]:   <uuid>3038a67c-0ffd-4652-a3d1-23e4bfda10fe</uuid>
Oct 20 02:15:33 user nova-compute[74242]:   <name>instance-0000001b</name>
Oct 20 02:15:33 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:15:33 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:15:33 user nova-compute[74242]:   <metadata>
Oct 20 02:15:33 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:15:33 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:15:33 user nova-compute[74242]:       <nova:name>tempest-ServerActionsTestOtherA-server-1719894790</nova:name>
Oct 20 02:15:33 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:15:32</nova:creationTime>
Oct 20 02:15:33 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:15:33 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:15:33 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:15:33 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:15:33 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:15:33 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:15:33 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:15:33 user nova-compute[74242]:       <nova:owner>
Oct 20 02:15:33 user nova-compute[74242]:         <nova:user uuid="c1f488a444de49f5bed5351efd55dafa">tempest-ServerActionsTestOtherA-2076229102-project-member</nova:user>
Oct 20 02:15:33 user nova-compute[74242]:         <nova:project uuid="5cf9b187fe8443aba57a8c629d78978e">tempest-ServerActionsTestOtherA-2076229102</nova:project>
Oct 20 02:15:33 user nova-compute[74242]:       </nova:owner>
Oct 20 02:15:33 user nova-compute[74242]:       <nova:ports>
Oct 20 02:15:33 user nova-compute[74242]:         <nova:port uuid="a8a2c2c1-7401-4115-8479-bb8939c1397f">
Oct 20 02:15:33 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 02:15:33 user nova-compute[74242]:         </nova:port>
Oct 20 02:15:33 user nova-compute[74242]:       </nova:ports>
Oct 20 02:15:33 user nova-compute[74242]:     </nova:instance>
Oct 20 02:15:33 user nova-compute[74242]:   </metadata>
Oct 20 02:15:33 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:15:33 user nova-compute[74242]:     <system>
Oct 20 02:15:33 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:15:33 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:15:33 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:15:33 user nova-compute[74242]:       <entry name="serial">3038a67c-0ffd-4652-a3d1-23e4bfda10fe</entry>
Oct 20 02:15:33 user nova-compute[74242]:       <entry name="uuid">3038a67c-0ffd-4652-a3d1-23e4bfda10fe</entry>
Oct 20 02:15:33 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:15:33 user nova-compute[74242]:     </system>
Oct 20 02:15:33 user nova-compute[74242]:   </sysinfo>
Oct 20 02:15:33 user nova-compute[74242]:   <os>
Oct 20 02:15:33 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:15:33 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:15:33 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:15:33 user nova-compute[74242]:   </os>
Oct 20 02:15:33 user nova-compute[74242]:   <features>
Oct 20 02:15:33 user nova-compute[74242]:     <acpi/>
Oct 20 02:15:33 user nova-compute[74242]:     <apic/>
Oct 20 02:15:33 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:15:33 user nova-compute[74242]:   </features>
Oct 20 02:15:33 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:15:33 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:15:33 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:15:33 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:15:33 user nova-compute[74242]:   </clock>
Oct 20 02:15:33 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:15:33 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:15:33 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:15:33 user nova-compute[74242]:   </cpu>
Oct 20 02:15:33 user nova-compute[74242]:   <devices>
Oct 20 02:15:33 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:15:33 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:15:33 user nova-compute[74242]:       <source dev="/dev/sdd"/>
Oct 20 02:15:33 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:15:33 user nova-compute[74242]:       <serial>611b143e-0c8f-4e29-a344-97df041319f1</serial>
Oct 20 02:15:33 user nova-compute[74242]:     </disk>
Oct 20 02:15:33 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:15:33 user nova-compute[74242]:       <mac address="fa:16:3e:02:1a:d8"/>
Oct 20 02:15:33 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:15:33 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:15:33 user nova-compute[74242]:       <target dev="tapa8a2c2c1-74"/>
Oct 20 02:15:33 user nova-compute[74242]:     </interface>
Oct 20 02:15:33 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:15:33 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/3038a67c-0ffd-4652-a3d1-23e4bfda10fe/console.log" append="off"/>
Oct 20 02:15:33 user nova-compute[74242]:     </serial>
Oct 20 02:15:33 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:15:33 user nova-compute[74242]:     <video>
Oct 20 02:15:33 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:15:33 user nova-compute[74242]:     </video>
Oct 20 02:15:33 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:15:33 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:15:33 user nova-compute[74242]:     </rng>
Oct 20 02:15:33 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:15:33 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:15:33 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:15:33 user nova-compute[74242]:     </memballoon>
Oct 20 02:15:33 user nova-compute[74242]:   </devices>
Oct 20 02:15:33 user nova-compute[74242]: </domain>
Oct 20 02:15:33 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1719894790',display_name='tempest-ServerActionsTestOtherA-server-1719894790',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1719894790',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB7bL+2x0x/JgolwV73wEpn90TfE93HD11kN8fWTUdskLHr/+qGh8YX2pmWaISRSrg9SBRQDQmulufko6eTLMYIA5vcJ4clYCIWnNXj2Hp2S/9mOnMK73v45XTwiydUrQ==',key_name='tempest-keypair-1706623376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5cf9b187fe8443aba57a8c629d78978e',ramdisk_id='',reservation_id='r-z5rlmmsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-2076229102',owner_user_name='tempest-ServerActionsTestOtherA-2076229102-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:15:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1f488a444de49f5bed5351efd55dafa',uuid=3038a67c-0ffd-4652-a3d1-23e4bfda10fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converting VIF {"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:1a:d8,bridge_name='br-int',has_traffic_filtering=True,id=a8a2c2c1-7401-4115-8479-bb8939c1397f,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a2c2c1-74') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG os_vif [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:1a:d8,bridge_name='br-int',has_traffic_filtering=True,id=a8a2c2c1-7401-4115-8479-bb8939c1397f,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a2c2c1-74') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e076415-b7d0-5058-8ee9-df04c72944fe', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8a2c2c1-74, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8a2c2c1-74, col_values=(('qos', UUID('03c723f9-639f-4514-bd39-6751eb68772d')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8a2c2c1-74, col_values=(('external_ids', {'iface-id': 'a8a2c2c1-7401-4115-8479-bb8939c1397f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:1a:d8', 'vm-uuid': '3038a67c-0ffd-4652-a3d1-23e4bfda10fe'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:15:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:33 user nova-compute[74242]: INFO os_vif [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:1a:d8,bridge_name='br-int',has_traffic_filtering=True,id=a8a2c2c1-7401-4115-8479-bb8939c1397f,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a2c2c1-74')
Oct 20 02:15:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:15:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] No VIF found with MAC fa:16:3e:02:1a:d8, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:15:34 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:15:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:15:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-39a5ba0f-e581-49c3-a179-62d6c333fa59" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:15:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-39a5ba0f-e581-49c3-a179-62d6c333fa59" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:15:34 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:15:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:34 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Updating instance_info_cache with network_info: [{"id": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "address": "fa:16:3e:79:1a:39", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57aa37e7-d4", "ovs_interfaceid": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:15:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-39a5ba0f-e581-49c3-a179-62d6c333fa59" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:15:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:15:34 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:15:35 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:15:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-a0ca287f-e59d-4e2e-8eef-13e5b10bb921 req-aa6c0788-68a7-4eb4-b32d-7a3a17432fb2 service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received event network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:15:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a0ca287f-e59d-4e2e-8eef-13e5b10bb921 req-aa6c0788-68a7-4eb4-b32d-7a3a17432fb2 service nova] Acquiring lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a0ca287f-e59d-4e2e-8eef-13e5b10bb921 req-aa6c0788-68a7-4eb4-b32d-7a3a17432fb2 service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a0ca287f-e59d-4e2e-8eef-13e5b10bb921 req-aa6c0788-68a7-4eb4-b32d-7a3a17432fb2 service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-a0ca287f-e59d-4e2e-8eef-13e5b10bb921 req-aa6c0788-68a7-4eb4-b32d-7a3a17432fb2 service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] No waiting events found dispatching network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:15:35 user nova-compute[74242]: WARNING nova.compute.manager [req-a0ca287f-e59d-4e2e-8eef-13e5b10bb921 req-aa6c0788-68a7-4eb4-b32d-7a3a17432fb2 service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received unexpected event network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f for instance with vm_state building and task_state spawning.
Oct 20 02:15:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:36 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:15:36 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:15:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:15:37 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:15:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:37 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:15:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-69893a1c-db09-4735-b0b4-a13b7103d249 req-546a2595-b6df-482e-8f69-96b7e7fb7859 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-changed-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:15:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-69893a1c-db09-4735-b0b4-a13b7103d249 req-546a2595-b6df-482e-8f69-96b7e7fb7859 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Refreshing instance network info cache due to event network-changed-bfec951d-2a9f-4fec-98a8-e9683bc83787. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:15:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-69893a1c-db09-4735-b0b4-a13b7103d249 req-546a2595-b6df-482e-8f69-96b7e7fb7859 service nova] Acquiring lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:15:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-69893a1c-db09-4735-b0b4-a13b7103d249 req-546a2595-b6df-482e-8f69-96b7e7fb7859 service nova] Acquired lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:15:37 user nova-compute[74242]: DEBUG nova.network.neutron [req-69893a1c-db09-4735-b0b4-a13b7103d249 req-546a2595-b6df-482e-8f69-96b7e7fb7859 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Refreshing network info cache for port bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:15:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-a3bfffdd-5d32-4946-b7d9-2d2f20c58694 req-09ecd722-312f-42a6-a910-da4e1e24307c service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received event network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a3bfffdd-5d32-4946-b7d9-2d2f20c58694 req-09ecd722-312f-42a6-a910-da4e1e24307c service nova] Acquiring lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a3bfffdd-5d32-4946-b7d9-2d2f20c58694 req-09ecd722-312f-42a6-a910-da4e1e24307c service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a3bfffdd-5d32-4946-b7d9-2d2f20c58694 req-09ecd722-312f-42a6-a910-da4e1e24307c service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-a3bfffdd-5d32-4946-b7d9-2d2f20c58694 req-09ecd722-312f-42a6-a910-da4e1e24307c service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] No waiting events found dispatching network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:15:38 user nova-compute[74242]: WARNING nova.compute.manager [req-a3bfffdd-5d32-4946-b7d9-2d2f20c58694 req-09ecd722-312f-42a6-a910-da4e1e24307c service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received unexpected event network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f for instance with vm_state building and task_state spawning.
Oct 20 02:15:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.network.neutron [req-69893a1c-db09-4735-b0b4-a13b7103d249 req-546a2595-b6df-482e-8f69-96b7e7fb7859 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updated VIF entry in instance network info cache for port bfec951d-2a9f-4fec-98a8-e9683bc83787. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.network.neutron [req-69893a1c-db09-4735-b0b4-a13b7103d249 req-546a2595-b6df-482e-8f69-96b7e7fb7859 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updating instance_info_cache with network_info: [{"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-69893a1c-db09-4735-b0b4-a13b7103d249 req-546a2595-b6df-482e-8f69-96b7e7fb7859 service nova] Releasing lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:15:38 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Instance spawned successfully.
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:15:38 user nova-compute[74242]: INFO nova.compute.manager [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Took 5.99 seconds to spawn the instance on the hypervisor.
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:38 user nova-compute[74242]: INFO nova.compute.manager [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Took 35.33 seconds to build instance.
Oct 20 02:15:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-df4e4237-6ac7-482a-85b6-69486b6005ef tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.434s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:15:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98e383a-e1e5-4130-9cc6-a9823db0b88c/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98e383a-e1e5-4130-9cc6-a9823db0b88c/disk.rescue --force-share --output=json" returned: 0 in 0.202s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98e383a-e1e5-4130-9cc6-a9823db0b88c/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c98e383a-e1e5-4130-9cc6-a9823db0b88c/disk.rescue --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:40 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:15:40 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:15:40 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7929MB free_disk=25.157604217529297GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:15:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:40 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:15:40 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:15:40 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c98e383a-e1e5-4130-9cc6-a9823db0b88c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:15:40 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2645af84-8ba4-4a34-beb1-9676cce3dc5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:15:40 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance b7b32e72-08ce-4afd-929c-6985b572767d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:15:40 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d1559836-bd5f-402d-b7b2-1ea2e613b362 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:15:40 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3038a67c-0ffd-4652-a3d1-23e4bfda10fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:15:40 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:15:40 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:15:40 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:15:40 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:15:40 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:15:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.464s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:42 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:15:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "00140923-ae97-40b6-a3a0-37215a45effc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "00140923-ae97-40b6-a3a0-37215a45effc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:53 user nova-compute[74242]: DEBUG nova.compute.manager [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:15:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:53 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:15:53 user nova-compute[74242]: INFO nova.compute.claims [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Claim successful on node user
Oct 20 02:15:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG nova.compute.manager [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG nova.compute.manager [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG nova.network.neutron [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:15:54 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:15:54 user nova-compute[74242]: DEBUG nova.compute.manager [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG nova.policy [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3069dcf63864aa08f632601c3a849c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74cc27f49384dc78190bd5d9ed7fab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG nova.compute.manager [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:15:54 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Creating image(s)
Oct 20 02:15:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "/opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "/opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "/opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.193s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.222s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk 1073741824" returned: 0 in 0.059s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:54 user nova-compute[74242]: DEBUG nova.network.neutron [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Successfully created port: e35dc654-660d-4088-9144-695a77478839 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:15:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.203s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:55 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:15:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:15:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:15:55 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Cannot resize image /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:15:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:15:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Ensure instance console log exists: /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:15:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:55 user nova-compute[74242]: DEBUG nova.network.neutron [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Successfully updated port: e35dc654-660d-4088-9144-695a77478839 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "refresh_cache-00140923-ae97-40b6-a3a0-37215a45effc" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquired lock "refresh_cache-00140923-ae97-40b6-a3a0-37215a45effc" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.network.neutron [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-7e306ccf-1502-4716-bfbb-8728564d85d6 req-510fb3c0-b9b1-4622-823a-82bfe2bfcccb service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Received event network-changed-e35dc654-660d-4088-9144-695a77478839 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-7e306ccf-1502-4716-bfbb-8728564d85d6 req-510fb3c0-b9b1-4622-823a-82bfe2bfcccb service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Refreshing instance network info cache due to event network-changed-e35dc654-660d-4088-9144-695a77478839. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7e306ccf-1502-4716-bfbb-8728564d85d6 req-510fb3c0-b9b1-4622-823a-82bfe2bfcccb service nova] Acquiring lock "refresh_cache-00140923-ae97-40b6-a3a0-37215a45effc" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.network.neutron [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.network.neutron [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Updating instance_info_cache with network_info: [{"id": "e35dc654-660d-4088-9144-695a77478839", "address": "fa:16:3e:b8:83:db", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35dc654-66", "ovs_interfaceid": "e35dc654-660d-4088-9144-695a77478839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Releasing lock "refresh_cache-00140923-ae97-40b6-a3a0-37215a45effc" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Instance network_info: |[{"id": "e35dc654-660d-4088-9144-695a77478839", "address": "fa:16:3e:b8:83:db", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35dc654-66", "ovs_interfaceid": "e35dc654-660d-4088-9144-695a77478839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7e306ccf-1502-4716-bfbb-8728564d85d6 req-510fb3c0-b9b1-4622-823a-82bfe2bfcccb service nova] Acquired lock "refresh_cache-00140923-ae97-40b6-a3a0-37215a45effc" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.network.neutron [req-7e306ccf-1502-4716-bfbb-8728564d85d6 req-510fb3c0-b9b1-4622-823a-82bfe2bfcccb service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Refreshing network info cache for port e35dc654-660d-4088-9144-695a77478839 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Start _get_guest_xml network_info=[{"id": "e35dc654-660d-4088-9144-695a77478839", "address": "fa:16:3e:b8:83:db", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35dc654-66", "ovs_interfaceid": "e35dc654-660d-4088-9144-695a77478839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:15:56 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:15:56 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1531114737',display_name='tempest-AttachVolumeNegativeTest-server-1531114737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1531114737',id=28,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPStTf9pKDNr4IG+SGqkXdwgPJvJgJTnvrGbK8kOq6efVfUeMyLZa1FVML8KjGSOj4ndys5STlW4xo7plz/y/1o1GUuu6oJ3XTnoq52lVNrcPPN6hMrjPJsTD1gDkgtShA==',key_name='tempest-keypair-1060541932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e74cc27f49384dc78190bd5d9ed7fab9',ramdisk_id='',reservation_id='r-s70o7t0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1292543897',owner_user_name='tempest-AttachVolumeNegativeTest-1292543897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:15:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3069dcf63864aa08f632601c3a849c5',uuid=00140923-ae97-40b6-a3a0-37215a45effc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e35dc654-660d-4088-9144-695a77478839", "address": "fa:16:3e:b8:83:db", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35dc654-66", "ovs_interfaceid": "e35dc654-660d-4088-9144-695a77478839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converting VIF {"id": "e35dc654-660d-4088-9144-695a77478839", "address": "fa:16:3e:b8:83:db", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35dc654-66", "ovs_interfaceid": "e35dc654-660d-4088-9144-695a77478839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:83:db,bridge_name='br-int',has_traffic_filtering=True,id=e35dc654-660d-4088-9144-695a77478839,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape35dc654-66') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.objects.instance [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lazy-loading 'pci_devices' on Instance uuid 00140923-ae97-40b6-a3a0-37215a45effc {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:15:56 user nova-compute[74242]:   <uuid>00140923-ae97-40b6-a3a0-37215a45effc</uuid>
Oct 20 02:15:56 user nova-compute[74242]:   <name>instance-0000001c</name>
Oct 20 02:15:56 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:15:56 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:15:56 user nova-compute[74242]:   <metadata>
Oct 20 02:15:56 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:15:56 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:15:56 user nova-compute[74242]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1531114737</nova:name>
Oct 20 02:15:56 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:15:56</nova:creationTime>
Oct 20 02:15:56 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:15:56 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:15:56 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:15:56 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:15:56 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:15:56 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:15:56 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:15:56 user nova-compute[74242]:       <nova:owner>
Oct 20 02:15:56 user nova-compute[74242]:         <nova:user uuid="d3069dcf63864aa08f632601c3a849c5">tempest-AttachVolumeNegativeTest-1292543897-project-member</nova:user>
Oct 20 02:15:56 user nova-compute[74242]:         <nova:project uuid="e74cc27f49384dc78190bd5d9ed7fab9">tempest-AttachVolumeNegativeTest-1292543897</nova:project>
Oct 20 02:15:56 user nova-compute[74242]:       </nova:owner>
Oct 20 02:15:56 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:15:56 user nova-compute[74242]:       <nova:ports>
Oct 20 02:15:56 user nova-compute[74242]:         <nova:port uuid="e35dc654-660d-4088-9144-695a77478839">
Oct 20 02:15:56 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 20 02:15:56 user nova-compute[74242]:         </nova:port>
Oct 20 02:15:56 user nova-compute[74242]:       </nova:ports>
Oct 20 02:15:56 user nova-compute[74242]:     </nova:instance>
Oct 20 02:15:56 user nova-compute[74242]:   </metadata>
Oct 20 02:15:56 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:15:56 user nova-compute[74242]:     <system>
Oct 20 02:15:56 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:15:56 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:15:56 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:15:56 user nova-compute[74242]:       <entry name="serial">00140923-ae97-40b6-a3a0-37215a45effc</entry>
Oct 20 02:15:56 user nova-compute[74242]:       <entry name="uuid">00140923-ae97-40b6-a3a0-37215a45effc</entry>
Oct 20 02:15:56 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:15:56 user nova-compute[74242]:     </system>
Oct 20 02:15:56 user nova-compute[74242]:   </sysinfo>
Oct 20 02:15:56 user nova-compute[74242]:   <os>
Oct 20 02:15:56 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:15:56 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:15:56 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:15:56 user nova-compute[74242]:   </os>
Oct 20 02:15:56 user nova-compute[74242]:   <features>
Oct 20 02:15:56 user nova-compute[74242]:     <acpi/>
Oct 20 02:15:56 user nova-compute[74242]:     <apic/>
Oct 20 02:15:56 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:15:56 user nova-compute[74242]:   </features>
Oct 20 02:15:56 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:15:56 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:15:56 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:15:56 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:15:56 user nova-compute[74242]:   </clock>
Oct 20 02:15:56 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:15:56 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:15:56 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:15:56 user nova-compute[74242]:   </cpu>
Oct 20 02:15:56 user nova-compute[74242]:   <devices>
Oct 20 02:15:56 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:15:56 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:15:56 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk"/>
Oct 20 02:15:56 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:15:56 user nova-compute[74242]:     </disk>
Oct 20 02:15:56 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:15:56 user nova-compute[74242]:       <mac address="fa:16:3e:b8:83:db"/>
Oct 20 02:15:56 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:15:56 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:15:56 user nova-compute[74242]:       <target dev="tape35dc654-66"/>
Oct 20 02:15:56 user nova-compute[74242]:     </interface>
Oct 20 02:15:56 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:15:56 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/console.log" append="off"/>
Oct 20 02:15:56 user nova-compute[74242]:     </serial>
Oct 20 02:15:56 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:15:56 user nova-compute[74242]:     <video>
Oct 20 02:15:56 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:15:56 user nova-compute[74242]:     </video>
Oct 20 02:15:56 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:15:56 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:15:56 user nova-compute[74242]:     </rng>
Oct 20 02:15:56 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:15:56 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:15:56 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:15:56 user nova-compute[74242]:     </memballoon>
Oct 20 02:15:56 user nova-compute[74242]:   </devices>
Oct 20 02:15:56 user nova-compute[74242]: </domain>
Oct 20 02:15:56 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1531114737',display_name='tempest-AttachVolumeNegativeTest-server-1531114737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1531114737',id=28,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPStTf9pKDNr4IG+SGqkXdwgPJvJgJTnvrGbK8kOq6efVfUeMyLZa1FVML8KjGSOj4ndys5STlW4xo7plz/y/1o1GUuu6oJ3XTnoq52lVNrcPPN6hMrjPJsTD1gDkgtShA==',key_name='tempest-keypair-1060541932',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e74cc27f49384dc78190bd5d9ed7fab9',ramdisk_id='',reservation_id='r-s70o7t0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1292543897',owner_user_name='tempest-AttachVolumeNegativeTest-1292543897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:15:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3069dcf63864aa08f632601c3a849c5',uuid=00140923-ae97-40b6-a3a0-37215a45effc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e35dc654-660d-4088-9144-695a77478839", "address": "fa:16:3e:b8:83:db", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35dc654-66", "ovs_interfaceid": "e35dc654-660d-4088-9144-695a77478839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converting VIF {"id": "e35dc654-660d-4088-9144-695a77478839", "address": "fa:16:3e:b8:83:db", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35dc654-66", "ovs_interfaceid": "e35dc654-660d-4088-9144-695a77478839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b8:83:db,bridge_name='br-int',has_traffic_filtering=True,id=e35dc654-660d-4088-9144-695a77478839,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape35dc654-66') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG os_vif [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:83:db,bridge_name='br-int',has_traffic_filtering=True,id=e35dc654-660d-4088-9144-695a77478839,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape35dc654-66') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f1f8a5f2-c660-5ca1-983c-4e32e10ef69f', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape35dc654-66, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape35dc654-66, col_values=(('qos', UUID('8e290efd-2e9c-4ac9-b12c-16b98df96bf5')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape35dc654-66, col_values=(('external_ids', {'iface-id': 'e35dc654-660d-4088-9144-695a77478839', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b8:83:db', 'vm-uuid': '00140923-ae97-40b6-a3a0-37215a45effc'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:56 user nova-compute[74242]: INFO os_vif [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b8:83:db,bridge_name='br-int',has_traffic_filtering=True,id=e35dc654-660d-4088-9144-695a77478839,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape35dc654-66')
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] No VIF found with MAC fa:16:3e:b8:83:db, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.network.neutron [req-7e306ccf-1502-4716-bfbb-8728564d85d6 req-510fb3c0-b9b1-4622-823a-82bfe2bfcccb service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Updated VIF entry in instance network info cache for port e35dc654-660d-4088-9144-695a77478839. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG nova.network.neutron [req-7e306ccf-1502-4716-bfbb-8728564d85d6 req-510fb3c0-b9b1-4622-823a-82bfe2bfcccb service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Updating instance_info_cache with network_info: [{"id": "e35dc654-660d-4088-9144-695a77478839", "address": "fa:16:3e:b8:83:db", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35dc654-66", "ovs_interfaceid": "e35dc654-660d-4088-9144-695a77478839", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:15:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7e306ccf-1502-4716-bfbb-8728564d85d6 req-510fb3c0-b9b1-4622-823a-82bfe2bfcccb service nova] Releasing lock "refresh_cache-00140923-ae97-40b6-a3a0-37215a45effc" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:15:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-2d4e1340-2909-4040-be39-17789e4cdbc0 req-3f41feee-7578-481e-a45b-45cbb1688bde service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Received event network-vif-plugged-e35dc654-660d-4088-9144-695a77478839 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:15:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2d4e1340-2909-4040-be39-17789e4cdbc0 req-3f41feee-7578-481e-a45b-45cbb1688bde service nova] Acquiring lock "00140923-ae97-40b6-a3a0-37215a45effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:15:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2d4e1340-2909-4040-be39-17789e4cdbc0 req-3f41feee-7578-481e-a45b-45cbb1688bde service nova] Lock "00140923-ae97-40b6-a3a0-37215a45effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:15:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2d4e1340-2909-4040-be39-17789e4cdbc0 req-3f41feee-7578-481e-a45b-45cbb1688bde service nova] Lock "00140923-ae97-40b6-a3a0-37215a45effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:15:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-2d4e1340-2909-4040-be39-17789e4cdbc0 req-3f41feee-7578-481e-a45b-45cbb1688bde service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] No waiting events found dispatching network-vif-plugged-e35dc654-660d-4088-9144-695a77478839 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:15:58 user nova-compute[74242]: WARNING nova.compute.manager [req-2d4e1340-2909-4040-be39-17789e4cdbc0 req-3f41feee-7578-481e-a45b-45cbb1688bde service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Received unexpected event network-vif-plugged-e35dc654-660d-4088-9144-695a77478839 for instance with vm_state building and task_state spawning.
Oct 20 02:15:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:15:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:00 user nova-compute[74242]: DEBUG nova.compute.manager [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:16:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:16:00 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Instance spawned successfully.
Oct 20 02:16:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:16:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:00 user nova-compute[74242]: INFO nova.compute.manager [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Took 5.78 seconds to spawn the instance on the hypervisor.
Oct 20 02:16:00 user nova-compute[74242]: DEBUG nova.compute.manager [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:16:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-e1b1db3e-95ea-48a4-9857-3d988e14764b req-cd0c5237-e644-4002-a828-4dceaad8900b service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Received event network-vif-plugged-e35dc654-660d-4088-9144-695a77478839 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e1b1db3e-95ea-48a4-9857-3d988e14764b req-cd0c5237-e644-4002-a828-4dceaad8900b service nova] Acquiring lock "00140923-ae97-40b6-a3a0-37215a45effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e1b1db3e-95ea-48a4-9857-3d988e14764b req-cd0c5237-e644-4002-a828-4dceaad8900b service nova] Lock "00140923-ae97-40b6-a3a0-37215a45effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e1b1db3e-95ea-48a4-9857-3d988e14764b req-cd0c5237-e644-4002-a828-4dceaad8900b service nova] Lock "00140923-ae97-40b6-a3a0-37215a45effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-e1b1db3e-95ea-48a4-9857-3d988e14764b req-cd0c5237-e644-4002-a828-4dceaad8900b service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] No waiting events found dispatching network-vif-plugged-e35dc654-660d-4088-9144-695a77478839 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:16:00 user nova-compute[74242]: WARNING nova.compute.manager [req-e1b1db3e-95ea-48a4-9857-3d988e14764b req-cd0c5237-e644-4002-a828-4dceaad8900b service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Received unexpected event network-vif-plugged-e35dc654-660d-4088-9144-695a77478839 for instance with vm_state building and task_state spawning.
Oct 20 02:16:00 user nova-compute[74242]: INFO nova.compute.manager [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Took 6.70 seconds to build instance.
Oct 20 02:16:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-734c0b69-abc3-464a-b228-422abb0a412b tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "00140923-ae97-40b6-a3a0-37215a45effc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.804s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:16:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:16:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:16:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:16:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-1f16e622-5cc1-40a8-9163-977b3b71bba3 req-7f1ee91a-224d-47fe-8378-a4ca6d059b48 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Received event network-changed-60eff229-2859-4d2b-a9c9-f9539da0c608 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-1f16e622-5cc1-40a8-9163-977b3b71bba3 req-7f1ee91a-224d-47fe-8378-a4ca6d059b48 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Refreshing instance network info cache due to event network-changed-60eff229-2859-4d2b-a9c9-f9539da0c608. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:16:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1f16e622-5cc1-40a8-9163-977b3b71bba3 req-7f1ee91a-224d-47fe-8378-a4ca6d059b48 service nova] Acquiring lock "refresh_cache-b7b32e72-08ce-4afd-929c-6985b572767d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:16:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1f16e622-5cc1-40a8-9163-977b3b71bba3 req-7f1ee91a-224d-47fe-8378-a4ca6d059b48 service nova] Acquired lock "refresh_cache-b7b32e72-08ce-4afd-929c-6985b572767d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:16:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-1f16e622-5cc1-40a8-9163-977b3b71bba3 req-7f1ee91a-224d-47fe-8378-a4ca6d059b48 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Refreshing network info cache for port 60eff229-2859-4d2b-a9c9-f9539da0c608 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:16:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "b7b32e72-08ce-4afd-929c-6985b572767d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "b7b32e72-08ce-4afd-929c-6985b572767d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "b7b32e72-08ce-4afd-929c-6985b572767d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "b7b32e72-08ce-4afd-929c-6985b572767d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "b7b32e72-08ce-4afd-929c-6985b572767d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:33 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:16:33 user nova-compute[74242]: DEBUG nova.network.neutron [req-1f16e622-5cc1-40a8-9163-977b3b71bba3 req-7f1ee91a-224d-47fe-8378-a4ca6d059b48 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Updated VIF entry in instance network info cache for port 60eff229-2859-4d2b-a9c9-f9539da0c608. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:16:33 user nova-compute[74242]: DEBUG nova.network.neutron [req-1f16e622-5cc1-40a8-9163-977b3b71bba3 req-7f1ee91a-224d-47fe-8378-a4ca6d059b48 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Updating instance_info_cache with network_info: [{"id": "60eff229-2859-4d2b-a9c9-f9539da0c608", "address": "fa:16:3e:f8:99:0a", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60eff229-28", "ovs_interfaceid": "60eff229-2859-4d2b-a9c9-f9539da0c608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:16:33 user nova-compute[74242]: INFO nova.compute.manager [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Terminating instance
Oct 20 02:16:33 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:16:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:16:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1f16e622-5cc1-40a8-9163-977b3b71bba3 req-7f1ee91a-224d-47fe-8378-a4ca6d059b48 service nova] Releasing lock "refresh_cache-b7b32e72-08ce-4afd-929c-6985b572767d" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:16:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:34 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Instance destroyed successfully.
Oct 20 02:16:34 user nova-compute[74242]: DEBUG nova.objects.instance [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lazy-loading 'resources' on Instance uuid b7b32e72-08ce-4afd-929c-6985b572767d {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:14:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1251057833',display_name='tempest-TestVolumeBootPattern-server-1251057833',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1251057833',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYHgQrnRlQ4jBKzblQ3DfxaEfVjuxo/NC6O+ICak+0aaFoFY7UzIhNxrdgQLtBAfBOsL0Lu2xLtyVpinmCCfqmljj/P6GdvFSKRfnZG4N6/Y2tUqR86uaxeDlehlPmATw==',key_name='tempest-TestVolumeBootPattern-887907135',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:15:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-htfbbarl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:15:18Z,user_data=None,user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=b7b32e72-08ce-4afd-929c-6985b572767d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "60eff229-2859-4d2b-a9c9-f9539da0c608", "address": "fa:16:3e:f8:99:0a", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60eff229-28", "ovs_interfaceid": "60eff229-2859-4d2b-a9c9-f9539da0c608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "60eff229-2859-4d2b-a9c9-f9539da0c608", "address": "fa:16:3e:f8:99:0a", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap60eff229-28", "ovs_interfaceid": "60eff229-2859-4d2b-a9c9-f9539da0c608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:99:0a,bridge_name='br-int',has_traffic_filtering=True,id=60eff229-2859-4d2b-a9c9-f9539da0c608,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60eff229-28') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_vif [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:99:0a,bridge_name='br-int',has_traffic_filtering=True,id=60eff229-2859-4d2b-a9c9-f9539da0c608,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60eff229-28') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap60eff229-28, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5f5113e7-1918-44a9-8124-a6b000a32cf1) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:34 user nova-compute[74242]: INFO os_vif [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:99:0a,bridge_name='br-int',has_traffic_filtering=True,id=60eff229-2859-4d2b-a9c9-f9539da0c608,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap60eff229-28')
Oct 20 02:16:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlohPgye', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:16:34 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[425e5a13-8659-4325-ac0b-8061a356830e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:16:34 user nova-compute[74242]: No targets found.
Oct 20 02:16:34 user nova-compute[74242]: iSNS:
Oct 20 02:16:34 user nova-compute[74242]: No targets found.
Oct 20 02:16:34 user nova-compute[74242]: STATIC:
Oct 20 02:16:34 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:16:34 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:16:34 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:16:34 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155
Oct 20 02:16:34 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:16:34 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:16:34 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1
Oct 20 02:16:34 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:16:34 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:16:34 user nova-compute[74242]: FIRMWARE:
Oct 20 02:16:34 user nova-compute[74242]: No targets found.
Oct 20 02:16:34 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:16:34 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:16:34 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[56246edd-e415-4f63-aca1-de0b6e9842f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dec137e-5fdc-4461-ad9f-52d81f646a4a]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:16:34 user nova-compute[74242]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:16:34 user nova-compute[74242]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:16:34 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:16:34 user nova-compute[74242]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:16:34 user nova-compute[74242]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:16:34 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d01896c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155'): ({'sdb'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Removing single pathed devices sdb {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c67b6d-7136-4821-8e14-4be713744e54]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[17823776-b577-4447-98f2-3abea9472425]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flushing IO for device /dev/sdb {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ed0b9f3-a1b7-4153-9981-d9731b954e7e]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.121s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fdab5f2-8740-4935-a1ff-7f7ad69e2ba3]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26637613835313933', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_13ce95cc', '/dev/disk/by-id/scsi-1SCST_BIO13ce95cc-f7a8519373e52fe5') {{(pid=85329) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeaeed52-73a1-491f-8ae6-0b15d9deb0e2]: (4, None) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4065523-60f6-4efb-83e0-42db9318e55f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[680a1eec-18d4-4d94-b443-c8354b39d4a7]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260]
Oct 20 02:16:34 user nova-compute[74242]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260] successful.
Oct 20 02:16:34 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd763d9-3ed5-42b5-83f9-dd48956a1c6f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== disconnect_volume: return (439ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:16:34 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Deleting instance files /opt/stack/data/nova/instances/b7b32e72-08ce-4afd-929c-6985b572767d_del
Oct 20 02:16:34 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Deletion of /opt/stack/data/nova/instances/b7b32e72-08ce-4afd-929c-6985b572767d_del complete
Oct 20 02:16:34 user nova-compute[74242]: INFO nova.compute.manager [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Took 1.37 seconds to destroy the instance on the hypervisor.
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "fdccf817-4784-472a-85d1-96b5cc37722c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:34 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:16:34 user nova-compute[74242]: INFO nova.compute.claims [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Claim successful on node user
Oct 20 02:16:35 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG nova.network.neutron [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:16:35 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:16:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG nova.policy [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b64ecd6426f429ba929925fca497c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7331dc1aa6464021bb371a8ebcf3a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-1cecca24-94ec-4235-a931-1ae072f3ac37 req-92fafa3c-1037-4970-b216-87fa01688a98 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Received event network-vif-deleted-60eff229-2859-4d2b-a9c9-f9539da0c608 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:35 user nova-compute[74242]: INFO nova.compute.manager [req-1cecca24-94ec-4235-a931-1ae072f3ac37 req-92fafa3c-1037-4970-b216-87fa01688a98 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Neutron deleted interface 60eff229-2859-4d2b-a9c9-f9539da0c608; detaching it from the instance and deleting it from the info cache
Oct 20 02:16:35 user nova-compute[74242]: DEBUG nova.network.neutron [req-1cecca24-94ec-4235-a931-1ae072f3ac37 req-92fafa3c-1037-4970-b216-87fa01688a98 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:16:35 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Creating image(s)
Oct 20 02:16:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "/opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "/opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "743671fbbbe910bc2946169c292b7ad5cab726e8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "743671fbbbe910bc2946169c292b7ad5cab726e8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:35 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Took 0.84 seconds to deallocate network for instance.
Oct 20 02:16:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-1cecca24-94ec-4235-a931-1ae072f3ac37 req-92fafa3c-1037-4970-b216-87fa01688a98 service nova] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Detach interface failed, port_id=60eff229-2859-4d2b-a9c9-f9539da0c608, reason: Instance b7b32e72-08ce-4afd-929c-6985b572767d could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:16:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8.part --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8.part --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:36 user nova-compute[74242]: DEBUG nova.virt.images [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] e5234cc4-11f6-4a2e-aabc-4d507a10c9e3 was qcow2, converting to raw {{(pid=74242) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 02:16:36 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:16:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8.part /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8.converted {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Successfully created port: 006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:16:36 user nova-compute[74242]: INFO nova.compute.manager [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: b7b32e72-08ce-4afd-929c-6985b572767d] Took 1.22 seconds to detach 1 volumes for instance.
Oct 20 02:16:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8.part /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8.converted" returned: 0 in 0.587s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8.converted --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8.converted --force-share --output=json" returned: 0 in 0.378s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "743671fbbbe910bc2946169c292b7ad5cab726e8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.706s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Updating instance_info_cache with network_info: [{"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-d1559836-bd5f-402d-b7b2-1ea2e613b362" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8 --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "743671fbbbe910bc2946169c292b7ad5cab726e8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "743671fbbbe910bc2946169c292b7ad5cab726e8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.527s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8 --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8,backing_fmt=raw /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:37 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Deleted allocations for instance b7b32e72-08ce-4afd-929c-6985b572767d
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8,backing_fmt=raw /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk 1073741824" returned: 0 in 0.058s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "743671fbbbe910bc2946169c292b7ad5cab726e8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.245s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d32f2f9c-f82a-42f4-85c9-ef16552ae42d tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "b7b32e72-08ce-4afd-929c-6985b572767d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.497s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Successfully updated port: 006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquired lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8 --force-share --output=json" returned: 0 in 0.169s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-006bad40-854f-48fd-8e17-ed7ba97c0400 req-87127c08-1033-40a7-bf5d-6b8cd93c0374 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received event network-changed-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-006bad40-854f-48fd-8e17-ed7ba97c0400 req-87127c08-1033-40a7-bf5d-6b8cd93c0374 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Refreshing instance network info cache due to event network-changed-006062cf-dcc6-4756-a074-1bf376c16abf. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-006bad40-854f-48fd-8e17-ed7ba97c0400 req-87127c08-1033-40a7-bf5d-6b8cd93c0374 service nova] Acquiring lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:16:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Cannot resize image /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Ensure instance console log exists: /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.network.neutron [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updating instance_info_cache with network_info: [{"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Releasing lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Instance network_info: |[{"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-006bad40-854f-48fd-8e17-ed7ba97c0400 req-87127c08-1033-40a7-bf5d-6b8cd93c0374 service nova] Acquired lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.network.neutron [req-006bad40-854f-48fd-8e17-ed7ba97c0400 req-87127c08-1033-40a7-bf5d-6b8cd93c0374 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Refreshing network info cache for port 006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Start _get_guest_xml network_info=[{"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T02:16:32Z,direct_url=<?>,disk_format='qcow2',id=e5234cc4-11f6-4a2e-aabc-4d507a10c9e3,min_disk=0,min_ram=0,name='tempest-scenario-img--2100818393',owner='7331dc1aa6464021bb371a8ebcf3a42b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T02:16:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'e5234cc4-11f6-4a2e-aabc-4d507a10c9e3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:16:38 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:16:38 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T02:16:32Z,direct_url=<?>,disk_format='qcow2',id=e5234cc4-11f6-4a2e-aabc-4d507a10c9e3,min_disk=0,min_ram=0,name='tempest-scenario-img--2100818393',owner='7331dc1aa6464021bb371a8ebcf3a42b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T02:16:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1250993369',display_name='tempest-TestMinimumBasicScenario-server-1250993369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1250993369',id=29,image_ref='e5234cc4-11f6-4a2e-aabc-4d507a10c9e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK58nK6/P7M9XX8Wto2o2Cy7i0fJFGM0D+C6eoGBe2je56k+b9odApg/kqd46JoZFSmd1A/ZjHKFUC29opF6ojgFuWZQ/K0Qwz/+Yn0qBXWUi5tHm6qeiPFv0smmEhnRw==',key_name='tempest-TestMinimumBasicScenario-1841214259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7331dc1aa6464021bb371a8ebcf3a42b',ramdisk_id='',reservation_id='r-0b9t5znw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e5234cc4-11f6-4a2e-aabc-4d507a10c9e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-504118242',owner_user_name='tempest-TestMinimumBasicScenario-504118242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:16:35Z,user_data=None,user_id='8b64ecd6426f429ba929925fca497c82',uuid=fdccf817-4784-472a-85d1-96b5cc37722c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converting VIF {"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:a9:46,bridge_name='br-int',has_traffic_filtering=True,id=006062cf-dcc6-4756-a074-1bf376c16abf,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap006062cf-dc') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.objects.instance [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lazy-loading 'pci_devices' on Instance uuid fdccf817-4784-472a-85d1-96b5cc37722c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:16:38 user nova-compute[74242]:   <uuid>fdccf817-4784-472a-85d1-96b5cc37722c</uuid>
Oct 20 02:16:38 user nova-compute[74242]:   <name>instance-0000001d</name>
Oct 20 02:16:38 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:16:38 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:16:38 user nova-compute[74242]:   <metadata>
Oct 20 02:16:38 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:16:38 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:16:38 user nova-compute[74242]:       <nova:name>tempest-TestMinimumBasicScenario-server-1250993369</nova:name>
Oct 20 02:16:38 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:16:38</nova:creationTime>
Oct 20 02:16:38 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:16:38 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:16:38 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:16:38 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:16:38 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:16:38 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:16:38 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:16:38 user nova-compute[74242]:       <nova:owner>
Oct 20 02:16:38 user nova-compute[74242]:         <nova:user uuid="8b64ecd6426f429ba929925fca497c82">tempest-TestMinimumBasicScenario-504118242-project-member</nova:user>
Oct 20 02:16:38 user nova-compute[74242]:         <nova:project uuid="7331dc1aa6464021bb371a8ebcf3a42b">tempest-TestMinimumBasicScenario-504118242</nova:project>
Oct 20 02:16:38 user nova-compute[74242]:       </nova:owner>
Oct 20 02:16:38 user nova-compute[74242]:       <nova:root type="image" uuid="e5234cc4-11f6-4a2e-aabc-4d507a10c9e3"/>
Oct 20 02:16:38 user nova-compute[74242]:       <nova:ports>
Oct 20 02:16:38 user nova-compute[74242]:         <nova:port uuid="006062cf-dcc6-4756-a074-1bf376c16abf">
Oct 20 02:16:38 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 02:16:38 user nova-compute[74242]:         </nova:port>
Oct 20 02:16:38 user nova-compute[74242]:       </nova:ports>
Oct 20 02:16:38 user nova-compute[74242]:     </nova:instance>
Oct 20 02:16:38 user nova-compute[74242]:   </metadata>
Oct 20 02:16:38 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:16:38 user nova-compute[74242]:     <system>
Oct 20 02:16:38 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:16:38 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:16:38 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:16:38 user nova-compute[74242]:       <entry name="serial">fdccf817-4784-472a-85d1-96b5cc37722c</entry>
Oct 20 02:16:38 user nova-compute[74242]:       <entry name="uuid">fdccf817-4784-472a-85d1-96b5cc37722c</entry>
Oct 20 02:16:38 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:16:38 user nova-compute[74242]:     </system>
Oct 20 02:16:38 user nova-compute[74242]:   </sysinfo>
Oct 20 02:16:38 user nova-compute[74242]:   <os>
Oct 20 02:16:38 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:16:38 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:16:38 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:16:38 user nova-compute[74242]:   </os>
Oct 20 02:16:38 user nova-compute[74242]:   <features>
Oct 20 02:16:38 user nova-compute[74242]:     <acpi/>
Oct 20 02:16:38 user nova-compute[74242]:     <apic/>
Oct 20 02:16:38 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:16:38 user nova-compute[74242]:   </features>
Oct 20 02:16:38 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:16:38 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:16:38 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:16:38 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:16:38 user nova-compute[74242]:   </clock>
Oct 20 02:16:38 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:16:38 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:16:38 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:16:38 user nova-compute[74242]:   </cpu>
Oct 20 02:16:38 user nova-compute[74242]:   <devices>
Oct 20 02:16:38 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:16:38 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:16:38 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk"/>
Oct 20 02:16:38 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:16:38 user nova-compute[74242]:     </disk>
Oct 20 02:16:38 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:16:38 user nova-compute[74242]:       <mac address="fa:16:3e:88:a9:46"/>
Oct 20 02:16:38 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:16:38 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:16:38 user nova-compute[74242]:       <target dev="tap006062cf-dc"/>
Oct 20 02:16:38 user nova-compute[74242]:     </interface>
Oct 20 02:16:38 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:16:38 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/console.log" append="off"/>
Oct 20 02:16:38 user nova-compute[74242]:     </serial>
Oct 20 02:16:38 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:16:38 user nova-compute[74242]:     <video>
Oct 20 02:16:38 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:16:38 user nova-compute[74242]:     </video>
Oct 20 02:16:38 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:16:38 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:16:38 user nova-compute[74242]:     </rng>
Oct 20 02:16:38 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:16:38 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:16:38 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:16:38 user nova-compute[74242]:     </memballoon>
Oct 20 02:16:38 user nova-compute[74242]:   </devices>
Oct 20 02:16:38 user nova-compute[74242]: </domain>
Oct 20 02:16:38 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1250993369',display_name='tempest-TestMinimumBasicScenario-server-1250993369',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1250993369',id=29,image_ref='e5234cc4-11f6-4a2e-aabc-4d507a10c9e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK58nK6/P7M9XX8Wto2o2Cy7i0fJFGM0D+C6eoGBe2je56k+b9odApg/kqd46JoZFSmd1A/ZjHKFUC29opF6ojgFuWZQ/K0Qwz/+Yn0qBXWUi5tHm6qeiPFv0smmEhnRw==',key_name='tempest-TestMinimumBasicScenario-1841214259',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7331dc1aa6464021bb371a8ebcf3a42b',ramdisk_id='',reservation_id='r-0b9t5znw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e5234cc4-11f6-4a2e-aabc-4d507a10c9e3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-504118242',owner_user_name='tempest-TestMinimumBasicScenario-504118242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:16:35Z,user_data=None,user_id='8b64ecd6426f429ba929925fca497c82',uuid=fdccf817-4784-472a-85d1-96b5cc37722c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converting VIF {"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:88:a9:46,bridge_name='br-int',has_traffic_filtering=True,id=006062cf-dcc6-4756-a074-1bf376c16abf,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap006062cf-dc') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG os_vif [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:a9:46,bridge_name='br-int',has_traffic_filtering=True,id=006062cf-dcc6-4756-a074-1bf376c16abf,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap006062cf-dc') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be17e708-d89f-5e30-b3e0-d06fe919dd25', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap006062cf-dc, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap006062cf-dc, col_values=(('qos', UUID('29c00bef-7294-4dee-b3be-0b3d71220fa6')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap006062cf-dc, col_values=(('external_ids', {'iface-id': '006062cf-dcc6-4756-a074-1bf376c16abf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:a9:46', 'vm-uuid': 'fdccf817-4784-472a-85d1-96b5cc37722c'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:38 user nova-compute[74242]: INFO os_vif [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:88:a9:46,bridge_name='br-int',has_traffic_filtering=True,id=006062cf-dcc6-4756-a074-1bf376c16abf,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap006062cf-dc')
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] No VIF found with MAC fa:16:3e:88:a9:46, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:16:38 user nova-compute[74242]: INFO nova.compute.manager [None req-95810c12-a103-424d-b620-0cfb6298eff1 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Unrescuing
Oct 20 02:16:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-95810c12-a103-424d-b620-0cfb6298eff1 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-95810c12-a103-424d-b620-0cfb6298eff1 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquired lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.network.neutron [None req-95810c12-a103-424d-b620-0cfb6298eff1 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.network.neutron [req-006bad40-854f-48fd-8e17-ed7ba97c0400 req-87127c08-1033-40a7-bf5d-6b8cd93c0374 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updated VIF entry in instance network info cache for port 006062cf-dcc6-4756-a074-1bf376c16abf. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG nova.network.neutron [req-006bad40-854f-48fd-8e17-ed7ba97c0400 req-87127c08-1033-40a7-bf5d-6b8cd93c0374 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updating instance_info_cache with network_info: [{"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:16:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-006bad40-854f-48fd-8e17-ed7ba97c0400 req-87127c08-1033-40a7-bf5d-6b8cd93c0374 service nova] Releasing lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG nova.network.neutron [None req-95810c12-a103-424d-b620-0cfb6298eff1 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Updating instance_info_cache with network_info: [{"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-95810c12-a103-424d-b620-0cfb6298eff1 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Releasing lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG nova.objects.instance [None req-95810c12-a103-424d-b620-0cfb6298eff1 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'flavor' on Instance uuid c98e383a-e1e5-4130-9cc6-a9823db0b88c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "d1559836-bd5f-402d-b7b2-1ea2e613b362" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:39 user nova-compute[74242]: INFO nova.compute.manager [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Terminating instance
Oct 20 02:16:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-c838cc39-1de7-45da-9995-6d92a0785117 req-ca106695-57ad-45c1-8641-68e2c431af6d service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received event network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c838cc39-1de7-45da-9995-6d92a0785117 req-ca106695-57ad-45c1-8641-68e2c431af6d service nova] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c838cc39-1de7-45da-9995-6d92a0785117 req-ca106695-57ad-45c1-8641-68e2c431af6d service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c838cc39-1de7-45da-9995-6d92a0785117 req-ca106695-57ad-45c1-8641-68e2c431af6d service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-c838cc39-1de7-45da-9995-6d92a0785117 req-ca106695-57ad-45c1-8641-68e2c431af6d service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] No waiting events found dispatching network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:16:40 user nova-compute[74242]: WARNING nova.compute.manager [req-c838cc39-1de7-45da-9995-6d92a0785117 req-ca106695-57ad-45c1-8641-68e2c431af6d service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received unexpected event network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf for instance with vm_state building and task_state spawning.
Oct 20 02:16:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:40 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Instance destroyed successfully.
Oct 20 02:16:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:41 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Instance destroyed successfully.
Oct 20 02:16:41 user nova-compute[74242]: DEBUG nova.objects.instance [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lazy-loading 'resources' on Instance uuid d1559836-bd5f-402d-b7b2-1ea2e613b362 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T02:10:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1898730605',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1898730605',id=21,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL45lC8uP88aLhPjVpFusc36EgxSMjXZFMi7kNkF3ISmf58aNyLJGlf6kN9rY1GLxONqaKngDD8N296JSE/ycrNLnxQHHeJNFHkBaGooBjeCsoqTZFQ43Lc0w8v+CVTfKQ==',key_name='tempest-keypair-1736999254',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:15:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a7a2695b5ad341e0afd133522f680bf9',ramdisk_id='',reservation_id='r-t0tvfa99',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-750275147',owner_user_name='tempest-AttachVolumeShelveTestJSON-750275147-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:15:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a3d6645596e24f24a216d2b4e7809073',uuid=d1559836-bd5f-402d-b7b2-1ea2e613b362,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converting VIF {"id": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "address": "fa:16:3e:4e:a2:94", "network": {"id": "9811a284-605e-49fb-851b-e6732b51ecad", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-1148432172-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.72", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a7a2695b5ad341e0afd133522f680bf9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75c2194c-b6", "ovs_interfaceid": "75c2194c-b6fc-4b52-8643-2137bd1d1235", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4e:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=75c2194c-b6fc-4b52-8643-2137bd1d1235,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c2194c-b6') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG os_vif [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=75c2194c-b6fc-4b52-8643-2137bd1d1235,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c2194c-b6') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75c2194c-b6, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7e27bb8-7310-4a0d-a0f7-a28f7d997708) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:41 user nova-compute[74242]: INFO os_vif [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4e:a2:94,bridge_name='br-int',has_traffic_filtering=True,id=75c2194c-b6fc-4b52-8643-2137bd1d1235,network=Network(9811a284-605e-49fb-851b-e6732b51ecad),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75c2194c-b6')
Oct 20 02:16:41 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Deleting instance files /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362_del
Oct 20 02:16:41 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Deletion of /opt/stack/data/nova/instances/d1559836-bd5f-402d-b7b2-1ea2e613b362_del complete
Oct 20 02:16:41 user nova-compute[74242]: INFO nova.compute.manager [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Took 1.73 seconds to destroy the instance on the hypervisor.
Oct 20 02:16:41 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:16:41 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-40cad2ae-01e1-4cd2-84a2-7fe6dcdebfe2 req-74ea91c5-1f42-4078-ab6a-6852c86b69d8 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received event network-vif-unplugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-40cad2ae-01e1-4cd2-84a2-7fe6dcdebfe2 req-74ea91c5-1f42-4078-ab6a-6852c86b69d8 service nova] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-40cad2ae-01e1-4cd2-84a2-7fe6dcdebfe2 req-74ea91c5-1f42-4078-ab6a-6852c86b69d8 service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-40cad2ae-01e1-4cd2-84a2-7fe6dcdebfe2 req-74ea91c5-1f42-4078-ab6a-6852c86b69d8 service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-40cad2ae-01e1-4cd2-84a2-7fe6dcdebfe2 req-74ea91c5-1f42-4078-ab6a-6852c86b69d8 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] No waiting events found dispatching network-vif-unplugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:16:42 user nova-compute[74242]: WARNING nova.compute.manager [req-40cad2ae-01e1-4cd2-84a2-7fe6dcdebfe2 req-74ea91c5-1f42-4078-ab6a-6852c86b69d8 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received unexpected event network-vif-unplugged-989425d9-6ff3-4460-9b24-aede590c961c for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:16:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-2fc3b9bc-aff9-477a-9a4a-0eb5960d17a9 req-5fcc4891-7786-43c6-836c-f7a8b6529c5e service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received event network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2fc3b9bc-aff9-477a-9a4a-0eb5960d17a9 req-5fcc4891-7786-43c6-836c-f7a8b6529c5e service nova] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2fc3b9bc-aff9-477a-9a4a-0eb5960d17a9 req-5fcc4891-7786-43c6-836c-f7a8b6529c5e service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2fc3b9bc-aff9-477a-9a4a-0eb5960d17a9 req-5fcc4891-7786-43c6-836c-f7a8b6529c5e service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-2fc3b9bc-aff9-477a-9a4a-0eb5960d17a9 req-5fcc4891-7786-43c6-836c-f7a8b6529c5e service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] No waiting events found dispatching network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:16:42 user nova-compute[74242]: WARNING nova.compute.manager [req-2fc3b9bc-aff9-477a-9a4a-0eb5960d17a9 req-5fcc4891-7786-43c6-836c-f7a8b6529c5e service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received unexpected event network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf for instance with vm_state building and task_state spawning.
Oct 20 02:16:42 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:16:42 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Took 1.03 seconds to deallocate network for instance.
Oct 20 02:16:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-e47e75cd-00cf-4526-a338-af8c2a14e03e req-4e25dd4b-28ed-47b5-93c9-8e6b4821e5d4 service nova] [instance: d1559836-bd5f-402d-b7b2-1ea2e613b362] Received event network-vif-deleted-75c2194c-b6fc-4b52-8643-2137bd1d1235 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.720s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:43 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Deleted allocations for instance d1559836-bd5f-402d-b7b2-1ea2e613b362
Oct 20 02:16:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-07ede532-7a2f-49cd-bd21-150032043b0d tempest-AttachVolumeShelveTestJSON-750275147 tempest-AttachVolumeShelveTestJSON-750275147-project-member] Lock "d1559836-bd5f-402d-b7b2-1ea2e613b362" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.692s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG nova.compute.manager [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:16:43 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Instance spawned successfully.
Oct 20 02:16:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:16:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:43 user nova-compute[74242]: INFO nova.compute.manager [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Took 8.49 seconds to spawn the instance on the hypervisor.
Oct 20 02:16:43 user nova-compute[74242]: DEBUG nova.compute.manager [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:16:44 user nova-compute[74242]: INFO nova.compute.manager [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Took 9.28 seconds to build instance.
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-648be1f7-beef-4046-859b-b0198e46e19f tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "fdccf817-4784-472a-85d1-96b5cc37722c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.378s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] No waiting events found dispatching network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:16:44 user nova-compute[74242]: WARNING nova.compute.manager [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received unexpected event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:16:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] No waiting events found dispatching network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:16:44 user nova-compute[74242]: WARNING nova.compute.manager [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received unexpected event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:16:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] No waiting events found dispatching network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:16:44 user nova-compute[74242]: WARNING nova.compute.manager [req-0cdf24ee-2ca4-4965-a53b-cd8319cafa61 req-70e36c6d-5bb1-4ef7-b4b9-bd1e7e489f6b service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received unexpected event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-95810c12-a103-424d-b620-0cfb6298eff1 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:16:45 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:16:45 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:16:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8045MB free_disk=25.052879333496094GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:16:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:16:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:16:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c98e383a-e1e5-4130-9cc6-a9823db0b88c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:16:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2645af84-8ba4-4a34-beb1-9676cce3dc5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:16:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3038a67c-0ffd-4652-a3d1-23e4bfda10fe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:16:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 00140923-ae97-40b6-a3a0-37215a45effc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:16:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance fdccf817-4784-472a-85d1-96b5cc37722c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:16:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:16:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:16:46 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:16:46 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:16:46 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:16:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.454s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:16:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:16:47 user nova-compute[74242]: INFO nova.compute.claims [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Claim successful on node user
Oct 20 02:16:48 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.433s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG nova.network.neutron [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:16:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:16:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG nova.policy [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c45749e114d745b3a9b15b45a9064430', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3a254f1387b4b929f5396d1db6c4ef8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:16:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Creating image(s)
Oct 20 02:16:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "/opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "/opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "/opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.216s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.204s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk 1073741824" returned: 0 in 0.072s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.284s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG nova.network.neutron [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Successfully created port: 29619557-d774-41f6-9094-cfce655bcd27 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.208s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Cannot resize image /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Ensure instance console log exists: /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:49 user nova-compute[74242]: DEBUG nova.network.neutron [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Successfully updated port: 29619557-d774-41f6-9094-cfce655bcd27 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "refresh_cache-5f96c71b-c391-42bd-8ac8-53ece7b302f5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquired lock "refresh_cache-5f96c71b-c391-42bd-8ac8-53ece7b302f5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.network.neutron [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-cf6c9c33-db4d-46f4-b2cc-c4349ee2367e req-91f864dd-160c-496f-bb7e-18305c18d414 service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Received event network-changed-29619557-d774-41f6-9094-cfce655bcd27 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-cf6c9c33-db4d-46f4-b2cc-c4349ee2367e req-91f864dd-160c-496f-bb7e-18305c18d414 service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Refreshing instance network info cache due to event network-changed-29619557-d774-41f6-9094-cfce655bcd27. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cf6c9c33-db4d-46f4-b2cc-c4349ee2367e req-91f864dd-160c-496f-bb7e-18305c18d414 service nova] Acquiring lock "refresh_cache-5f96c71b-c391-42bd-8ac8-53ece7b302f5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.network.neutron [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.network.neutron [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Updating instance_info_cache with network_info: [{"id": "29619557-d774-41f6-9094-cfce655bcd27", "address": "fa:16:3e:6b:ed:0a", "network": {"id": "694ee4ba-c5b8-4c34-a5c3-1bb34288136f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1990549718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3a254f1387b4b929f5396d1db6c4ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29619557-d7", "ovs_interfaceid": "29619557-d774-41f6-9094-cfce655bcd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Releasing lock "refresh_cache-5f96c71b-c391-42bd-8ac8-53ece7b302f5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Instance network_info: |[{"id": "29619557-d774-41f6-9094-cfce655bcd27", "address": "fa:16:3e:6b:ed:0a", "network": {"id": "694ee4ba-c5b8-4c34-a5c3-1bb34288136f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1990549718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3a254f1387b4b929f5396d1db6c4ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29619557-d7", "ovs_interfaceid": "29619557-d774-41f6-9094-cfce655bcd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cf6c9c33-db4d-46f4-b2cc-c4349ee2367e req-91f864dd-160c-496f-bb7e-18305c18d414 service nova] Acquired lock "refresh_cache-5f96c71b-c391-42bd-8ac8-53ece7b302f5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.network.neutron [req-cf6c9c33-db4d-46f4-b2cc-c4349ee2367e req-91f864dd-160c-496f-bb7e-18305c18d414 service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Refreshing network info cache for port 29619557-d774-41f6-9094-cfce655bcd27 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Start _get_guest_xml network_info=[{"id": "29619557-d774-41f6-9094-cfce655bcd27", "address": "fa:16:3e:6b:ed:0a", "network": {"id": "694ee4ba-c5b8-4c34-a5c3-1bb34288136f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1990549718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3a254f1387b4b929f5396d1db6c4ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29619557-d7", "ovs_interfaceid": "29619557-d774-41f6-9094-cfce655bcd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:16:50 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:16:50 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1329325275',display_name='tempest-SnapshotDataIntegrityTests-server-1329325275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1329325275',id=30,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiSXYFYGfUSraVsyGtd9r3KWI7RVgsKq3cTlz/zgtArLKh6HAxpaQ8leLb8KWga2aKLA16p62OMgB4BpLBPXQjqF/pmba/PF1P3Fz96U5oFyVIEru+aLgIwgNQDKVYvqw==',key_name='tempest-keypair-76504524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3a254f1387b4b929f5396d1db6c4ef8',ramdisk_id='',reservation_id='r-dr0cc6kx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1374608529',owner_user_name='tempest-SnapshotDataIntegrityTests-1374608529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:16:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c45749e114d745b3a9b15b45a9064430',uuid=5f96c71b-c391-42bd-8ac8-53ece7b302f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29619557-d774-41f6-9094-cfce655bcd27", "address": "fa:16:3e:6b:ed:0a", "network": {"id": "694ee4ba-c5b8-4c34-a5c3-1bb34288136f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1990549718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3a254f1387b4b929f5396d1db6c4ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29619557-d7", "ovs_interfaceid": "29619557-d774-41f6-9094-cfce655bcd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Converting VIF {"id": "29619557-d774-41f6-9094-cfce655bcd27", "address": "fa:16:3e:6b:ed:0a", "network": {"id": "694ee4ba-c5b8-4c34-a5c3-1bb34288136f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1990549718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3a254f1387b4b929f5396d1db6c4ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29619557-d7", "ovs_interfaceid": "29619557-d774-41f6-9094-cfce655bcd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ed:0a,bridge_name='br-int',has_traffic_filtering=True,id=29619557-d774-41f6-9094-cfce655bcd27,network=Network(694ee4ba-c5b8-4c34-a5c3-1bb34288136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29619557-d7') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.objects.instance [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lazy-loading 'pci_devices' on Instance uuid 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:16:50 user nova-compute[74242]:   <uuid>5f96c71b-c391-42bd-8ac8-53ece7b302f5</uuid>
Oct 20 02:16:50 user nova-compute[74242]:   <name>instance-0000001e</name>
Oct 20 02:16:50 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:16:50 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:16:50 user nova-compute[74242]:   <metadata>
Oct 20 02:16:50 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:16:50 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:16:50 user nova-compute[74242]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1329325275</nova:name>
Oct 20 02:16:50 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:16:50</nova:creationTime>
Oct 20 02:16:50 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:16:50 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:16:50 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:16:50 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:16:50 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:16:50 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:16:50 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:16:50 user nova-compute[74242]:       <nova:owner>
Oct 20 02:16:50 user nova-compute[74242]:         <nova:user uuid="c45749e114d745b3a9b15b45a9064430">tempest-SnapshotDataIntegrityTests-1374608529-project-member</nova:user>
Oct 20 02:16:50 user nova-compute[74242]:         <nova:project uuid="a3a254f1387b4b929f5396d1db6c4ef8">tempest-SnapshotDataIntegrityTests-1374608529</nova:project>
Oct 20 02:16:50 user nova-compute[74242]:       </nova:owner>
Oct 20 02:16:50 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:16:50 user nova-compute[74242]:       <nova:ports>
Oct 20 02:16:50 user nova-compute[74242]:         <nova:port uuid="29619557-d774-41f6-9094-cfce655bcd27">
Oct 20 02:16:50 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 02:16:50 user nova-compute[74242]:         </nova:port>
Oct 20 02:16:50 user nova-compute[74242]:       </nova:ports>
Oct 20 02:16:50 user nova-compute[74242]:     </nova:instance>
Oct 20 02:16:50 user nova-compute[74242]:   </metadata>
Oct 20 02:16:50 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:16:50 user nova-compute[74242]:     <system>
Oct 20 02:16:50 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:16:50 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:16:50 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:16:50 user nova-compute[74242]:       <entry name="serial">5f96c71b-c391-42bd-8ac8-53ece7b302f5</entry>
Oct 20 02:16:50 user nova-compute[74242]:       <entry name="uuid">5f96c71b-c391-42bd-8ac8-53ece7b302f5</entry>
Oct 20 02:16:50 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:16:50 user nova-compute[74242]:     </system>
Oct 20 02:16:50 user nova-compute[74242]:   </sysinfo>
Oct 20 02:16:50 user nova-compute[74242]:   <os>
Oct 20 02:16:50 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:16:50 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:16:50 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:16:50 user nova-compute[74242]:   </os>
Oct 20 02:16:50 user nova-compute[74242]:   <features>
Oct 20 02:16:50 user nova-compute[74242]:     <acpi/>
Oct 20 02:16:50 user nova-compute[74242]:     <apic/>
Oct 20 02:16:50 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:16:50 user nova-compute[74242]:   </features>
Oct 20 02:16:50 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:16:50 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:16:50 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:16:50 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:16:50 user nova-compute[74242]:   </clock>
Oct 20 02:16:50 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:16:50 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:16:50 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:16:50 user nova-compute[74242]:   </cpu>
Oct 20 02:16:50 user nova-compute[74242]:   <devices>
Oct 20 02:16:50 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:16:50 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:16:50 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk"/>
Oct 20 02:16:50 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:16:50 user nova-compute[74242]:     </disk>
Oct 20 02:16:50 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:16:50 user nova-compute[74242]:       <mac address="fa:16:3e:6b:ed:0a"/>
Oct 20 02:16:50 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:16:50 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:16:50 user nova-compute[74242]:       <target dev="tap29619557-d7"/>
Oct 20 02:16:50 user nova-compute[74242]:     </interface>
Oct 20 02:16:50 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:16:50 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/console.log" append="off"/>
Oct 20 02:16:50 user nova-compute[74242]:     </serial>
Oct 20 02:16:50 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:16:50 user nova-compute[74242]:     <video>
Oct 20 02:16:50 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:16:50 user nova-compute[74242]:     </video>
Oct 20 02:16:50 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:16:50 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:16:50 user nova-compute[74242]:     </rng>
Oct 20 02:16:50 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:16:50 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:16:50 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:16:50 user nova-compute[74242]:     </memballoon>
Oct 20 02:16:50 user nova-compute[74242]:   </devices>
Oct 20 02:16:50 user nova-compute[74242]: </domain>
Oct 20 02:16:50 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1329325275',display_name='tempest-SnapshotDataIntegrityTests-server-1329325275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1329325275',id=30,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiSXYFYGfUSraVsyGtd9r3KWI7RVgsKq3cTlz/zgtArLKh6HAxpaQ8leLb8KWga2aKLA16p62OMgB4BpLBPXQjqF/pmba/PF1P3Fz96U5oFyVIEru+aLgIwgNQDKVYvqw==',key_name='tempest-keypair-76504524',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a3a254f1387b4b929f5396d1db6c4ef8',ramdisk_id='',reservation_id='r-dr0cc6kx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1374608529',owner_user_name='tempest-SnapshotDataIntegrityTests-1374608529-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:16:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c45749e114d745b3a9b15b45a9064430',uuid=5f96c71b-c391-42bd-8ac8-53ece7b302f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "29619557-d774-41f6-9094-cfce655bcd27", "address": "fa:16:3e:6b:ed:0a", "network": {"id": "694ee4ba-c5b8-4c34-a5c3-1bb34288136f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1990549718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3a254f1387b4b929f5396d1db6c4ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29619557-d7", "ovs_interfaceid": "29619557-d774-41f6-9094-cfce655bcd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Converting VIF {"id": "29619557-d774-41f6-9094-cfce655bcd27", "address": "fa:16:3e:6b:ed:0a", "network": {"id": "694ee4ba-c5b8-4c34-a5c3-1bb34288136f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1990549718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3a254f1387b4b929f5396d1db6c4ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29619557-d7", "ovs_interfaceid": "29619557-d774-41f6-9094-cfce655bcd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ed:0a,bridge_name='br-int',has_traffic_filtering=True,id=29619557-d774-41f6-9094-cfce655bcd27,network=Network(694ee4ba-c5b8-4c34-a5c3-1bb34288136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29619557-d7') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG os_vif [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ed:0a,bridge_name='br-int',has_traffic_filtering=True,id=29619557-d774-41f6-9094-cfce655bcd27,network=Network(694ee4ba-c5b8-4c34-a5c3-1bb34288136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29619557-d7') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cd7e580-df2d-55c3-89ce-aadb4ea351c2', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap29619557-d7, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap29619557-d7, col_values=(('qos', UUID('8e4302d7-f5a9-4a94-bb12-bb1628ab7e1e')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap29619557-d7, col_values=(('external_ids', {'iface-id': '29619557-d774-41f6-9094-cfce655bcd27', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6b:ed:0a', 'vm-uuid': '5f96c71b-c391-42bd-8ac8-53ece7b302f5'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:50 user nova-compute[74242]: INFO os_vif [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6b:ed:0a,bridge_name='br-int',has_traffic_filtering=True,id=29619557-d774-41f6-9094-cfce655bcd27,network=Network(694ee4ba-c5b8-4c34-a5c3-1bb34288136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29619557-d7')
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] No VIF found with MAC fa:16:3e:6b:ed:0a, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.network.neutron [req-cf6c9c33-db4d-46f4-b2cc-c4349ee2367e req-91f864dd-160c-496f-bb7e-18305c18d414 service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Updated VIF entry in instance network info cache for port 29619557-d774-41f6-9094-cfce655bcd27. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG nova.network.neutron [req-cf6c9c33-db4d-46f4-b2cc-c4349ee2367e req-91f864dd-160c-496f-bb7e-18305c18d414 service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Updating instance_info_cache with network_info: [{"id": "29619557-d774-41f6-9094-cfce655bcd27", "address": "fa:16:3e:6b:ed:0a", "network": {"id": "694ee4ba-c5b8-4c34-a5c3-1bb34288136f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1990549718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3a254f1387b4b929f5396d1db6c4ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29619557-d7", "ovs_interfaceid": "29619557-d774-41f6-9094-cfce655bcd27", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:16:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cf6c9c33-db4d-46f4-b2cc-c4349ee2367e req-91f864dd-160c-496f-bb7e-18305c18d414 service nova] Releasing lock "refresh_cache-5f96c71b-c391-42bd-8ac8-53ece7b302f5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:16:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-015ba7db-f605-404b-890a-ca1f751dc89e req-6c7cca85-298c-4792-ac4b-5b529c028a9a service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Received event network-vif-plugged-29619557-d774-41f6-9094-cfce655bcd27 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-015ba7db-f605-404b-890a-ca1f751dc89e req-6c7cca85-298c-4792-ac4b-5b529c028a9a service nova] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-015ba7db-f605-404b-890a-ca1f751dc89e req-6c7cca85-298c-4792-ac4b-5b529c028a9a service nova] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-015ba7db-f605-404b-890a-ca1f751dc89e req-6c7cca85-298c-4792-ac4b-5b529c028a9a service nova] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-015ba7db-f605-404b-890a-ca1f751dc89e req-6c7cca85-298c-4792-ac4b-5b529c028a9a service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] No waiting events found dispatching network-vif-plugged-29619557-d774-41f6-9094-cfce655bcd27 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:16:52 user nova-compute[74242]: WARNING nova.compute.manager [req-015ba7db-f605-404b-890a-ca1f751dc89e req-6c7cca85-298c-4792-ac4b-5b529c028a9a service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Received unexpected event network-vif-plugged-29619557-d774-41f6-9094-cfce655bcd27 for instance with vm_state building and task_state spawning.
Oct 20 02:16:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.compute.manager [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:16:54 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Instance spawned successfully.
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:16:54 user nova-compute[74242]: INFO nova.compute.manager [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Took 5.67 seconds to spawn the instance on the hypervisor.
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.compute.manager [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Received event network-vif-plugged-29619557-d774-41f6-9094-cfce655bcd27 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] No waiting events found dispatching network-vif-plugged-29619557-d774-41f6-9094-cfce655bcd27 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:16:54 user nova-compute[74242]: WARNING nova.compute.manager [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Received unexpected event network-vif-plugged-29619557-d774-41f6-9094-cfce655bcd27 for instance with vm_state building and task_state spawning.
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Received event network-changed-4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Refreshing instance network info cache due to event network-changed-4e64f25c-d50c-4c69-950d-1bccc487367c. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] Acquiring lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] Acquired lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.network.neutron [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Refreshing network info cache for port 4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:16:54 user nova-compute[74242]: INFO nova.compute.manager [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Took 6.56 seconds to build instance.
Oct 20 02:16:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-837bc69d-ec34-4721-b7d2-4d5593e6ac2d tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.699s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.network.neutron [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updated VIF entry in instance network info cache for port 4e64f25c-d50c-4c69-950d-1bccc487367c. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.network.neutron [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updating instance_info_cache with network_info: [{"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] Releasing lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received event network-changed-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Refreshing instance network info cache due to event network-changed-a8a2c2c1-7401-4115-8479-bb8939c1397f. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] Acquiring lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] Acquired lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:16:54 user nova-compute[74242]: DEBUG nova.network.neutron [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Refreshing network info cache for port a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:16:55 user nova-compute[74242]: DEBUG nova.network.neutron [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Updated VIF entry in instance network info cache for port a8a2c2c1-7401-4115-8479-bb8939c1397f. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:16:55 user nova-compute[74242]: DEBUG nova.network.neutron [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Updating instance_info_cache with network_info: [{"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:16:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1a179367-d737-4c7b-869f-92f6070264f2 req-6999b78a-b288-4e85-b539-679c8450999d service nova] Releasing lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:16:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Stashing vm_state: active {{(pid=74242) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 02:16:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:56 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:16:56 user nova-compute[74242]: INFO nova.compute.claims [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Claim successful on node user
Oct 20 02:16:56 user nova-compute[74242]: INFO nova.compute.resource_tracker [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Updating resource usage from migration 9216e329-8936-4b18-8440-69345512291b
Oct 20 02:16:56 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:16:57 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:16:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.416s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:57 user nova-compute[74242]: INFO nova.compute.manager [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Migrating
Oct 20 02:16:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:16:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:16:57 user nova-compute[74242]: INFO nova.compute.rpcapi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 20 02:16:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:16:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:16:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquired lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:16:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:16:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Updating instance_info_cache with network_info: [{"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:16:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Releasing lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:16:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Starting migrate_disk_and_power_off {{(pid=74242) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 02:16:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-821dcb00-251d-4f4a-8f44-b22fe753a52a req-14e0e0df-2d71-4a19-9001-f8c769a58ed1 service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received event network-vif-unplugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-821dcb00-251d-4f4a-8f44-b22fe753a52a req-14e0e0df-2d71-4a19-9001-f8c769a58ed1 service nova] Acquiring lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-821dcb00-251d-4f4a-8f44-b22fe753a52a req-14e0e0df-2d71-4a19-9001-f8c769a58ed1 service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-821dcb00-251d-4f4a-8f44-b22fe753a52a req-14e0e0df-2d71-4a19-9001-f8c769a58ed1 service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-821dcb00-251d-4f4a-8f44-b22fe753a52a req-14e0e0df-2d71-4a19-9001-f8c769a58ed1 service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] No waiting events found dispatching network-vif-unplugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:16:58 user nova-compute[74242]: WARNING nova.compute.manager [req-821dcb00-251d-4f4a-8f44-b22fe753a52a req-14e0e0df-2d71-4a19-9001-f8c769a58ed1 service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received unexpected event network-vif-unplugged-a8a2c2c1-7401-4115-8479-bb8939c1397f for instance with vm_state active and task_state resize_migrating.
Oct 20 02:16:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:58 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Instance destroyed successfully.
Oct 20 02:16:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1719894790',display_name='tempest-ServerActionsTestOtherA-server-1719894790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1719894790',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB7bL+2x0x/JgolwV73wEpn90TfE93HD11kN8fWTUdskLHr/+qGh8YX2pmWaISRSrg9SBRQDQmulufko6eTLMYIA5vcJ4clYCIWnNXj2Hp2S/9mOnMK73v45XTwiydUrQ==',key_name='tempest-keypair-1706623376',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:15:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5cf9b187fe8443aba57a8c629d78978e',ramdisk_id='',reservation_id='r-z5rlmmsm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2076229102',owner_user_name='tempest-ServerActionsTestOtherA-2076229102-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:16:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1f488a444de49f5bed5351efd55dafa',uuid=3038a67c-0ffd-4652-a3d1-23e4bfda10fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2013478958-network", "vif_mac": "fa:16:3e:02:1a:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converting VIF {"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2013478958-network", "vif_mac": "fa:16:3e:02:1a:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:1a:d8,bridge_name='br-int',has_traffic_filtering=True,id=a8a2c2c1-7401-4115-8479-bb8939c1397f,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a2c2c1-74') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_vif [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:1a:d8,bridge_name='br-int',has_traffic_filtering=True,id=a8a2c2c1-7401-4115-8479-bb8939c1397f,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a2c2c1-74') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8a2c2c1-74, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=03c723f9-639f-4514-bd39-6751eb68772d) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:16:58 user nova-compute[74242]: INFO os_vif [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:1a:d8,bridge_name='br-int',has_traffic_filtering=True,id=a8a2c2c1-7401-4115-8479-bb8939c1397f,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a2c2c1-74')
Oct 20 02:16:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AsWrHYCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:16:58 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45342cb-cbd1-445d-90d3-1135db7d2580]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:16:58 user nova-compute[74242]: No targets found.
Oct 20 02:16:58 user nova-compute[74242]: iSNS:
Oct 20 02:16:58 user nova-compute[74242]: No targets found.
Oct 20 02:16:58 user nova-compute[74242]: STATIC:
Oct 20 02:16:58 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:16:58 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:16:58 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:16:58 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1
Oct 20 02:16:58 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:16:58 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:16:58 user nova-compute[74242]: FIRMWARE:
Oct 20 02:16:58 user nova-compute[74242]: No targets found.
Oct 20 02:16:58 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:16:58 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:16:58 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed183d78-adcd-4d93-b1ee-822ccd9c467f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[939dd215-c3a0-42d3-92a8-ee9545271f56]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:16:58 user nova-compute[74242]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:16:58 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:16:58 user nova-compute[74242]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:16:58 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b86a2a70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1'): ({'sdd'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Removing single pathed devices sdd {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f080e71f-f6f4-4379-a422-b6366d80bfb2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b03179-3301-41af-86b9-48669d97335a]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Flushing IO for device /dev/sdd {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff1a1da0-1a08-4027-ae23-1e6fd8f495f8]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8d3698-dd66-49a2-a05b-5fbe989851e0]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4610e382-ed04-4c7b-a7e8-25bcf550a8e6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b9d6db-270d-461c-9065-d6bdff2bf347]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260]
Oct 20 02:16:58 user nova-compute[74242]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260] successful.
Oct 20 02:16:58 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cca61497-7bbc-4494-b1ec-cecb3310a827]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] <== disconnect_volume: return (320ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:16:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:16:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Port a8a2c2c1-7401-4115-8479-bb8939c1397f binding to destination host user is already ACTIVE {{(pid=74242) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-461e8b0f-04de-4f3e-9bb0-e38dcd0b4141 req-d3416bb8-98a9-4a4a-83b1-f1ed72fd7622 service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received event network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-461e8b0f-04de-4f3e-9bb0-e38dcd0b4141 req-d3416bb8-98a9-4a4a-83b1-f1ed72fd7622 service nova] Acquiring lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-461e8b0f-04de-4f3e-9bb0-e38dcd0b4141 req-d3416bb8-98a9-4a4a-83b1-f1ed72fd7622 service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-461e8b0f-04de-4f3e-9bb0-e38dcd0b4141 req-d3416bb8-98a9-4a4a-83b1-f1ed72fd7622 service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-461e8b0f-04de-4f3e-9bb0-e38dcd0b4141 req-d3416bb8-98a9-4a4a-83b1-f1ed72fd7622 service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] No waiting events found dispatching network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:17:00 user nova-compute[74242]: WARNING nova.compute.manager [req-461e8b0f-04de-4f3e-9bb0-e38dcd0b4141 req-d3416bb8-98a9-4a4a-83b1-f1ed72fd7622 service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received unexpected event network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f for instance with vm_state active and task_state resize_migrating.
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquired lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Updating instance_info_cache with network_info: [{"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Releasing lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG os_brick.utils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87835b4-e889-46c5-8608-51e34031e783]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa1775c-30c8-4ff3-b0c2-12cde57d2275]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[af523aa0-a843-486d-8031-2adcaee6571e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7452f9fc-538d-4276-9172-41bccb8677c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:17:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:17:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:17:01 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:17:01 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b99fd64e-6050-4262-bbad-5ec6324de8fd]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:17:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:17:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:17:01 user nova-compute[74242]: DEBUG os_brick.utils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:17:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Starting finish_migration {{(pid=74242) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Instance directory exists: not creating {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 02:17:17 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Creating image(s)
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Ensure instance console log exists: /opt/stack/data/nova/instances/3038a67c-0ffd-4652-a3d1-23e4bfda10fe/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Start _get_guest_xml network_info=[{"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2013478958-network", "vif_mac": "fa:16:3e:02:1a:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '50a39742-9741-4ee0-be6b-78241f6b2fe1', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AsWrHYCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '3038a67c-0ffd-4652-a3d1-23e4bfda10fe', 'attached_at': '2023-10-20T02:17:18.000000', 'detached_at': '', 'volume_id': '611b143e-0c8f-4e29-a344-97df041319f1', 'serial': '611b143e-0c8f-4e29-a344-97df041319f1'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:17:17 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:17:17 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AsWrHYCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:17:17 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:17:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:17:17 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:17:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:17:17 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:17:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed69c8ba-0677-46df-9215-27b532530572]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:17:17 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ff8bf2-9aa6-4979-a54b-01a2a9303247]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1] added
Oct 20 02:17:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[63079753-6484-4a34-9801-db0d650695a0]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4398f06c-8449-48c4-a589-e6a2f14a21b5]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AsWrHYCU {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AsWrHYCU" returned: 0 in 0.035s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1262431b-55b8-4f67-a0d3-4bfccf8c1ca3]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AsWrHYCU'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d6fce2d-1016-4b5c-8e65-61401dcd09c6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6672fe4-263f-4432-8eea-83c145204287]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:17:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:17:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0707633e-9f69-4680-8c16-f3d107d6b289]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260]
Oct 20 02:17:18 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260] successful.
Oct 20 02:17:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[73444620-6ac3-424c-899e-9e45e1867e27]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d860d44e-081d-41bb-912d-fe3551bbf9ff]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:17:18 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:17:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:17:18 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:17:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ad9304-1630-442b-bc03-f2eeb626b1d4]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AsWrHYCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:17:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23530663730306462', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23530663730306462', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1719894790',display_name='tempest-ServerActionsTestOtherA-server-1719894790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1719894790',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB7bL+2x0x/JgolwV73wEpn90TfE93HD11kN8fWTUdskLHr/+qGh8YX2pmWaISRSrg9SBRQDQmulufko6eTLMYIA5vcJ4clYCIWnNXj2Hp2S/9mOnMK73v45XTwiydUrQ==',key_name='tempest-keypair-1706623376',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:15:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5cf9b187fe8443aba57a8c629d78978e',ramdisk_id='',reservation_id='r-z5rlmmsm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2076229102',owner_user_name='tempest-ServerActionsTestOtherA-2076229102-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1f488a444de49f5bed5351efd55dafa',uuid=3038a67c-0ffd-4652-a3d1-23e4bfda10fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2013478958-network", "vif_mac": "fa:16:3e:02:1a:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converting VIF {"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2013478958-network", "vif_mac": "fa:16:3e:02:1a:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:1a:d8,bridge_name='br-int',has_traffic_filtering=True,id=a8a2c2c1-7401-4115-8479-bb8939c1397f,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a2c2c1-74') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:17:19 user nova-compute[74242]:   <uuid>3038a67c-0ffd-4652-a3d1-23e4bfda10fe</uuid>
Oct 20 02:17:19 user nova-compute[74242]:   <name>instance-0000001b</name>
Oct 20 02:17:19 user nova-compute[74242]:   <memory>2097152</memory>
Oct 20 02:17:19 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:17:19 user nova-compute[74242]:   <metadata>
Oct 20 02:17:19 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:17:19 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:17:19 user nova-compute[74242]:       <nova:name>tempest-ServerActionsTestOtherA-server-1719894790</nova:name>
Oct 20 02:17:19 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:17:17</nova:creationTime>
Oct 20 02:17:19 user nova-compute[74242]:       <nova:flavor name="m1.small">
Oct 20 02:17:19 user nova-compute[74242]:         <nova:memory>2048</nova:memory>
Oct 20 02:17:19 user nova-compute[74242]:         <nova:disk>20</nova:disk>
Oct 20 02:17:19 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:17:19 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:17:19 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:17:19 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:17:19 user nova-compute[74242]:       <nova:owner>
Oct 20 02:17:19 user nova-compute[74242]:         <nova:user uuid="c1f488a444de49f5bed5351efd55dafa">tempest-ServerActionsTestOtherA-2076229102-project-member</nova:user>
Oct 20 02:17:19 user nova-compute[74242]:         <nova:project uuid="5cf9b187fe8443aba57a8c629d78978e">tempest-ServerActionsTestOtherA-2076229102</nova:project>
Oct 20 02:17:19 user nova-compute[74242]:       </nova:owner>
Oct 20 02:17:19 user nova-compute[74242]:       <nova:ports>
Oct 20 02:17:19 user nova-compute[74242]:         <nova:port uuid="a8a2c2c1-7401-4115-8479-bb8939c1397f">
Oct 20 02:17:19 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 02:17:19 user nova-compute[74242]:         </nova:port>
Oct 20 02:17:19 user nova-compute[74242]:       </nova:ports>
Oct 20 02:17:19 user nova-compute[74242]:     </nova:instance>
Oct 20 02:17:19 user nova-compute[74242]:   </metadata>
Oct 20 02:17:19 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:17:19 user nova-compute[74242]:     <system>
Oct 20 02:17:19 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:17:19 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:17:19 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:17:19 user nova-compute[74242]:       <entry name="serial">3038a67c-0ffd-4652-a3d1-23e4bfda10fe</entry>
Oct 20 02:17:19 user nova-compute[74242]:       <entry name="uuid">3038a67c-0ffd-4652-a3d1-23e4bfda10fe</entry>
Oct 20 02:17:19 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:17:19 user nova-compute[74242]:     </system>
Oct 20 02:17:19 user nova-compute[74242]:   </sysinfo>
Oct 20 02:17:19 user nova-compute[74242]:   <os>
Oct 20 02:17:19 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:17:19 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:17:19 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:17:19 user nova-compute[74242]:   </os>
Oct 20 02:17:19 user nova-compute[74242]:   <features>
Oct 20 02:17:19 user nova-compute[74242]:     <acpi/>
Oct 20 02:17:19 user nova-compute[74242]:     <apic/>
Oct 20 02:17:19 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:17:19 user nova-compute[74242]:   </features>
Oct 20 02:17:19 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:17:19 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:17:19 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:17:19 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:17:19 user nova-compute[74242]:   </clock>
Oct 20 02:17:19 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:17:19 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:17:19 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:17:19 user nova-compute[74242]:   </cpu>
Oct 20 02:17:19 user nova-compute[74242]:   <devices>
Oct 20 02:17:19 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:17:19 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:17:19 user nova-compute[74242]:       <source dev="/dev/sdb"/>
Oct 20 02:17:19 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:17:19 user nova-compute[74242]:       <serial>611b143e-0c8f-4e29-a344-97df041319f1</serial>
Oct 20 02:17:19 user nova-compute[74242]:     </disk>
Oct 20 02:17:19 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:17:19 user nova-compute[74242]:       <mac address="fa:16:3e:02:1a:d8"/>
Oct 20 02:17:19 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:17:19 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:17:19 user nova-compute[74242]:       <target dev="tapa8a2c2c1-74"/>
Oct 20 02:17:19 user nova-compute[74242]:     </interface>
Oct 20 02:17:19 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:17:19 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/3038a67c-0ffd-4652-a3d1-23e4bfda10fe/console.log" append="off"/>
Oct 20 02:17:19 user nova-compute[74242]:     </serial>
Oct 20 02:17:19 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:17:19 user nova-compute[74242]:     <video>
Oct 20 02:17:19 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:17:19 user nova-compute[74242]:     </video>
Oct 20 02:17:19 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:17:19 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:17:19 user nova-compute[74242]:     </rng>
Oct 20 02:17:19 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:17:19 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:17:19 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:17:19 user nova-compute[74242]:     </memballoon>
Oct 20 02:17:19 user nova-compute[74242]:   </devices>
Oct 20 02:17:19 user nova-compute[74242]: </domain>
Oct 20 02:17:19 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1719894790',display_name='tempest-ServerActionsTestOtherA-server-1719894790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1719894790',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB7bL+2x0x/JgolwV73wEpn90TfE93HD11kN8fWTUdskLHr/+qGh8YX2pmWaISRSrg9SBRQDQmulufko6eTLMYIA5vcJ4clYCIWnNXj2Hp2S/9mOnMK73v45XTwiydUrQ==',key_name='tempest-keypair-1706623376',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:15:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='5cf9b187fe8443aba57a8c629d78978e',ramdisk_id='',reservation_id='r-z5rlmmsm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-2076229102',owner_user_name='tempest-ServerActionsTestOtherA-2076229102-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:17:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1f488a444de49f5bed5351efd55dafa',uuid=3038a67c-0ffd-4652-a3d1-23e4bfda10fe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2013478958-network", "vif_mac": "fa:16:3e:02:1a:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converting VIF {"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-2013478958-network", "vif_mac": "fa:16:3e:02:1a:d8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:02:1a:d8,bridge_name='br-int',has_traffic_filtering=True,id=a8a2c2c1-7401-4115-8479-bb8939c1397f,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a2c2c1-74') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG os_vif [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:1a:d8,bridge_name='br-int',has_traffic_filtering=True,id=a8a2c2c1-7401-4115-8479-bb8939c1397f,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a2c2c1-74') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0e076415-b7d0-5058-8ee9-df04c72944fe', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8a2c2c1-74, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8a2c2c1-74, col_values=(('qos', UUID('f5dd19b1-d570-449f-92aa-78d790173f5c')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8a2c2c1-74, col_values=(('external_ids', {'iface-id': 'a8a2c2c1-7401-4115-8479-bb8939c1397f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:02:1a:d8', 'vm-uuid': '3038a67c-0ffd-4652-a3d1-23e4bfda10fe'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:19 user nova-compute[74242]: INFO os_vif [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:02:1a:d8,bridge_name='br-int',has_traffic_filtering=True,id=a8a2c2c1-7401-4115-8479-bb8939c1397f,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a2c2c1-74')
Oct 20 02:17:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] No VIF found with MAC fa:16:3e:02:1a:d8, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:17:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:21 user nova-compute[74242]: DEBUG nova.compute.manager [req-570f7fdb-df20-49c3-b77b-9f8de4b18200 req-66612d93-82e1-49fc-aa96-0d94e38ff11f service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received event network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:17:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-570f7fdb-df20-49c3-b77b-9f8de4b18200 req-66612d93-82e1-49fc-aa96-0d94e38ff11f service nova] Acquiring lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-570f7fdb-df20-49c3-b77b-9f8de4b18200 req-66612d93-82e1-49fc-aa96-0d94e38ff11f service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-570f7fdb-df20-49c3-b77b-9f8de4b18200 req-66612d93-82e1-49fc-aa96-0d94e38ff11f service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:21 user nova-compute[74242]: DEBUG nova.compute.manager [req-570f7fdb-df20-49c3-b77b-9f8de4b18200 req-66612d93-82e1-49fc-aa96-0d94e38ff11f service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] No waiting events found dispatching network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:17:21 user nova-compute[74242]: WARNING nova.compute.manager [req-570f7fdb-df20-49c3-b77b-9f8de4b18200 req-66612d93-82e1-49fc-aa96-0d94e38ff11f service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received unexpected event network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f for instance with vm_state active and task_state resize_finish.
Oct 20 02:17:23 user nova-compute[74242]: DEBUG nova.compute.manager [req-ff277b7d-db03-4acd-a314-c2aa1da1556e req-e4433e91-bb03-454f-9bf6-5cf57ed15e50 service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received event network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:17:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ff277b7d-db03-4acd-a314-c2aa1da1556e req-e4433e91-bb03-454f-9bf6-5cf57ed15e50 service nova] Acquiring lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ff277b7d-db03-4acd-a314-c2aa1da1556e req-e4433e91-bb03-454f-9bf6-5cf57ed15e50 service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ff277b7d-db03-4acd-a314-c2aa1da1556e req-e4433e91-bb03-454f-9bf6-5cf57ed15e50 service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:23 user nova-compute[74242]: DEBUG nova.compute.manager [req-ff277b7d-db03-4acd-a314-c2aa1da1556e req-e4433e91-bb03-454f-9bf6-5cf57ed15e50 service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] No waiting events found dispatching network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:17:23 user nova-compute[74242]: WARNING nova.compute.manager [req-ff277b7d-db03-4acd-a314-c2aa1da1556e req-e4433e91-bb03-454f-9bf6-5cf57ed15e50 service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received unexpected event network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f for instance with vm_state active and task_state resize_finish.
Oct 20 02:17:23 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:17:23 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Instance running successfully.
Oct 20 02:17:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Failed to set time: agent not configured {{(pid=74242) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 20 02:17:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e08c85d6-4cba-4234-9615-238e8df8af68 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] finish_migration finished successfully. {{(pid=74242) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 20 02:17:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "531961c2-d07a-4edc-8714-16ff1fa1a925" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:17:25 user nova-compute[74242]: INFO nova.compute.claims [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Claim successful on node user
Oct 20 02:17:25 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.470s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG nova.network.neutron [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:17:25 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:17:25 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG nova.policy [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00ea297f598040fbb338b9ab2e1a1d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e137c75824d7429585ddd2245f86a6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:17:25 user nova-compute[74242]: INFO nova.virt.block_device [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Booting with volume 81a7b30b-0424-4656-b2f1-5fd1f6617155 at /dev/vda
Oct 20 02:17:25 user nova-compute[74242]: DEBUG os_brick.utils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[de0c5abe-d958-4be2-aa91-a513b8e4261e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a88b12a-caf3-4b7c-afaa-0e194b554823]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[91f44537-ef6a-4287-9a6f-1ed93bc87943]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[649de446-e297-4acf-8e01-acd2988e2f61]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:17:25 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:17:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e515c2-f47c-4edb-9214-d4b47b389483]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:17:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:17:26 user nova-compute[74242]: DEBUG os_brick.utils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:17:26 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Updating existing volume attachment record: 076eac90-f130-428c-b09e-86a7d1b529a2 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:17:26 user nova-compute[74242]: DEBUG nova.network.neutron [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Successfully created port: 6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG nova.network.neutron [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Successfully updated port: 6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "refresh_cache-531961c2-d07a-4edc-8714-16ff1fa1a925" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquired lock "refresh_cache-531961c2-d07a-4edc-8714-16ff1fa1a925" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG nova.network.neutron [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-d07d9fa9-09f2-495d-aaa0-b6b0d2584c63 req-13b0f036-770a-4e0c-b333-0ea525e5cc56 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Received event network-changed-6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-d07d9fa9-09f2-495d-aaa0-b6b0d2584c63 req-13b0f036-770a-4e0c-b333-0ea525e5cc56 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Refreshing instance network info cache due to event network-changed-6d6d2672-e110-4684-8590-a816a23e680a. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d07d9fa9-09f2-495d-aaa0-b6b0d2584c63 req-13b0f036-770a-4e0c-b333-0ea525e5cc56 service nova] Acquiring lock "refresh_cache-531961c2-d07a-4edc-8714-16ff1fa1a925" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG nova.network.neutron [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG nova.network.neutron [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Updating instance_info_cache with network_info: [{"id": "6d6d2672-e110-4684-8590-a816a23e680a", "address": "fa:16:3e:4f:95:67", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d2672-e1", "ovs_interfaceid": "6d6d2672-e110-4684-8590-a816a23e680a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Releasing lock "refresh_cache-531961c2-d07a-4edc-8714-16ff1fa1a925" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Instance network_info: |[{"id": "6d6d2672-e110-4684-8590-a816a23e680a", "address": "fa:16:3e:4f:95:67", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d2672-e1", "ovs_interfaceid": "6d6d2672-e110-4684-8590-a816a23e680a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d07d9fa9-09f2-495d-aaa0-b6b0d2584c63 req-13b0f036-770a-4e0c-b333-0ea525e5cc56 service nova] Acquired lock "refresh_cache-531961c2-d07a-4edc-8714-16ff1fa1a925" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG nova.network.neutron [req-d07d9fa9-09f2-495d-aaa0-b6b0d2584c63 req-13b0f036-770a-4e0c-b333-0ea525e5cc56 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Refreshing network info cache for port 6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG nova.network.neutron [req-d07d9fa9-09f2-495d-aaa0-b6b0d2584c63 req-13b0f036-770a-4e0c-b333-0ea525e5cc56 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Updated VIF entry in instance network info cache for port 6d6d2672-e110-4684-8590-a816a23e680a. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG nova.network.neutron [req-d07d9fa9-09f2-495d-aaa0-b6b0d2584c63 req-13b0f036-770a-4e0c-b333-0ea525e5cc56 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Updating instance_info_cache with network_info: [{"id": "6d6d2672-e110-4684-8590-a816a23e680a", "address": "fa:16:3e:4f:95:67", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d2672-e1", "ovs_interfaceid": "6d6d2672-e110-4684-8590-a816a23e680a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:17:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d07d9fa9-09f2-495d-aaa0-b6b0d2584c63 req-13b0f036-770a-4e0c-b333-0ea525e5cc56 service nova] Releasing lock "refresh_cache-531961c2-d07a-4edc-8714-16ff1fa1a925" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:17:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG nova.objects.instance [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lazy-loading 'flavor' on Instance uuid 2645af84-8ba4-4a34-beb1-9676cce3dc5f {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:34 user nova-compute[74242]: INFO nova.compute.manager [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Attaching volume bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 to /dev/vdb
Oct 20 02:17:34 user nova-compute[74242]: DEBUG os_brick.utils [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e66795b9-6c57-4cb5-a5d2-a4e524f526f8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7decb456-1db1-493b-8868-426c7de9307d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0f62a3-014f-47ee-b1c9-423f0cd8193f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49806f2-01a5-4f79-8843-f0e79da7f6df]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:17:34 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:17:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[98949606-d72d-4b62-babb-783740adf2bf]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG os_brick.utils [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:17:34 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updating existing volume attachment record: 7642f9f7-f652-42ab-8a5f-4940f0151f06 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:17:35 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:17:35 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:17:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:17:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Didn't find any instances for network info cache update. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 02:17:35 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:17:36 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:17:37 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:17:38 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:17:38 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:17:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:17:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:17:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:39 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:17:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:17:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:17:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:17:42 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:17:42 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7841MB free_disk=25.012454986572266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Applying migration context for instance 3038a67c-0ffd-4652-a3d1-23e4bfda10fe as it has an incoming, in-progress migration 9216e329-8936-4b18-8440-69345512291b. Migration status is finished {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 02:17:42 user nova-compute[74242]: INFO nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Updating resource usage from migration 9216e329-8936-4b18-8440-69345512291b
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c98e383a-e1e5-4130-9cc6-a9823db0b88c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2645af84-8ba4-4a34-beb1-9676cce3dc5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 00140923-ae97-40b6-a3a0-37215a45effc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance fdccf817-4784-472a-85d1-96b5cc37722c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Migration 9216e329-8936-4b18-8440-69345512291b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3038a67c-0ffd-4652-a3d1-23e4bfda10fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 531961c2-d07a-4edc-8714-16ff1fa1a925 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:17:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:17:44 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Creating image(s)
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Ensure instance console log exists: /opt/stack/data/nova/instances/531961c2-d07a-4edc-8714-16ff1fa1a925/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Start _get_guest_xml network_info=[{"id": "6d6d2672-e110-4684-8590-a816a23e680a", "address": "fa:16:3e:4f:95:67", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d2672-e1", "ovs_interfaceid": "6d6d2672-e110-4684-8590-a816a23e680a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '076eac90-f130-428c-b09e-86a7d1b529a2', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlohPgye', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '531961c2-d07a-4edc-8714-16ff1fa1a925', 'attached_at': '', 'detached_at': '', 'volume_id': '81a7b30b-0424-4656-b2f1-5fd1f6617155', 'serial': '81a7b30b-0424-4656-b2f1-5fd1f6617155'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:17:44 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:17:44 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlohPgye', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:17:44 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:17:44 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:17:44 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2974861-71f0-4b42-99b1-1c8529f91f2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:17:44 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[81adb3d5-fc61-42ca-8359-180c1f5760f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155] added
Oct 20 02:17:44 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd147e61-acf0-46fd-815b-fa9642a04009]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ceccbf2-e0a0-48f2-bcdc-5b5e43037256]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WlohPgye {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WlohPgye" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ffd9e1-7c59-4fd1-8fc3-da4519d7748d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WlohPgye'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74e378f-d41a-48ac-8cc9-a2ac971c7b4e]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d46baa78-13fd-4d07-b8b3-0a556a9089a4]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:17:44 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:17:44 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:17:44 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:17:44 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bee2056-1d9d-4cb5-87cf-671225df2d14]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260]
Oct 20 02:17:44 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260] successful.
Oct 20 02:17:44 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d7d4f5-d460-4d8c-b35e-b2b8f6b067b1]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f26371a-fabc-4a51-8adf-27088edfecb8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:17:44 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:17:44 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:17:44 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:17:44 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:17:44 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:17:44 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.354s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] HCTL ('35', '-', '-', 0) found on session 32 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[381023f8-8905-4712-ba8f-ae89eae80f60]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching for a device in session 32 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlohPgye', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-cc8b792c-090e-4212-bf60-52ecc79db978 req-a8edb073-345e-4ca4-ae1e-17304990e2d0 service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Received event network-changed-e35dc654-660d-4088-9144-695a77478839 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-cc8b792c-090e-4212-bf60-52ecc79db978 req-a8edb073-345e-4ca4-ae1e-17304990e2d0 service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Refreshing instance network info cache due to event network-changed-e35dc654-660d-4088-9144-695a77478839. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cc8b792c-090e-4212-bf60-52ecc79db978 req-a8edb073-345e-4ca4-ae1e-17304990e2d0 service nova] Acquiring lock "refresh_cache-00140923-ae97-40b6-a3a0-37215a45effc" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cc8b792c-090e-4212-bf60-52ecc79db978 req-a8edb073-345e-4ca4-ae1e-17304990e2d0 service nova] Acquired lock "refresh_cache-00140923-ae97-40b6-a3a0-37215a45effc" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG nova.network.neutron [req-cc8b792c-090e-4212-bf60-52ecc79db978 req-a8edb073-345e-4ca4-ae1e-17304990e2d0 service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Refreshing network info cache for port e35dc654-660d-4088-9144-695a77478839 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:17:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG nova.network.neutron [req-cc8b792c-090e-4212-bf60-52ecc79db978 req-a8edb073-345e-4ca4-ae1e-17304990e2d0 service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Updated VIF entry in instance network info cache for port e35dc654-660d-4088-9144-695a77478839. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG nova.network.neutron [req-cc8b792c-090e-4212-bf60-52ecc79db978 req-a8edb073-345e-4ca4-ae1e-17304990e2d0 service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Updating instance_info_cache with network_info: [{"id": "e35dc654-660d-4088-9144-695a77478839", "address": "fa:16:3e:b8:83:db", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35dc654-66", "ovs_interfaceid": "e35dc654-660d-4088-9144-695a77478839", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cc8b792c-090e-4212-bf60-52ecc79db978 req-a8edb073-345e-4ca4-ae1e-17304990e2d0 service nova] Releasing lock "refresh_cache-00140923-ae97-40b6-a3a0-37215a45effc" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== connect_volume: return (1402ms) {'type': 'block', 'scsi_wwn': '26637613835313933', 'path': '/dev/sdd'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26637613835313933', 'path': '/dev/sdd'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1527036357',display_name='tempest-TestVolumeBootPattern-server-1527036357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1527036357',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYHgQrnRlQ4jBKzblQ3DfxaEfVjuxo/NC6O+ICak+0aaFoFY7UzIhNxrdgQLtBAfBOsL0Lu2xLtyVpinmCCfqmljj/P6GdvFSKRfnZG4N6/Y2tUqR86uaxeDlehlPmATw==',key_name='tempest-TestVolumeBootPattern-887907135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-0caltrux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:17:26Z,user_data=None,user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=531961c2-d07a-4edc-8714-16ff1fa1a925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d6d2672-e110-4684-8590-a816a23e680a", "address": "fa:16:3e:4f:95:67", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d2672-e1", "ovs_interfaceid": "6d6d2672-e110-4684-8590-a816a23e680a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "6d6d2672-e110-4684-8590-a816a23e680a", "address": "fa:16:3e:4f:95:67", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d2672-e1", "ovs_interfaceid": "6d6d2672-e110-4684-8590-a816a23e680a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:95:67,bridge_name='br-int',has_traffic_filtering=True,id=6d6d2672-e110-4684-8590-a816a23e680a,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6d2672-e1') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG nova.objects.instance [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lazy-loading 'pci_devices' on Instance uuid 531961c2-d07a-4edc-8714-16ff1fa1a925 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:17:45 user nova-compute[74242]:   <uuid>531961c2-d07a-4edc-8714-16ff1fa1a925</uuid>
Oct 20 02:17:45 user nova-compute[74242]:   <name>instance-0000001f</name>
Oct 20 02:17:45 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:17:45 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:17:45 user nova-compute[74242]:   <metadata>
Oct 20 02:17:45 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:17:45 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:17:45 user nova-compute[74242]:       <nova:name>tempest-TestVolumeBootPattern-server-1527036357</nova:name>
Oct 20 02:17:45 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:17:44</nova:creationTime>
Oct 20 02:17:45 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:17:45 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:17:45 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:17:45 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:17:45 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:17:45 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:17:45 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:17:45 user nova-compute[74242]:       <nova:owner>
Oct 20 02:17:45 user nova-compute[74242]:         <nova:user uuid="00ea297f598040fbb338b9ab2e1a1d3a">tempest-TestVolumeBootPattern-882774340-project-member</nova:user>
Oct 20 02:17:45 user nova-compute[74242]:         <nova:project uuid="e137c75824d7429585ddd2245f86a6d0">tempest-TestVolumeBootPattern-882774340</nova:project>
Oct 20 02:17:45 user nova-compute[74242]:       </nova:owner>
Oct 20 02:17:45 user nova-compute[74242]:       <nova:ports>
Oct 20 02:17:45 user nova-compute[74242]:         <nova:port uuid="6d6d2672-e110-4684-8590-a816a23e680a">
Oct 20 02:17:45 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 02:17:45 user nova-compute[74242]:         </nova:port>
Oct 20 02:17:45 user nova-compute[74242]:       </nova:ports>
Oct 20 02:17:45 user nova-compute[74242]:     </nova:instance>
Oct 20 02:17:45 user nova-compute[74242]:   </metadata>
Oct 20 02:17:45 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:17:45 user nova-compute[74242]:     <system>
Oct 20 02:17:45 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:17:45 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:17:45 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:17:45 user nova-compute[74242]:       <entry name="serial">531961c2-d07a-4edc-8714-16ff1fa1a925</entry>
Oct 20 02:17:45 user nova-compute[74242]:       <entry name="uuid">531961c2-d07a-4edc-8714-16ff1fa1a925</entry>
Oct 20 02:17:45 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:17:45 user nova-compute[74242]:     </system>
Oct 20 02:17:45 user nova-compute[74242]:   </sysinfo>
Oct 20 02:17:45 user nova-compute[74242]:   <os>
Oct 20 02:17:45 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:17:45 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:17:45 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:17:45 user nova-compute[74242]:   </os>
Oct 20 02:17:45 user nova-compute[74242]:   <features>
Oct 20 02:17:45 user nova-compute[74242]:     <acpi/>
Oct 20 02:17:45 user nova-compute[74242]:     <apic/>
Oct 20 02:17:45 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:17:45 user nova-compute[74242]:   </features>
Oct 20 02:17:45 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:17:45 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:17:45 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:17:45 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:17:45 user nova-compute[74242]:   </clock>
Oct 20 02:17:45 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:17:45 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:17:45 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:17:45 user nova-compute[74242]:   </cpu>
Oct 20 02:17:45 user nova-compute[74242]:   <devices>
Oct 20 02:17:45 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:17:45 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:17:45 user nova-compute[74242]:       <source dev="/dev/sdd"/>
Oct 20 02:17:45 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:17:45 user nova-compute[74242]:       <serial>81a7b30b-0424-4656-b2f1-5fd1f6617155</serial>
Oct 20 02:17:45 user nova-compute[74242]:     </disk>
Oct 20 02:17:45 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:17:45 user nova-compute[74242]:       <mac address="fa:16:3e:4f:95:67"/>
Oct 20 02:17:45 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:17:45 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:17:45 user nova-compute[74242]:       <target dev="tap6d6d2672-e1"/>
Oct 20 02:17:45 user nova-compute[74242]:     </interface>
Oct 20 02:17:45 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:17:45 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/531961c2-d07a-4edc-8714-16ff1fa1a925/console.log" append="off"/>
Oct 20 02:17:45 user nova-compute[74242]:     </serial>
Oct 20 02:17:45 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:17:45 user nova-compute[74242]:     <video>
Oct 20 02:17:45 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:17:45 user nova-compute[74242]:     </video>
Oct 20 02:17:45 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:17:45 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:17:45 user nova-compute[74242]:     </rng>
Oct 20 02:17:45 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:17:45 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:17:45 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:17:45 user nova-compute[74242]:     </memballoon>
Oct 20 02:17:45 user nova-compute[74242]:   </devices>
Oct 20 02:17:45 user nova-compute[74242]: </domain>
Oct 20 02:17:45 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1527036357',display_name='tempest-TestVolumeBootPattern-server-1527036357',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1527036357',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYHgQrnRlQ4jBKzblQ3DfxaEfVjuxo/NC6O+ICak+0aaFoFY7UzIhNxrdgQLtBAfBOsL0Lu2xLtyVpinmCCfqmljj/P6GdvFSKRfnZG4N6/Y2tUqR86uaxeDlehlPmATw==',key_name='tempest-TestVolumeBootPattern-887907135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-0caltrux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:17:26Z,user_data=None,user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=531961c2-d07a-4edc-8714-16ff1fa1a925,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d6d2672-e110-4684-8590-a816a23e680a", "address": "fa:16:3e:4f:95:67", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d2672-e1", "ovs_interfaceid": "6d6d2672-e110-4684-8590-a816a23e680a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "6d6d2672-e110-4684-8590-a816a23e680a", "address": "fa:16:3e:4f:95:67", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d2672-e1", "ovs_interfaceid": "6d6d2672-e110-4684-8590-a816a23e680a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:95:67,bridge_name='br-int',has_traffic_filtering=True,id=6d6d2672-e110-4684-8590-a816a23e680a,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6d2672-e1') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG os_vif [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:95:67,bridge_name='br-int',has_traffic_filtering=True,id=6d6d2672-e110-4684-8590-a816a23e680a,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6d2672-e1') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ae3f80bb-b409-58f5-bb23-72c500ad51e1', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d6d2672-e1, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d6d2672-e1, col_values=(('qos', UUID('3cc508cb-bee2-4194-9ba5-9fd2842f28c4')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d6d2672-e1, col_values=(('external_ids', {'iface-id': '6d6d2672-e110-4684-8590-a816a23e680a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:95:67', 'vm-uuid': '531961c2-d07a-4edc-8714-16ff1fa1a925'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:45 user nova-compute[74242]: INFO os_vif [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:95:67,bridge_name='br-int',has_traffic_filtering=True,id=6d6d2672-e110-4684-8590-a816a23e680a,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6d2672-e1')
Oct 20 02:17:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:17:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] No VIF found with MAC fa:16:3e:4f:95:67, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:17:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-17451f62-c689-4666-ad9a-64c19bd1effa req-c54e6d19-d9a1-4ad9-926b-caf4fbf70362 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Received event network-vif-plugged-6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:17:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-17451f62-c689-4666-ad9a-64c19bd1effa req-c54e6d19-d9a1-4ad9-926b-caf4fbf70362 service nova] Acquiring lock "531961c2-d07a-4edc-8714-16ff1fa1a925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-17451f62-c689-4666-ad9a-64c19bd1effa req-c54e6d19-d9a1-4ad9-926b-caf4fbf70362 service nova] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-17451f62-c689-4666-ad9a-64c19bd1effa req-c54e6d19-d9a1-4ad9-926b-caf4fbf70362 service nova] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-17451f62-c689-4666-ad9a-64c19bd1effa req-c54e6d19-d9a1-4ad9-926b-caf4fbf70362 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] No waiting events found dispatching network-vif-plugged-6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:17:47 user nova-compute[74242]: WARNING nova.compute.manager [req-17451f62-c689-4666-ad9a-64c19bd1effa req-c54e6d19-d9a1-4ad9-926b-caf4fbf70362 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Received unexpected event network-vif-plugged-6d6d2672-e110-4684-8590-a816a23e680a for instance with vm_state building and task_state spawning.
Oct 20 02:17:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-62046a0c-cbda-4ae7-b94c-eb69e820982d req-7690b77c-d2dc-4062-a8eb-2cc3a5fa5bd6 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Received event network-vif-plugged-6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:17:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-62046a0c-cbda-4ae7-b94c-eb69e820982d req-7690b77c-d2dc-4062-a8eb-2cc3a5fa5bd6 service nova] Acquiring lock "531961c2-d07a-4edc-8714-16ff1fa1a925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-62046a0c-cbda-4ae7-b94c-eb69e820982d req-7690b77c-d2dc-4062-a8eb-2cc3a5fa5bd6 service nova] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-62046a0c-cbda-4ae7-b94c-eb69e820982d req-7690b77c-d2dc-4062-a8eb-2cc3a5fa5bd6 service nova] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-62046a0c-cbda-4ae7-b94c-eb69e820982d req-7690b77c-d2dc-4062-a8eb-2cc3a5fa5bd6 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] No waiting events found dispatching network-vif-plugged-6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:17:49 user nova-compute[74242]: WARNING nova.compute.manager [req-62046a0c-cbda-4ae7-b94c-eb69e820982d req-7690b77c-d2dc-4062-a8eb-2cc3a5fa5bd6 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Received unexpected event network-vif-plugged-6d6d2672-e110-4684-8590-a816a23e680a for instance with vm_state building and task_state spawning.
Oct 20 02:17:49 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:17:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:17:49 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Instance spawned successfully.
Oct 20 02:17:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:17:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:17:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:17:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:17:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:17:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:17:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:17:49 user nova-compute[74242]: INFO nova.compute.manager [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Took 5.46 seconds to spawn the instance on the hypervisor.
Oct 20 02:17:49 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:17:49 user nova-compute[74242]: INFO nova.compute.manager [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Took 24.54 seconds to build instance.
Oct 20 02:17:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b667800a-f4d6-464c-8474-b521c5fc2022 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.691s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "00140923-ae97-40b6-a3a0-37215a45effc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "00140923-ae97-40b6-a3a0-37215a45effc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:51 user nova-compute[74242]: DEBUG nova.objects.instance [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lazy-loading 'flavor' on Instance uuid 00140923-ae97-40b6-a3a0-37215a45effc {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:17:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "00140923-ae97-40b6-a3a0-37215a45effc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "00140923-ae97-40b6-a3a0-37215a45effc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "00140923-ae97-40b6-a3a0-37215a45effc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:51 user nova-compute[74242]: INFO nova.compute.manager [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Attaching volume e6d69ae5-2032-4d06-8533-f422a4601a62 to /dev/vdb
Oct 20 02:17:52 user nova-compute[74242]: DEBUG os_brick.utils [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0646e4f-d88b-481d-8b62-3fb8ae31e899]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3327ee-37f7-4281-9af9-6ad55505c0be]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8314bfc-63a8-435c-bc0e-36dd243c21b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c40ed7-25dd-4914-a600-a5b46693cc73]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:17:52 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:17:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b883f98-d7a0-4fb8-9c53-73cb2c944b3b]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG os_brick.utils [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:17:52 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Updating existing volume attachment record: 744a6cd5-d167-4005-931c-c04671233a2c {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AedRuVJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:17:53 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:17:53 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:17:53 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1480cf-d13f-4ef2-8cf0-9ad11e6b8bd8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:17:53 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79cc8b8-07a0-4f47-9f2f-ffa069b8bc2c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5] added
Oct 20 02:17:53 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f824861-2b4f-44e5-b190-7ac4063afea8]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c8feac6-d4fa-4fc7-8e99-8ee59fa2db55]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AedRuVJG {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AedRuVJG" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd062bcc-70fc-463a-829f-2eb29753e9a1]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AedRuVJG'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.056s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e2457c-4fe3-4b46-a0d4-6489f8160845]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b1e070-02f7-4f96-88a0-27be448a87d6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:17:53 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:17:53 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:17:53 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:17:53 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:17:53 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:17:53 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.129s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dc82b7-2a69-440c-9935-fa5b276c17b4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260]
Oct 20 02:17:53 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260] successful.
Oct 20 02:17:53 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea09d155-d3cd-42ce-8c7c-70a49aa783d0]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd625e0d-e6a6-419e-bb60-69ab7a3e6847]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:17:53 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:17:53 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:17:53 user nova-compute[74242]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:17:53 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:17:53 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:17:53 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:17:53 user nova-compute[74242]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:17:53 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.417s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5e5544-d735-4f28-a9c4-622032a9e39e]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:17:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AedRuVJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:17:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.452s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:17:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] <== connect_volume: return (1454ms) {'type': 'block', 'scsi_wwn': '23735643833386538', 'path': '/dev/sde'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:17:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735643833386538', 'path': '/dev/sde'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:17:54 user nova-compute[74242]: DEBUG nova.objects.instance [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lazy-loading 'flavor' on Instance uuid 2645af84-8ba4-4a34-beb1-9676cce3dc5f {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:17:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:17:54 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:17:54 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:17:54 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:17:54 user nova-compute[74242]:   <serial>bb8530dc-d2f2-4f73-a60d-f7acd7be85f5</serial>
Oct 20 02:17:54 user nova-compute[74242]: </disk>
Oct 20 02:17:54 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:17:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:17:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:17:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] No VIF found with MAC fa:16:3e:1f:ee:0a, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:17:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bd3e9b7b-291e-4912-9d45-ffd9bb52b81b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.985s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:58 user nova-compute[74242]: DEBUG nova.compute.manager [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Stashing vm_state: active {{(pid=74242) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 20 02:17:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:17:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:17:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:17:58 user nova-compute[74242]: INFO nova.compute.claims [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Claim successful on node user
Oct 20 02:17:58 user nova-compute[74242]: INFO nova.compute.resource_tracker [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updating resource usage from migration 2a63d998-3ba0-4cca-be80-2ab6d2c5b6ff
Oct 20 02:17:58 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:17:58 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:17:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.448s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:17:58 user nova-compute[74242]: INFO nova.compute.manager [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Migrating
Oct 20 02:17:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:17:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquired lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:17:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:17:59 user nova-compute[74242]: DEBUG nova.network.neutron [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updating instance_info_cache with network_info: [{"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:17:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Releasing lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:17:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Starting migrate_disk_and_power_off {{(pid=74242) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 20 02:17:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:17:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-ecf1d3dd-bf50-48c3-8168-89c479a21a37 req-55f8a2bd-d99f-404d-bf82-272ac6937411 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-vif-unplugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ecf1d3dd-bf50-48c3-8168-89c479a21a37 req-55f8a2bd-d99f-404d-bf82-272ac6937411 service nova] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ecf1d3dd-bf50-48c3-8168-89c479a21a37 req-55f8a2bd-d99f-404d-bf82-272ac6937411 service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ecf1d3dd-bf50-48c3-8168-89c479a21a37 req-55f8a2bd-d99f-404d-bf82-272ac6937411 service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-ecf1d3dd-bf50-48c3-8168-89c479a21a37 req-55f8a2bd-d99f-404d-bf82-272ac6937411 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] No waiting events found dispatching network-vif-unplugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:18:00 user nova-compute[74242]: WARNING nova.compute.manager [req-ecf1d3dd-bf50-48c3-8168-89c479a21a37 req-55f8a2bd-d99f-404d-bf82-272ac6937411 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received unexpected event network-vif-unplugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 for instance with vm_state active and task_state resize_migrating.
Oct 20 02:18:00 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Instance destroyed successfully.
Oct 20 02:18:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-346873381',display_name='tempest-ServerActionsTestOtherB-server-346873381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-346873381',id=25,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIglcMR+peRa0oE4XH1xEQPQIqhuBje0KSTUzv/TpZRtBBqkKyYxWmNpC0JGbnCtrC95IJdTO6AdIgwEwg+bzGJkzWbXrKT8XXGF365xukpUOAemIbyOpaYNjhmP5ri2Q==',key_name='tempest-keypair-921939156',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:13:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f72d19ab869b4bdeb6798f12ca2ef6ae',ramdisk_id='',reservation_id='r-r3xavz7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-215383043',owner_user_name='tempest-ServerActionsTestOtherB-215383043-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de983dabe464ac8a720fc45fc311bf5',uuid=2645af84-8ba4-4a34-beb1-9676cce3dc5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2124958625-network", "vif_mac": "fa:16:3e:1f:ee:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converting VIF {"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2124958625-network", "vif_mac": "fa:16:3e:1f:ee:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_vif [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfec951d-2a, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4d7a56f9-710d-4f3b-ad78-ca4fcb921ed8) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:18:00 user nova-compute[74242]: INFO os_vif [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a')
Oct 20 02:18:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AedRuVJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:18:00 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea9b362-2c7b-4eb5-b04b-263ea94f6aca]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:18:00 user nova-compute[74242]: No targets found.
Oct 20 02:18:00 user nova-compute[74242]: iSNS:
Oct 20 02:18:00 user nova-compute[74242]: No targets found.
Oct 20 02:18:00 user nova-compute[74242]: STATIC:
Oct 20 02:18:00 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5
Oct 20 02:18:00 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:18:00 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:18:00 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:18:00 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:18:00 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:18:00 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155
Oct 20 02:18:00 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:18:00 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:18:00 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1
Oct 20 02:18:00 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:18:00 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:18:00 user nova-compute[74242]: FIRMWARE:
Oct 20 02:18:00 user nova-compute[74242]: No targets found.
Oct 20 02:18:00 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:18:00 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:18:00 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[682c40a9-b78c-4691-9b28-bbf12704b2a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[502272d0-e375-402f-abcb-1109029501fb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:18:00 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:18:00 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:18:00 user nova-compute[74242]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:18:00 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:18:00 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:18:00 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:18:00 user nova-compute[74242]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:18:00 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d0188280>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5'): ({'sde'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Removing single pathed devices sde {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[55446ce4-29ab-44b6-ad1e-73c0c81bcee0]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a108a5e-afdb-4974-a770-6010471fa5e8]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Flushing IO for device /dev/sde {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d5ba39-ff89-48b1-a365-3e36f23660c5]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb7eb67-04a3-4df6-adda-daeb0e014b77]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7efe934a-bd26-463e-ab8f-10dbeaf21b58]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0373aa75-0e17-490e-801f-c149e86f6da2]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260]
Oct 20 02:18:00 user nova-compute[74242]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260] successful.
Oct 20 02:18:00 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3547b40f-a0e6-4c31-8341-056b22402feb]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] <== disconnect_volume: return (314ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:18:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f_resize/disk /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CMD "cp -r /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f_resize/disk /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk" returned: 0 in 0.372s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f_resize/disk.info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk.info {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CMD "cp -r /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f_resize/disk.info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk.info" returned: 0 in 0.033s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-3b2838ab-55e2-4e5e-aa28-47d75742086f req-93619a9e-abff-4854-9ea3-2fdd9d0be97c service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:18:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3b2838ab-55e2-4e5e-aa28-47d75742086f req-93619a9e-abff-4854-9ea3-2fdd9d0be97c service nova] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3b2838ab-55e2-4e5e-aa28-47d75742086f req-93619a9e-abff-4854-9ea3-2fdd9d0be97c service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3b2838ab-55e2-4e5e-aa28-47d75742086f req-93619a9e-abff-4854-9ea3-2fdd9d0be97c service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-3b2838ab-55e2-4e5e-aa28-47d75742086f req-93619a9e-abff-4854-9ea3-2fdd9d0be97c service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] No waiting events found dispatching network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:18:02 user nova-compute[74242]: WARNING nova.compute.manager [req-3b2838ab-55e2-4e5e-aa28-47d75742086f req-93619a9e-abff-4854-9ea3-2fdd9d0be97c service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received unexpected event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 for instance with vm_state active and task_state resize_migrating.
Oct 20 02:18:02 user nova-compute[74242]: DEBUG nova.network.neutron [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Port bfec951d-2a9f-4fec-98a8-e9683bc83787 binding to destination host user is already ACTIVE {{(pid=74242) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 02:18:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.005s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:18:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquired lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:18:02 user nova-compute[74242]: DEBUG nova.network.neutron [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG nova.network.neutron [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updating instance_info_cache with network_info: [{"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Releasing lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG os_brick.utils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a6fcd3-9760-416a-b173-78ea8a0270a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b416b094-145c-4ebe-8a2f-0c900e83ca38]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[190fb2ae-5169-43b9-99a2-995c67c55786]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b11124c-666b-4cf6-a325-0797c1679dcd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:18:03 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:18:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7991b027-7547-4686-bb55-1054a0ae503e]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:18:03 user nova-compute[74242]: DEBUG os_brick.utils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:18:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGzalnvX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:18:14 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:18:14 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:18:14 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4af8a6-3f9d-4f7d-9441-41ac0d81ae44]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:18:14 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc02347c-4b77-4c7e-9db8-8f1d062a8cbe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62] added
Oct 20 02:18:14 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e891f94f-ddce-4393-8ab9-6894add283ae]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af1d4c3-3824-43b4-9db7-dc9b9a010bf7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGzalnvX {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RGzalnvX" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b84a32-812c-42f9-a926-63b477c5166b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RGzalnvX'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8de8d166-4474-478f-a196-88c5678dd078]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[925e9f2a-6ce4-4596-a18a-cccf1dffd5fb]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:18:14 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:18:14 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:18:14 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:18:14 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:18:14 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:18:14 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3214b58-b74d-4e05-a76a-bff189f003c0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62, portal: 172.16.0.220,3260]
Oct 20 02:18:14 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62, portal: 172.16.0.220,3260] successful.
Oct 20 02:18:14 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60f01dc-08d4-400a-a8e9-1799d01df682]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2c44e3-f225-4dc1-a708-a2c2150c33d8]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:18:14 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:18:14 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:18:14 user nova-compute[74242]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 (non-flash)
Oct 20 02:18:14 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:18:14 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:18:14 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:18:14 user nova-compute[74242]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 (non-flash)
Oct 20 02:18:14 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] HCTL ('36', '-', '-', 0) found on session 34 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[94557e70-439f-4855-9c67-5954db7afd48]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:18:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:15 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Searching for a device in session 34 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:18:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGzalnvX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:18:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:18:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26334336632326239', 'path': '/dev/sde'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:18:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26334336632326239', 'path': '/dev/sde'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:18:15 user nova-compute[74242]: DEBUG nova.objects.instance [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lazy-loading 'flavor' on Instance uuid 00140923-ae97-40b6-a3a0-37215a45effc {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:18:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:18:15 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:18:15 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:18:15 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:18:15 user nova-compute[74242]:   <serial>e6d69ae5-2032-4d06-8533-f422a4601a62</serial>
Oct 20 02:18:15 user nova-compute[74242]: </disk>
Oct 20 02:18:15 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:18:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:18:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:18:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] No VIF found with MAC fa:16:3e:b8:83:db, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:18:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f6cca6f3-3937-4d7c-a96b-b168885cac00 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "00140923-ae97-40b6-a3a0-37215a45effc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.078s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "00140923-ae97-40b6-a3a0-37215a45effc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "00140923-ae97-40b6-a3a0-37215a45effc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:17 user nova-compute[74242]: INFO nova.compute.manager [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Detaching volume e6d69ae5-2032-4d06-8533-f422a4601a62
Oct 20 02:18:17 user nova-compute[74242]: INFO nova.virt.block_device [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Attempting to driver detach volume e6d69ae5-2032-4d06-8533-f422a4601a62 from mountpoint /dev/vdb
Oct 20 02:18:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Attempting to detach device vdb from instance 00140923-ae97-40b6-a3a0-37215a45effc from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:18:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:18:17 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:18:17 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:18:17 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:18:17 user nova-compute[74242]:   <serial>e6d69ae5-2032-4d06-8533-f422a4601a62</serial>
Oct 20 02:18:17 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:18:17 user nova-compute[74242]: </disk>
Oct 20 02:18:17 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:18:17 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Successfully detached device vdb from instance 00140923-ae97-40b6-a3a0-37215a45effc from the persistent domain config.
Oct 20 02:18:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 00140923-ae97-40b6-a3a0-37215a45effc from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:18:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:18:17 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:18:17 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:18:17 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:18:17 user nova-compute[74242]:   <serial>e6d69ae5-2032-4d06-8533-f422a4601a62</serial>
Oct 20 02:18:17 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:18:17 user nova-compute[74242]: </disk>
Oct 20 02:18:17 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:18:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 00140923-ae97-40b6-a3a0-37215a45effc {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:18:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:18:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5009 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:18:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:18:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:18:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Starting finish_migration {{(pid=74242) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 20 02:18:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Instance directory exists: not creating {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 02:18:30 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Creating image(s)
Oct 20 02:18:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.196s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:30 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk. size=21474836480 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:18:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "876f8f80-9640-43ba-8ec7-0ffe06c82086" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk 21474836480 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk 21474836480" returned: 0 in 0.062s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Ensure instance console log exists: /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Start _get_guest_xml network_info=[{"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2124958625-network", "vif_mac": "fa:16:3e:1f:ee:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': 'a984716e-3a0c-4f00-8a5e-de4a450cd4c4', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AedRuVJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2645af84-8ba4-4a34-beb1-9676cce3dc5f', 'attached_at': '2023-10-20T02:18:30.000000', 'detached_at': '', 'volume_id': 'bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 'serial': 'bb8530dc-d2f2-4f73-a60d-f7acd7be85f5'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:18:31 user nova-compute[74242]: INFO nova.compute.claims [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Claim successful on node user
Oct 20 02:18:31 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:18:31 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:40Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AedRuVJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:18:31 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:18:31 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:18:31 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef5cbd9d-e20b-4745-a15f-dc9312bbe314]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:18:31 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4220953c-8f03-4033-81ce-8dd9a2ed2eb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5] added
Oct 20 02:18:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0372ff65-b63e-4a7f-8d5f-f62e29b6e66d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[526c79a4-38ab-468d-a09b-0bed9502b3e7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AedRuVJG {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AedRuVJG" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0317f4-3d08-4122-a563-586217451467]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AedRuVJG'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0716b023-2a78-4eb5-9c9e-fb8f3900f198]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d9b6c7-f2c6-4fbb-abf9-6a1fab5612cf]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9b63cf7-7613-4b24-8c84-4975381a92af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260]
Oct 20 02:18:31 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260] successful.
Oct 20 02:18:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0264e66b-5717-430a-91d3-533b6383526c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9feac6f7-ac27-4e6c-b418-8f14e2e8418b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:18:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.324s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] HCTL ('37', '-', '-', 0) found on session 35 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b05b7f1-c550-4b36-ac82-8f4a384e2535]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.518s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:18:31 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.policy [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ac628a224fb4653932a27e33aa33c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112fda62d355421e80e674dc18bb5069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:18:31 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Creating image(s)
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "/opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "/opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "/opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk 1073741824" returned: 0 in 0.048s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.network.neutron [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Successfully created port: b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Checking if we can resize image /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Searching for a device in session 35 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AedRuVJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.370s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] <== connect_volume: return (1372ms) {'type': 'block', 'scsi_wwn': '23735643833386538', 'path': '/dev/sdf'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735643833386538', 'path': '/dev/sdf'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-346873381',display_name='tempest-ServerActionsTestOtherB-server-346873381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-346873381',id=25,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIglcMR+peRa0oE4XH1xEQPQIqhuBje0KSTUzv/TpZRtBBqkKyYxWmNpC0JGbnCtrC95IJdTO6AdIgwEwg+bzGJkzWbXrKT8XXGF365xukpUOAemIbyOpaYNjhmP5ri2Q==',key_name='tempest-keypair-921939156',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:13:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f72d19ab869b4bdeb6798f12ca2ef6ae',ramdisk_id='',reservation_id='r-r3xavz7r',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-215383043',owner_user_name='tempest-ServerActionsTestOtherB-215383043-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de983dabe464ac8a720fc45fc311bf5',uuid=2645af84-8ba4-4a34-beb1-9676cce3dc5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2124958625-network", "vif_mac": "fa:16:3e:1f:ee:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converting VIF {"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2124958625-network", "vif_mac": "fa:16:3e:1f:ee:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:18:32 user nova-compute[74242]:   <uuid>2645af84-8ba4-4a34-beb1-9676cce3dc5f</uuid>
Oct 20 02:18:32 user nova-compute[74242]:   <name>instance-00000019</name>
Oct 20 02:18:32 user nova-compute[74242]:   <memory>2097152</memory>
Oct 20 02:18:32 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:18:32 user nova-compute[74242]:   <metadata>
Oct 20 02:18:32 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:18:32 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:18:32 user nova-compute[74242]:       <nova:name>tempest-ServerActionsTestOtherB-server-346873381</nova:name>
Oct 20 02:18:32 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:18:31</nova:creationTime>
Oct 20 02:18:32 user nova-compute[74242]:       <nova:flavor name="m1.small">
Oct 20 02:18:32 user nova-compute[74242]:         <nova:memory>2048</nova:memory>
Oct 20 02:18:32 user nova-compute[74242]:         <nova:disk>20</nova:disk>
Oct 20 02:18:32 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:18:32 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:18:32 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:18:32 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:18:32 user nova-compute[74242]:       <nova:owner>
Oct 20 02:18:32 user nova-compute[74242]:         <nova:user uuid="7de983dabe464ac8a720fc45fc311bf5">tempest-ServerActionsTestOtherB-215383043-project-member</nova:user>
Oct 20 02:18:32 user nova-compute[74242]:         <nova:project uuid="f72d19ab869b4bdeb6798f12ca2ef6ae">tempest-ServerActionsTestOtherB-215383043</nova:project>
Oct 20 02:18:32 user nova-compute[74242]:       </nova:owner>
Oct 20 02:18:32 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:18:32 user nova-compute[74242]:       <nova:ports>
Oct 20 02:18:32 user nova-compute[74242]:         <nova:port uuid="bfec951d-2a9f-4fec-98a8-e9683bc83787">
Oct 20 02:18:32 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 02:18:32 user nova-compute[74242]:         </nova:port>
Oct 20 02:18:32 user nova-compute[74242]:       </nova:ports>
Oct 20 02:18:32 user nova-compute[74242]:     </nova:instance>
Oct 20 02:18:32 user nova-compute[74242]:   </metadata>
Oct 20 02:18:32 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:18:32 user nova-compute[74242]:     <system>
Oct 20 02:18:32 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:18:32 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:18:32 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:18:32 user nova-compute[74242]:       <entry name="serial">2645af84-8ba4-4a34-beb1-9676cce3dc5f</entry>
Oct 20 02:18:32 user nova-compute[74242]:       <entry name="uuid">2645af84-8ba4-4a34-beb1-9676cce3dc5f</entry>
Oct 20 02:18:32 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:18:32 user nova-compute[74242]:     </system>
Oct 20 02:18:32 user nova-compute[74242]:   </sysinfo>
Oct 20 02:18:32 user nova-compute[74242]:   <os>
Oct 20 02:18:32 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:18:32 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:18:32 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:18:32 user nova-compute[74242]:   </os>
Oct 20 02:18:32 user nova-compute[74242]:   <features>
Oct 20 02:18:32 user nova-compute[74242]:     <acpi/>
Oct 20 02:18:32 user nova-compute[74242]:     <apic/>
Oct 20 02:18:32 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:18:32 user nova-compute[74242]:   </features>
Oct 20 02:18:32 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:18:32 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:18:32 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:18:32 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:18:32 user nova-compute[74242]:   </clock>
Oct 20 02:18:32 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:18:32 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:18:32 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:18:32 user nova-compute[74242]:   </cpu>
Oct 20 02:18:32 user nova-compute[74242]:   <devices>
Oct 20 02:18:32 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:18:32 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:18:32 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk"/>
Oct 20 02:18:32 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:18:32 user nova-compute[74242]:     </disk>
Oct 20 02:18:32 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:18:32 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:18:32 user nova-compute[74242]:       <source dev="/dev/sdf"/>
Oct 20 02:18:32 user nova-compute[74242]:       <target dev="vdb" bus="virtio"/>
Oct 20 02:18:32 user nova-compute[74242]:       <serial>bb8530dc-d2f2-4f73-a60d-f7acd7be85f5</serial>
Oct 20 02:18:32 user nova-compute[74242]:     </disk>
Oct 20 02:18:32 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:18:32 user nova-compute[74242]:       <mac address="fa:16:3e:1f:ee:0a"/>
Oct 20 02:18:32 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:18:32 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:18:32 user nova-compute[74242]:       <target dev="tapbfec951d-2a"/>
Oct 20 02:18:32 user nova-compute[74242]:     </interface>
Oct 20 02:18:32 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:18:32 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/console.log" append="off"/>
Oct 20 02:18:32 user nova-compute[74242]:     </serial>
Oct 20 02:18:32 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:18:32 user nova-compute[74242]:     <video>
Oct 20 02:18:32 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:18:32 user nova-compute[74242]:     </video>
Oct 20 02:18:32 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:18:32 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:18:32 user nova-compute[74242]:     </rng>
Oct 20 02:18:32 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:18:32 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:18:32 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:18:32 user nova-compute[74242]:     </memballoon>
Oct 20 02:18:32 user nova-compute[74242]:   </devices>
Oct 20 02:18:32 user nova-compute[74242]: </domain>
Oct 20 02:18:32 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-346873381',display_name='tempest-ServerActionsTestOtherB-server-346873381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-346873381',id=25,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIglcMR+peRa0oE4XH1xEQPQIqhuBje0KSTUzv/TpZRtBBqkKyYxWmNpC0JGbnCtrC95IJdTO6AdIgwEwg+bzGJkzWbXrKT8XXGF365xukpUOAemIbyOpaYNjhmP5ri2Q==',key_name='tempest-keypair-921939156',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:13:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f72d19ab869b4bdeb6798f12ca2ef6ae',ramdisk_id='',reservation_id='r-r3xavz7r',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-215383043',owner_user_name='tempest-ServerActionsTestOtherB-215383043-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:18:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de983dabe464ac8a720fc45fc311bf5',uuid=2645af84-8ba4-4a34-beb1-9676cce3dc5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2124958625-network", "vif_mac": "fa:16:3e:1f:ee:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converting VIF {"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-2124958625-network", "vif_mac": "fa:16:3e:1f:ee:0a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG os_vif [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71336896-7a38-5f9b-8f8b-61b4705073c9', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfec951d-2a, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfec951d-2a, col_values=(('qos', UUID('c9d89ce1-6c84-4e82-ab65-002d84113427')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfec951d-2a, col_values=(('external_ids', {'iface-id': 'bfec951d-2a9f-4fec-98a8-e9683bc83787', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:ee:0a', 'vm-uuid': '2645af84-8ba4-4a34-beb1-9676cce3dc5f'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:32 user nova-compute[74242]: INFO os_vif [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a')
Oct 20 02:18:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Cannot resize image /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Ensure instance console log exists: /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:18:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] No VIF found with MAC fa:16:3e:1f:ee:0a, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.network.neutron [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Successfully updated port: b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "refresh_cache-876f8f80-9640-43ba-8ec7-0ffe06c82086" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquired lock "refresh_cache-876f8f80-9640-43ba-8ec7-0ffe06c82086" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.network.neutron [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.network.neutron [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-f1734ab0-ba13-4037-b232-b0dd4ca44d35 req-a58b266d-53ed-4144-b10d-08ddf79c95fd service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received event network-changed-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.compute.manager [req-f1734ab0-ba13-4037-b232-b0dd4ca44d35 req-a58b266d-53ed-4144-b10d-08ddf79c95fd service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Refreshing instance network info cache due to event network-changed-b8ad394b-aab1-4d61-a58e-50509bd3cb9d. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f1734ab0-ba13-4037-b232-b0dd4ca44d35 req-a58b266d-53ed-4144-b10d-08ddf79c95fd service nova] Acquiring lock "refresh_cache-876f8f80-9640-43ba-8ec7-0ffe06c82086" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.network.neutron [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Updating instance_info_cache with network_info: [{"id": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "address": "fa:16:3e:7f:cf:92", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ad394b-aa", "ovs_interfaceid": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Releasing lock "refresh_cache-876f8f80-9640-43ba-8ec7-0ffe06c82086" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Instance network_info: |[{"id": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "address": "fa:16:3e:7f:cf:92", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ad394b-aa", "ovs_interfaceid": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f1734ab0-ba13-4037-b232-b0dd4ca44d35 req-a58b266d-53ed-4144-b10d-08ddf79c95fd service nova] Acquired lock "refresh_cache-876f8f80-9640-43ba-8ec7-0ffe06c82086" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.network.neutron [req-f1734ab0-ba13-4037-b232-b0dd4ca44d35 req-a58b266d-53ed-4144-b10d-08ddf79c95fd service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Refreshing network info cache for port b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Start _get_guest_xml network_info=[{"id": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "address": "fa:16:3e:7f:cf:92", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ad394b-aa", "ovs_interfaceid": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:18:33 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:18:33 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-630563716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-630563716',id=32,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112fda62d355421e80e674dc18bb5069',ramdisk_id='',reservation_id='r-yeafms84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:18:32Z,user_data=None,user_id='9ac628a224fb4653932a27e33aa33c9d',uuid=876f8f80-9640-43ba-8ec7-0ffe06c82086,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "address": "fa:16:3e:7f:cf:92", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ad394b-aa", "ovs_interfaceid": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converting VIF {"id": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "address": "fa:16:3e:7f:cf:92", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ad394b-aa", "ovs_interfaceid": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:cf:92,bridge_name='br-int',has_traffic_filtering=True,id=b8ad394b-aab1-4d61-a58e-50509bd3cb9d,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ad394b-aa') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.objects.instance [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'pci_devices' on Instance uuid 876f8f80-9640-43ba-8ec7-0ffe06c82086 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:18:33 user nova-compute[74242]:   <uuid>876f8f80-9640-43ba-8ec7-0ffe06c82086</uuid>
Oct 20 02:18:33 user nova-compute[74242]:   <name>instance-00000020</name>
Oct 20 02:18:33 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:18:33 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:18:33 user nova-compute[74242]:   <metadata>
Oct 20 02:18:33 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:18:33 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:18:33 user nova-compute[74242]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-630563716</nova:name>
Oct 20 02:18:33 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:18:33</nova:creationTime>
Oct 20 02:18:33 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:18:33 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:18:33 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:18:33 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:18:33 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:18:33 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:18:33 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:18:33 user nova-compute[74242]:       <nova:owner>
Oct 20 02:18:33 user nova-compute[74242]:         <nova:user uuid="9ac628a224fb4653932a27e33aa33c9d">tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member</nova:user>
Oct 20 02:18:33 user nova-compute[74242]:         <nova:project uuid="112fda62d355421e80e674dc18bb5069">tempest-ServerBootFromVolumeStableRescueTest-1661425956</nova:project>
Oct 20 02:18:33 user nova-compute[74242]:       </nova:owner>
Oct 20 02:18:33 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:18:33 user nova-compute[74242]:       <nova:ports>
Oct 20 02:18:33 user nova-compute[74242]:         <nova:port uuid="b8ad394b-aab1-4d61-a58e-50509bd3cb9d">
Oct 20 02:18:33 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 02:18:33 user nova-compute[74242]:         </nova:port>
Oct 20 02:18:33 user nova-compute[74242]:       </nova:ports>
Oct 20 02:18:33 user nova-compute[74242]:     </nova:instance>
Oct 20 02:18:33 user nova-compute[74242]:   </metadata>
Oct 20 02:18:33 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:18:33 user nova-compute[74242]:     <system>
Oct 20 02:18:33 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:18:33 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:18:33 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:18:33 user nova-compute[74242]:       <entry name="serial">876f8f80-9640-43ba-8ec7-0ffe06c82086</entry>
Oct 20 02:18:33 user nova-compute[74242]:       <entry name="uuid">876f8f80-9640-43ba-8ec7-0ffe06c82086</entry>
Oct 20 02:18:33 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:18:33 user nova-compute[74242]:     </system>
Oct 20 02:18:33 user nova-compute[74242]:   </sysinfo>
Oct 20 02:18:33 user nova-compute[74242]:   <os>
Oct 20 02:18:33 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:18:33 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:18:33 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:18:33 user nova-compute[74242]:   </os>
Oct 20 02:18:33 user nova-compute[74242]:   <features>
Oct 20 02:18:33 user nova-compute[74242]:     <acpi/>
Oct 20 02:18:33 user nova-compute[74242]:     <apic/>
Oct 20 02:18:33 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:18:33 user nova-compute[74242]:   </features>
Oct 20 02:18:33 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:18:33 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:18:33 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:18:33 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:18:33 user nova-compute[74242]:   </clock>
Oct 20 02:18:33 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:18:33 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:18:33 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:18:33 user nova-compute[74242]:   </cpu>
Oct 20 02:18:33 user nova-compute[74242]:   <devices>
Oct 20 02:18:33 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:18:33 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:18:33 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk"/>
Oct 20 02:18:33 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:18:33 user nova-compute[74242]:     </disk>
Oct 20 02:18:33 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:18:33 user nova-compute[74242]:       <mac address="fa:16:3e:7f:cf:92"/>
Oct 20 02:18:33 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:18:33 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:18:33 user nova-compute[74242]:       <target dev="tapb8ad394b-aa"/>
Oct 20 02:18:33 user nova-compute[74242]:     </interface>
Oct 20 02:18:33 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:18:33 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/console.log" append="off"/>
Oct 20 02:18:33 user nova-compute[74242]:     </serial>
Oct 20 02:18:33 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:18:33 user nova-compute[74242]:     <video>
Oct 20 02:18:33 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:18:33 user nova-compute[74242]:     </video>
Oct 20 02:18:33 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:18:33 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:18:33 user nova-compute[74242]:     </rng>
Oct 20 02:18:33 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:18:33 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:18:33 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:18:33 user nova-compute[74242]:     </memballoon>
Oct 20 02:18:33 user nova-compute[74242]:   </devices>
Oct 20 02:18:33 user nova-compute[74242]: </domain>
Oct 20 02:18:33 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-630563716',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-630563716',id=32,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112fda62d355421e80e674dc18bb5069',ramdisk_id='',reservation_id='r-yeafms84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:18:32Z,user_data=None,user_id='9ac628a224fb4653932a27e33aa33c9d',uuid=876f8f80-9640-43ba-8ec7-0ffe06c82086,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "address": "fa:16:3e:7f:cf:92", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ad394b-aa", "ovs_interfaceid": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converting VIF {"id": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "address": "fa:16:3e:7f:cf:92", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ad394b-aa", "ovs_interfaceid": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7f:cf:92,bridge_name='br-int',has_traffic_filtering=True,id=b8ad394b-aab1-4d61-a58e-50509bd3cb9d,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ad394b-aa') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG os_vif [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:cf:92,bridge_name='br-int',has_traffic_filtering=True,id=b8ad394b-aab1-4d61-a58e-50509bd3cb9d,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ad394b-aa') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7d770e64-9003-5302-a757-b1462d65c5bd', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb8ad394b-aa, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb8ad394b-aa, col_values=(('qos', UUID('db4dafcc-1155-4093-b05a-a7c52359c7b1')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb8ad394b-aa, col_values=(('external_ids', {'iface-id': 'b8ad394b-aab1-4d61-a58e-50509bd3cb9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7f:cf:92', 'vm-uuid': '876f8f80-9640-43ba-8ec7-0ffe06c82086'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:33 user nova-compute[74242]: INFO os_vif [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7f:cf:92,bridge_name='br-int',has_traffic_filtering=True,id=b8ad394b-aab1-4d61-a58e-50509bd3cb9d,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ad394b-aa')
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] No VIF found with MAC fa:16:3e:7f:cf:92, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "fdccf817-4784-472a-85d1-96b5cc37722c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.objects.instance [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lazy-loading 'flavor' on Instance uuid fdccf817-4784-472a-85d1-96b5cc37722c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "fdccf817-4784-472a-85d1-96b5cc37722c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "fdccf817-4784-472a-85d1-96b5cc37722c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:33 user nova-compute[74242]: INFO nova.compute.manager [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Attaching volume 9ddad15b-604d-4140-bf1b-845eaa5bda33 to /dev/vdb
Oct 20 02:18:33 user nova-compute[74242]: DEBUG os_brick.utils [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a964d1-63eb-4289-9f2d-98653e33195a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.network.neutron [req-f1734ab0-ba13-4037-b232-b0dd4ca44d35 req-a58b266d-53ed-4144-b10d-08ddf79c95fd service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Updated VIF entry in instance network info cache for port b8ad394b-aab1-4d61-a58e-50509bd3cb9d. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG nova.network.neutron [req-f1734ab0-ba13-4037-b232-b0dd4ca44d35 req-a58b266d-53ed-4144-b10d-08ddf79c95fd service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Updating instance_info_cache with network_info: [{"id": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "address": "fa:16:3e:7f:cf:92", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ad394b-aa", "ovs_interfaceid": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30eb1aa-22a9-4ef5-bb9b-591217c824c8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:33 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f1734ab0-ba13-4037-b232-b0dd4ca44d35 req-a58b266d-53ed-4144-b10d-08ddf79c95fd service nova] Releasing lock "refresh_cache-876f8f80-9640-43ba-8ec7-0ffe06c82086" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d829d8b4-6eb2-4409-8862-509fcd81a11d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[538b436b-417b-4429-81bd-d8fbacf438a8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:18:34 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:18:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c4b94e-e5e8-4bc3-bc58-0c68fc4833b6]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG os_brick.utils [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updating existing volume attachment record: 8332a44f-77a4-4d73-a457-e74edfeb8e2d {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-27eab0df-664f-4628-97c8-b648fa1dc7fb req-22b60785-0fb2-451a-a780-e2f3d82b8808 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-27eab0df-664f-4628-97c8-b648fa1dc7fb req-22b60785-0fb2-451a-a780-e2f3d82b8808 service nova] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-27eab0df-664f-4628-97c8-b648fa1dc7fb req-22b60785-0fb2-451a-a780-e2f3d82b8808 service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-27eab0df-664f-4628-97c8-b648fa1dc7fb req-22b60785-0fb2-451a-a780-e2f3d82b8808 service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-27eab0df-664f-4628-97c8-b648fa1dc7fb req-22b60785-0fb2-451a-a780-e2f3d82b8808 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] No waiting events found dispatching network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:18:34 user nova-compute[74242]: WARNING nova.compute.manager [req-27eab0df-664f-4628-97c8-b648fa1dc7fb req-22b60785-0fb2-451a-a780-e2f3d82b8808 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received unexpected event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 for instance with vm_state active and task_state resize_finish.
Oct 20 02:18:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:35 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:18:35 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:18:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-798b9403-dea5-4b4c-aa26-3d6444f4e59b req-f99708d5-3d29-4da9-9485-d3edc9281864 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received event network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:18:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-798b9403-dea5-4b4c-aa26-3d6444f4e59b req-f99708d5-3d29-4da9-9485-d3edc9281864 service nova] Acquiring lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-798b9403-dea5-4b4c-aa26-3d6444f4e59b req-f99708d5-3d29-4da9-9485-d3edc9281864 service nova] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-798b9403-dea5-4b4c-aa26-3d6444f4e59b req-f99708d5-3d29-4da9-9485-d3edc9281864 service nova] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-798b9403-dea5-4b4c-aa26-3d6444f4e59b req-f99708d5-3d29-4da9-9485-d3edc9281864 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] No waiting events found dispatching network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:18:35 user nova-compute[74242]: WARNING nova.compute.manager [req-798b9403-dea5-4b4c-aa26-3d6444f4e59b req-f99708d5-3d29-4da9-9485-d3edc9281864 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received unexpected event network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d for instance with vm_state building and task_state spawning.
Oct 20 02:18:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:36 user nova-compute[74242]: DEBUG nova.compute.manager [req-94cd9c96-981e-40b9-b3fc-f64090412cd6 req-6f440005-daee-4d14-8fe7-f24414d6735d service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:18:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-94cd9c96-981e-40b9-b3fc-f64090412cd6 req-6f440005-daee-4d14-8fe7-f24414d6735d service nova] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-94cd9c96-981e-40b9-b3fc-f64090412cd6 req-6f440005-daee-4d14-8fe7-f24414d6735d service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-94cd9c96-981e-40b9-b3fc-f64090412cd6 req-6f440005-daee-4d14-8fe7-f24414d6735d service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:36 user nova-compute[74242]: DEBUG nova.compute.manager [req-94cd9c96-981e-40b9-b3fc-f64090412cd6 req-6f440005-daee-4d14-8fe7-f24414d6735d service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] No waiting events found dispatching network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:18:36 user nova-compute[74242]: WARNING nova.compute.manager [req-94cd9c96-981e-40b9-b3fc-f64090412cd6 req-6f440005-daee-4d14-8fe7-f24414d6735d service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received unexpected event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 for instance with vm_state active and task_state resize_finish.
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Skipping network cache update for instance because it is Building. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid 0636ce59-3cfb-4959-bb28-bce8f4c30043 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:18:37 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 00140923-ae97-40b6-a3a0-37215a45effc is timed out.
Oct 20 02:18:37 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Successfully detached device vdb from instance 00140923-ae97-40b6-a3a0-37215a45effc from the live domain config.
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RGzalnvX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:18:37 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updating instance_info_cache with network_info: [{"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:18:37 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Instance running successfully.
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fc6b96-5d32-4d58-ac0e-562c32cd9415]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:18:37 user nova-compute[74242]: No targets found.
Oct 20 02:18:37 user nova-compute[74242]: iSNS:
Oct 20 02:18:37 user nova-compute[74242]: No targets found.
Oct 20 02:18:37 user nova-compute[74242]: STATIC:
Oct 20 02:18:37 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5
Oct 20 02:18:37 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:18:37 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:18:37 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62
Oct 20 02:18:37 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:18:37 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:18:37 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:18:37 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:18:37 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:18:37 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155
Oct 20 02:18:37 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:18:37 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:18:37 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1
Oct 20 02:18:37 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:18:37 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:18:37 user nova-compute[74242]: FIRMWARE:
Oct 20 02:18:37 user nova-compute[74242]: No targets found.
Oct 20 02:18:37 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:18:37 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:18:37 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Failed to set time: agent not configured {{(pid=74242) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3b84913f-fee5-4299-abd4-961620335c6b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] finish_migration finished successfully. {{(pid=74242) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-0636ce59-3cfb-4959-bb28-bce8f4c30043" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a636fba4-9f02-462a-a621-7397bfb623c3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca13e660-5e7a-436a-a806-b9c6febe8398]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:18:37 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:18:37 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:18:37 user nova-compute[74242]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 (non-flash)
Oct 20 02:18:37 user nova-compute[74242]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:18:37 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:18:37 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:18:37 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:18:37 user nova-compute[74242]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 (non-flash)
Oct 20 02:18:37 user nova-compute[74242]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:18:37 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b8348550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62'): ({'sde'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Removing single pathed devices sde {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[85603a59-e8bf-4152-bb39-63a76beadc3f]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:37 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Instance spawned successfully.
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b766d11-2293-4707-bcbf-b7380fc5d418]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Flushing IO for device /dev/sde {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[893df967-eddf-4756-934d-ee90bb815663]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-7030ed6a-4a00-4ead-aed0-4e84f9356650 req-f8c0d8f7-2240-4d80-a89c-4f0e8d5d4fa5 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received event network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7030ed6a-4a00-4ead-aed0-4e84f9356650 req-f8c0d8f7-2240-4d80-a89c-4f0e8d5d4fa5 service nova] Acquiring lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7030ed6a-4a00-4ead-aed0-4e84f9356650 req-f8c0d8f7-2240-4d80-a89c-4f0e8d5d4fa5 service nova] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7030ed6a-4a00-4ead-aed0-4e84f9356650 req-f8c0d8f7-2240-4d80-a89c-4f0e8d5d4fa5 service nova] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-7030ed6a-4a00-4ead-aed0-4e84f9356650 req-f8c0d8f7-2240-4d80-a89c-4f0e8d5d4fa5 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] No waiting events found dispatching network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:18:37 user nova-compute[74242]: WARNING nova.compute.manager [req-7030ed6a-4a00-4ead-aed0-4e84f9356650 req-f8c0d8f7-2240-4d80-a89c-4f0e8d5d4fa5 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received unexpected event network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d for instance with vm_state building and task_state spawning.
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.058s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7f3b5ea-ed7a-4451-99b5-8dbe93b54a97]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:37 user nova-compute[74242]: INFO nova.compute.manager [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Took 6.06 seconds to spawn the instance on the hypervisor.
Oct 20 02:18:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ba6650-ee42-423c-ba1e-9c2fea649145]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:38 user nova-compute[74242]: INFO nova.compute.manager [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Took 6.94 seconds to build instance.
Oct 20 02:18:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.082s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62d59dd-c943-4003-b8c0-65017cf2e888]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62, portal: 172.16.0.220,3260]
Oct 20 02:18:38 user nova-compute[74242]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62, portal: 172.16.0.220,3260] successful.
Oct 20 02:18:38 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c290006-f344-4e31-965c-b0032578c40c tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.054s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e6d69ae5-2032-4d06-8533-f422a4601a62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a083da-7190-49f6-ab71-a02d65474c9d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.396s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] <== disconnect_volume: return (397ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-66aae64e-fe37-4df8-be09-711394b1a36a req-e2697fc0-50e1-4469-85d9-1b214887c8df service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Received event network-changed-29619557-d774-41f6-9094-cfce655bcd27 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-66aae64e-fe37-4df8-be09-711394b1a36a req-e2697fc0-50e1-4469-85d9-1b214887c8df service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Refreshing instance network info cache due to event network-changed-29619557-d774-41f6-9094-cfce655bcd27. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-66aae64e-fe37-4df8-be09-711394b1a36a req-e2697fc0-50e1-4469-85d9-1b214887c8df service nova] Acquiring lock "refresh_cache-5f96c71b-c391-42bd-8ac8-53ece7b302f5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-66aae64e-fe37-4df8-be09-711394b1a36a req-e2697fc0-50e1-4469-85d9-1b214887c8df service nova] Acquired lock "refresh_cache-5f96c71b-c391-42bd-8ac8-53ece7b302f5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:18:38 user nova-compute[74242]: DEBUG nova.network.neutron [req-66aae64e-fe37-4df8-be09-711394b1a36a req-e2697fc0-50e1-4469-85d9-1b214887c8df service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Refreshing network info cache for port 29619557-d774-41f6-9094-cfce655bcd27 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:18:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:18:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:18:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 02:18:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] There are 0 instances to clean {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 02:18:39 user nova-compute[74242]: DEBUG nova.network.neutron [req-66aae64e-fe37-4df8-be09-711394b1a36a req-e2697fc0-50e1-4469-85d9-1b214887c8df service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Updated VIF entry in instance network info cache for port 29619557-d774-41f6-9094-cfce655bcd27. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:18:39 user nova-compute[74242]: DEBUG nova.network.neutron [req-66aae64e-fe37-4df8-be09-711394b1a36a req-e2697fc0-50e1-4469-85d9-1b214887c8df service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Updating instance_info_cache with network_info: [{"id": "29619557-d774-41f6-9094-cfce655bcd27", "address": "fa:16:3e:6b:ed:0a", "network": {"id": "694ee4ba-c5b8-4c34-a5c3-1bb34288136f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1990549718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3a254f1387b4b929f5396d1db6c4ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29619557-d7", "ovs_interfaceid": "29619557-d774-41f6-9094-cfce655bcd27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:18:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-66aae64e-fe37-4df8-be09-711394b1a36a req-e2697fc0-50e1-4469-85d9-1b214887c8df service nova] Releasing lock "refresh_cache-5f96c71b-c391-42bd-8ac8-53ece7b302f5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:18:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:40 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:18:40 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:18:41 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:18:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:41 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:18:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:18:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:18:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:18:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:45 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:18:45 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7759MB free_disk=24.970504760742188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Applying migration context for instance 3038a67c-0ffd-4652-a3d1-23e4bfda10fe as it has an incoming, in-progress migration 9216e329-8936-4b18-8440-69345512291b. Migration status is finished {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Applying migration context for instance 2645af84-8ba4-4a34-beb1-9676cce3dc5f as it has an incoming, in-progress migration 2a63d998-3ba0-4cca-be80-2ab6d2c5b6ff. Migration status is finished {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 02:18:45 user nova-compute[74242]: INFO nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Updating resource usage from migration 9216e329-8936-4b18-8440-69345512291b
Oct 20 02:18:45 user nova-compute[74242]: INFO nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updating resource usage from migration 2a63d998-3ba0-4cca-be80-2ab6d2c5b6ff
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c98e383a-e1e5-4130-9cc6-a9823db0b88c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 00140923-ae97-40b6-a3a0-37215a45effc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance fdccf817-4784-472a-85d1-96b5cc37722c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Migration 9216e329-8936-4b18-8440-69345512291b is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3038a67c-0ffd-4652-a3d1-23e4bfda10fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 531961c2-d07a-4edc-8714-16ff1fa1a925 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Migration 2a63d998-3ba0-4cca-be80-2ab6d2c5b6ff is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2645af84-8ba4-4a34-beb1-9676cce3dc5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 876f8f80-9640-43ba-8ec7-0ffe06c82086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=9728MB phys_disk=40GB used_disk=27GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing inventories for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Updating ProviderTree inventory for provider 07b40460-b6ac-48c1-8447-e1778d50b26e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Updating inventory in ProviderTree for provider 07b40460-b6ac-48c1-8447-e1778d50b26e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing aggregate associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, aggregates: None {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing trait associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:45 user nova-compute[74242]: DEBUG nova.compute.manager [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Going to confirm migration 1 {{(pid=74242) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG nova.objects.instance [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lazy-loading 'flavor' on Instance uuid 00140923-ae97-40b6-a3a0-37215a45effc {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2fc94b16-2fd2-4bc1-8163-be2b24050112 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "00140923-ae97-40b6-a3a0-37215a45effc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 28.972s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG nova.objects.instance [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lazy-loading 'flavor' on Instance uuid 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquired lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG nova.network.neutron [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG nova.objects.instance [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lazy-loading 'info_cache' on Instance uuid 3038a67c-0ffd-4652-a3d1-23e4bfda10fe {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:46 user nova-compute[74242]: INFO nova.compute.manager [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Attaching volume e797a789-31bb-4cb6-acfa-c54b5970a610 to /dev/vdb
Oct 20 02:18:46 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.234s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74242) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG os_brick.utils [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f33dd8c4-c4d4-4707-86c9-5f4f2c230d67]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a039653-7d85-4096-bc62-aa371aba2ff5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf3beb6-e3a5-4d3b-90e0-43cb2c940f30]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c284c7c-5bf7-480c-b16f-a9f4c76f8b59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:18:46 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[83528ded-1ce4-4827-b6e6-9d326e22ce3d]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG os_brick.utils [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Updating existing volume attachment record: ba5b4d5e-14b4-47e5-aac6-b058bccbc016 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG nova.network.neutron [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Updating instance_info_cache with network_info: [{"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Releasing lock "refresh_cache-3038a67c-0ffd-4652-a3d1-23e4bfda10fe" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:18:46 user nova-compute[74242]: DEBUG nova.objects.instance [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lazy-loading 'migration_context' on Instance uuid 3038a67c-0ffd-4652-a3d1-23e4bfda10fe {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:18:47 user nova-compute[74242]: DEBUG nova.objects.base [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Object Instance<3038a67c-0ffd-4652-a3d1-23e4bfda10fe> lazy-loaded attributes: info_cache,migration_context {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:18:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:18:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:18:47 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:18:47 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:18:47 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:18:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.506s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:47 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Deleted allocation for migration 9216e329-8936-4b18-8440-69345512291b
Oct 20 02:18:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-99629c92-484d-473b-b19c-d4fd60075944 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.849s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:18:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:49 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:18:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:18:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "00140923-ae97-40b6-a3a0-37215a45effc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "00140923-ae97-40b6-a3a0-37215a45effc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "00140923-ae97-40b6-a3a0-37215a45effc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "00140923-ae97-40b6-a3a0-37215a45effc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "00140923-ae97-40b6-a3a0-37215a45effc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:07 user nova-compute[74242]: INFO nova.compute.manager [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Terminating instance
Oct 20 02:19:07 user nova-compute[74242]: DEBUG nova.compute.manager [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:19:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-f2de769b-91ab-4524-96da-686c902eb7f9 req-4d58140d-91d2-4f92-bd86-ee62d18fabcc service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Received event network-vif-unplugged-e35dc654-660d-4088-9144-695a77478839 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f2de769b-91ab-4524-96da-686c902eb7f9 req-4d58140d-91d2-4f92-bd86-ee62d18fabcc service nova] Acquiring lock "00140923-ae97-40b6-a3a0-37215a45effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f2de769b-91ab-4524-96da-686c902eb7f9 req-4d58140d-91d2-4f92-bd86-ee62d18fabcc service nova] Lock "00140923-ae97-40b6-a3a0-37215a45effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f2de769b-91ab-4524-96da-686c902eb7f9 req-4d58140d-91d2-4f92-bd86-ee62d18fabcc service nova] Lock "00140923-ae97-40b6-a3a0-37215a45effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-f2de769b-91ab-4524-96da-686c902eb7f9 req-4d58140d-91d2-4f92-bd86-ee62d18fabcc service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] No waiting events found dispatching network-vif-unplugged-e35dc654-660d-4088-9144-695a77478839 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-f2de769b-91ab-4524-96da-686c902eb7f9 req-4d58140d-91d2-4f92-bd86-ee62d18fabcc service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Received event network-vif-unplugged-e35dc654-660d-4088-9144-695a77478839 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:08 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Instance destroyed successfully.
Oct 20 02:19:08 user nova-compute[74242]: DEBUG nova.objects.instance [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lazy-loading 'resources' on Instance uuid 00140923-ae97-40b6-a3a0-37215a45effc {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:15:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1531114737',display_name='tempest-AttachVolumeNegativeTest-server-1531114737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1531114737',id=28,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPStTf9pKDNr4IG+SGqkXdwgPJvJgJTnvrGbK8kOq6efVfUeMyLZa1FVML8KjGSOj4ndys5STlW4xo7plz/y/1o1GUuu6oJ3XTnoq52lVNrcPPN6hMrjPJsTD1gDkgtShA==',key_name='tempest-keypair-1060541932',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:16:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e74cc27f49384dc78190bd5d9ed7fab9',ramdisk_id='',reservation_id='r-s70o7t0j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1292543897',owner_user_name='tempest-AttachVolumeNegativeTest-1292543897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:16:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3069dcf63864aa08f632601c3a849c5',uuid=00140923-ae97-40b6-a3a0-37215a45effc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e35dc654-660d-4088-9144-695a77478839", "address": "fa:16:3e:b8:83:db", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35dc654-66", "ovs_interfaceid": "e35dc654-660d-4088-9144-695a77478839", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converting VIF {"id": "e35dc654-660d-4088-9144-695a77478839", "address": "fa:16:3e:b8:83:db", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.136", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape35dc654-66", "ovs_interfaceid": "e35dc654-660d-4088-9144-695a77478839", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b8:83:db,bridge_name='br-int',has_traffic_filtering=True,id=e35dc654-660d-4088-9144-695a77478839,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape35dc654-66') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG os_vif [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:83:db,bridge_name='br-int',has_traffic_filtering=True,id=e35dc654-660d-4088-9144-695a77478839,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape35dc654-66') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape35dc654-66, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e290efd-2e9c-4ac9-b12c-16b98df96bf5) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:19:08 user nova-compute[74242]: INFO os_vif [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b8:83:db,bridge_name='br-int',has_traffic_filtering=True,id=e35dc654-660d-4088-9144-695a77478839,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape35dc654-66')
Oct 20 02:19:08 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Deleting instance files /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc_del
Oct 20 02:19:08 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Deletion of /opt/stack/data/nova/instances/00140923-ae97-40b6-a3a0-37215a45effc_del complete
Oct 20 02:19:08 user nova-compute[74242]: INFO nova.compute.manager [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 02:19:08 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:19:08 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:19:09 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:19:09 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Took 0.90 seconds to deallocate network for instance.
Oct 20 02:19:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:09 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:19:10 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:19:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.420s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:10 user nova-compute[74242]: DEBUG nova.compute.manager [req-96eab4fb-4662-4ef5-840c-57c36588d09d req-1e849891-781f-49c7-b1f8-4f1ca1100642 service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Received event network-vif-plugged-e35dc654-660d-4088-9144-695a77478839 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:19:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-96eab4fb-4662-4ef5-840c-57c36588d09d req-1e849891-781f-49c7-b1f8-4f1ca1100642 service nova] Acquiring lock "00140923-ae97-40b6-a3a0-37215a45effc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-96eab4fb-4662-4ef5-840c-57c36588d09d req-1e849891-781f-49c7-b1f8-4f1ca1100642 service nova] Lock "00140923-ae97-40b6-a3a0-37215a45effc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-96eab4fb-4662-4ef5-840c-57c36588d09d req-1e849891-781f-49c7-b1f8-4f1ca1100642 service nova] Lock "00140923-ae97-40b6-a3a0-37215a45effc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:10 user nova-compute[74242]: DEBUG nova.compute.manager [req-96eab4fb-4662-4ef5-840c-57c36588d09d req-1e849891-781f-49c7-b1f8-4f1ca1100642 service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] No waiting events found dispatching network-vif-plugged-e35dc654-660d-4088-9144-695a77478839 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:19:10 user nova-compute[74242]: WARNING nova.compute.manager [req-96eab4fb-4662-4ef5-840c-57c36588d09d req-1e849891-781f-49c7-b1f8-4f1ca1100642 service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Received unexpected event network-vif-plugged-e35dc654-660d-4088-9144-695a77478839 for instance with vm_state deleted and task_state None.
Oct 20 02:19:10 user nova-compute[74242]: DEBUG nova.compute.manager [req-96eab4fb-4662-4ef5-840c-57c36588d09d req-1e849891-781f-49c7-b1f8-4f1ca1100642 service nova] [instance: 00140923-ae97-40b6-a3a0-37215a45effc] Received event network-vif-deleted-e35dc654-660d-4088-9144-695a77478839 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:19:10 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Deleted allocations for instance 00140923-ae97-40b6-a3a0-37215a45effc
Oct 20 02:19:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d59d03f9-4f21-4d6d-b93b-7c6a3160b3ee tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "00140923-ae97-40b6-a3a0-37215a45effc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.427s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-19271694-f180-48e1-b420-8bbce602e7f4 req-0e00d20f-acce-400f-8b26-1c1b1e99317b service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Received event network-changed-6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:19:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-19271694-f180-48e1-b420-8bbce602e7f4 req-0e00d20f-acce-400f-8b26-1c1b1e99317b service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Refreshing instance network info cache due to event network-changed-6d6d2672-e110-4684-8590-a816a23e680a. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:19:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-19271694-f180-48e1-b420-8bbce602e7f4 req-0e00d20f-acce-400f-8b26-1c1b1e99317b service nova] Acquiring lock "refresh_cache-531961c2-d07a-4edc-8714-16ff1fa1a925" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:19:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-19271694-f180-48e1-b420-8bbce602e7f4 req-0e00d20f-acce-400f-8b26-1c1b1e99317b service nova] Acquired lock "refresh_cache-531961c2-d07a-4edc-8714-16ff1fa1a925" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:19:16 user nova-compute[74242]: DEBUG nova.network.neutron [req-19271694-f180-48e1-b420-8bbce602e7f4 req-0e00d20f-acce-400f-8b26-1c1b1e99317b service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Refreshing network info cache for port 6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:19:17 user nova-compute[74242]: DEBUG nova.network.neutron [req-19271694-f180-48e1-b420-8bbce602e7f4 req-0e00d20f-acce-400f-8b26-1c1b1e99317b service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Updated VIF entry in instance network info cache for port 6d6d2672-e110-4684-8590-a816a23e680a. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:19:17 user nova-compute[74242]: DEBUG nova.network.neutron [req-19271694-f180-48e1-b420-8bbce602e7f4 req-0e00d20f-acce-400f-8b26-1c1b1e99317b service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Updating instance_info_cache with network_info: [{"id": "6d6d2672-e110-4684-8590-a816a23e680a", "address": "fa:16:3e:4f:95:67", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d2672-e1", "ovs_interfaceid": "6d6d2672-e110-4684-8590-a816a23e680a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:19:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-19271694-f180-48e1-b420-8bbce602e7f4 req-0e00d20f-acce-400f-8b26-1c1b1e99317b service nova] Releasing lock "refresh_cache-531961c2-d07a-4edc-8714-16ff1fa1a925" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:19:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:19:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:19:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:19:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:19:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGZLuUzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:19:26 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:19:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:19:26 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:19:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:19:26 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:19:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[35896829-16ae-43cf-96b7-8388b9b1bd55]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:19:26 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa7782a-7c3a-4733-9320-d8c608986191]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33] added
Oct 20 02:19:26 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f9fa94-c379-4ee2-9b4a-a4f19317a6c7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[11931931-4983-4326-b1f0-08b75171aa8d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XGZLuUzg {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XGZLuUzg" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44ac5e1-bf3c-4d77-8ad0-b338c4d12924]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XGZLuUzg'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b98bdd4-53cb-48f1-9658-3be902f8bada]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3a237c-12d6-4777-8c0e-40452e402a33]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMosateW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:19:27 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[513775c3-b505-4982-8371-515a7953fb47]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260]
Oct 20 02:19:27 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260] successful.
Oct 20 02:19:27 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbe3a01-37e7-4162-b0ca-7fb3a9be7e6d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4758b5-0e3c-4414-82ef-10cbb2641c8e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:19:27 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.293s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[59beabc5-b779-4f46-82fe-fcfdc2110a44]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:27 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGZLuUzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '26365333833316365', 'path': '/dev/sde'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365333833316365', 'path': '/dev/sde'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.115s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:19:28 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:19:28 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG nova.objects.instance [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lazy-loading 'flavor' on Instance uuid fdccf817-4784-472a-85d1-96b5cc37722c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c90b5368-76cd-4966-ab53-a09ba5186a3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:19:28 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:19:28 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:19:28 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:19:28 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:19:28 user nova-compute[74242]:   <serial>9ddad15b-604d-4140-bf1b-845eaa5bda33</serial>
Oct 20 02:19:28 user nova-compute[74242]: </disk>
Oct 20 02:19:28 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbe6bf8-1cf3-42a8-8c4b-08dc7ee4e8a1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610] added
Oct 20 02:19:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f195c7-c8e1-459b-a19f-3cfc9bbb844b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc82ab3d-be55-4a5a-a1fb-5541836b643f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMosateW {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QMosateW" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dde5a23e-b56c-45cc-8e9b-fa262eb6df22]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QMosateW'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.078s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec2445a-3b00-4ec1-b8d0-514b72166a9d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9da8fd7-eec2-43b6-9b39-abdac5aa5d67]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[40917d17-c4a6-4c1e-8a30-3a9ddf9f5b97]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610, portal: 172.16.0.220,3260]
Oct 20 02:19:28 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610, portal: 172.16.0.220,3260] successful.
Oct 20 02:19:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4555b3dd-c266-4cbb-97a9-794cafaaf0cf]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[318803c6-869b-45da-9116-8576a011cbb0]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)
Oct 20 02:19:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] HCTL ('38', '-', '-', 0) found on session 37 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77495b7-4db2-4f07-9d5f-a22628364123]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] No VIF found with MAC fa:16:3e:88:a9:46, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:19:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a4744035-c149-4e8b-8a4b-6c0a7e69432b tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "fdccf817-4784-472a-85d1-96b5cc37722c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 54.961s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Searching for a device in session 37 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:19:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMosateW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:19:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:19:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] <== connect_volume: return (2532ms) {'type': 'block', 'scsi_wwn': '26332643038646330', 'path': '/dev/sdg'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:19:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26332643038646330', 'path': '/dev/sdg'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:19:29 user nova-compute[74242]: DEBUG nova.objects.instance [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lazy-loading 'flavor' on Instance uuid 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:19:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:19:29 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:19:29 user nova-compute[74242]:   <source dev="/dev/sdg"/>
Oct 20 02:19:29 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:19:29 user nova-compute[74242]:   <serial>e797a789-31bb-4cb6-acfa-c54b5970a610</serial>
Oct 20 02:19:29 user nova-compute[74242]: </disk>
Oct 20 02:19:29 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:19:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:19:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:19:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] No VIF found with MAC fa:16:3e:6b:ed:0a, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:19:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-227542a6-8815-4e76-af45-64a83ff5b3e1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 43.840s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:19:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:35 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:19:37 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:19:37 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:19:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:19:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-39a5ba0f-e581-49c3-a179-62d6c333fa59" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:19:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-39a5ba0f-e581-49c3-a179-62d6c333fa59" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:19:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:19:38 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Updating instance_info_cache with network_info: [{"id": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "address": "fa:16:3e:79:1a:39", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57aa37e7-d4", "ovs_interfaceid": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:19:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-39a5ba0f-e581-49c3-a179-62d6c333fa59" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:19:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:19:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:19:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:19:40 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:19:41 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:19:41 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:19:42 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:19:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:42 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:19:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:19:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:19:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:19:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:19:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:19:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:43 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:19:44 user nova-compute[74242]: INFO nova.compute.claims [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Claim successful on node user
Oct 20 02:19:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-1dfc537c-4470-492e-af6c-d83cb075a07d req-03f90a2e-2abd-4afe-a1c4-8a22a4135638 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received event network-changed-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-1dfc537c-4470-492e-af6c-d83cb075a07d req-03f90a2e-2abd-4afe-a1c4-8a22a4135638 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Refreshing instance network info cache due to event network-changed-006062cf-dcc6-4756-a074-1bf376c16abf. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1dfc537c-4470-492e-af6c-d83cb075a07d req-03f90a2e-2abd-4afe-a1c4-8a22a4135638 service nova] Acquiring lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1dfc537c-4470-492e-af6c-d83cb075a07d req-03f90a2e-2abd-4afe-a1c4-8a22a4135638 service nova] Acquired lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG nova.network.neutron [req-1dfc537c-4470-492e-af6c-d83cb075a07d req-03f90a2e-2abd-4afe-a1c4-8a22a4135638 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Refreshing network info cache for port 006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.728s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:19:44 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:19:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:19:44 user nova-compute[74242]: INFO nova.virt.block_device [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Booting with volume 43ee55e4-2aa2-4b93-ac99-5927df75b7ad at /dev/vda
Oct 20 02:19:45 user nova-compute[74242]: DEBUG os_brick.utils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.policy [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '00ea297f598040fbb338b9ab2e1a1d3a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e137c75824d7429585ddd2245f86a6d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:45 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:19:45 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7719MB free_disk=24.966678619384766GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae111a4-fefd-4a6b-ae18-f0b36bac8f9d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[570fc5e5-5642-4be2-8adf-7f5c901e3cab]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac4e6977-fde8-48a8-9791-aa6140acec33]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[194b6f19-f8f7-4e1a-ba17-cf10645f81b9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:19:45 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[142ae774-7214-4c04-a607-c352f5520cc6]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG os_brick.utils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Updating existing volume attachment record: c43b276d-062e-4fa0-a78a-8a7a5a9d3778 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.network.neutron [req-1dfc537c-4470-492e-af6c-d83cb075a07d req-03f90a2e-2abd-4afe-a1c4-8a22a4135638 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updated VIF entry in instance network info cache for port 006062cf-dcc6-4756-a074-1bf376c16abf. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.network.neutron [req-1dfc537c-4470-492e-af6c-d83cb075a07d req-03f90a2e-2abd-4afe-a1c4-8a22a4135638 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updating instance_info_cache with network_info: [{"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1dfc537c-4470-492e-af6c-d83cb075a07d req-03f90a2e-2abd-4afe-a1c4-8a22a4135638 service nova] Releasing lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Applying migration context for instance 2645af84-8ba4-4a34-beb1-9676cce3dc5f as it has an incoming, in-progress migration 2a63d998-3ba0-4cca-be80-2ab6d2c5b6ff. Migration status is finished {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 20 02:19:45 user nova-compute[74242]: INFO nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updating resource usage from migration 2a63d998-3ba0-4cca-be80-2ab6d2c5b6ff
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c98e383a-e1e5-4130-9cc6-a9823db0b88c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance fdccf817-4784-472a-85d1-96b5cc37722c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3038a67c-0ffd-4652-a3d1-23e4bfda10fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 531961c2-d07a-4edc-8714-16ff1fa1a925 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Migration 2a63d998-3ba0-4cca-be80-2ab6d2c5b6ff is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2645af84-8ba4-4a34-beb1-9676cce3dc5f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 876f8f80-9640-43ba-8ec7-0ffe06c82086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:19:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.597s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:46 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Successfully created port: 3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:19:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-b94bcb6b-2e96-420c-b6cc-0a48a207d92d req-eadb1107-c720-47bf-9158-5d512e4c65ce service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received event network-changed-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:19:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-b94bcb6b-2e96-420c-b6cc-0a48a207d92d req-eadb1107-c720-47bf-9158-5d512e4c65ce service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Refreshing instance network info cache due to event network-changed-006062cf-dcc6-4756-a074-1bf376c16abf. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:19:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b94bcb6b-2e96-420c-b6cc-0a48a207d92d req-eadb1107-c720-47bf-9158-5d512e4c65ce service nova] Acquiring lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:19:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b94bcb6b-2e96-420c-b6cc-0a48a207d92d req-eadb1107-c720-47bf-9158-5d512e4c65ce service nova] Acquired lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:19:46 user nova-compute[74242]: DEBUG nova.network.neutron [req-b94bcb6b-2e96-420c-b6cc-0a48a207d92d req-eadb1107-c720-47bf-9158-5d512e4c65ce service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Refreshing network info cache for port 006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:19:46 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Successfully updated port: 3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:19:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "refresh_cache-9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:19:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquired lock "refresh_cache-9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:19:46 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:19:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-c7558516-17a5-423a-9376-f4ba951c998d req-4e20a7c4-29b3-4379-a6dd-cd91f968b1a5 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Received event network-changed-3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:19:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-c7558516-17a5-423a-9376-f4ba951c998d req-4e20a7c4-29b3-4379-a6dd-cd91f968b1a5 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Refreshing instance network info cache due to event network-changed-3e12123a-bc10-4890-b661-b8dbfc74e420. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:19:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c7558516-17a5-423a-9376-f4ba951c998d req-4e20a7c4-29b3-4379-a6dd-cd91f968b1a5 service nova] Acquiring lock "refresh_cache-9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:19:46 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Updating instance_info_cache with network_info: [{"id": "3e12123a-bc10-4890-b661-b8dbfc74e420", "address": "fa:16:3e:5e:d6:a5", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e12123a-bc", "ovs_interfaceid": "3e12123a-bc10-4890-b661-b8dbfc74e420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Releasing lock "refresh_cache-9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Instance network_info: |[{"id": "3e12123a-bc10-4890-b661-b8dbfc74e420", "address": "fa:16:3e:5e:d6:a5", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e12123a-bc", "ovs_interfaceid": "3e12123a-bc10-4890-b661-b8dbfc74e420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c7558516-17a5-423a-9376-f4ba951c998d req-4e20a7c4-29b3-4379-a6dd-cd91f968b1a5 service nova] Acquired lock "refresh_cache-9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG nova.network.neutron [req-c7558516-17a5-423a-9376-f4ba951c998d req-4e20a7c4-29b3-4379-a6dd-cd91f968b1a5 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Refreshing network info cache for port 3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG nova.network.neutron [req-b94bcb6b-2e96-420c-b6cc-0a48a207d92d req-eadb1107-c720-47bf-9158-5d512e4c65ce service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updated VIF entry in instance network info cache for port 006062cf-dcc6-4756-a074-1bf376c16abf. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG nova.network.neutron [req-b94bcb6b-2e96-420c-b6cc-0a48a207d92d req-eadb1107-c720-47bf-9158-5d512e4c65ce service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updating instance_info_cache with network_info: [{"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b94bcb6b-2e96-420c-b6cc-0a48a207d92d req-eadb1107-c720-47bf-9158-5d512e4c65ce service nova] Releasing lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG nova.network.neutron [req-c7558516-17a5-423a-9376-f4ba951c998d req-4e20a7c4-29b3-4379-a6dd-cd91f968b1a5 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Updated VIF entry in instance network info cache for port 3e12123a-bc10-4890-b661-b8dbfc74e420. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG nova.network.neutron [req-c7558516-17a5-423a-9376-f4ba951c998d req-4e20a7c4-29b3-4379-a6dd-cd91f968b1a5 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Updating instance_info_cache with network_info: [{"id": "3e12123a-bc10-4890-b661-b8dbfc74e420", "address": "fa:16:3e:5e:d6:a5", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e12123a-bc", "ovs_interfaceid": "3e12123a-bc10-4890-b661-b8dbfc74e420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c7558516-17a5-423a-9376-f4ba951c998d req-4e20a7c4-29b3-4379-a6dd-cd91f968b1a5 service nova] Releasing lock "refresh_cache-9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Port bfec951d-2a9f-4fec-98a8-e9683bc83787 binding to destination host user is already ACTIVE {{(pid=74242) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquired lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:19:47 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updating instance_info_cache with network_info: [{"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Releasing lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Creating tmpfile /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/tmpwg06awhf to verify with other compute node that the instance is on the same shared storage. {{(pid=74242) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-33fd74e3-15d7-456d-9b94-e06e2e40383a req-18e2144f-ef57-4caf-b1c7-c0efe25b0b82 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-vif-unplugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-33fd74e3-15d7-456d-9b94-e06e2e40383a req-18e2144f-ef57-4caf-b1c7-c0efe25b0b82 service nova] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-33fd74e3-15d7-456d-9b94-e06e2e40383a req-18e2144f-ef57-4caf-b1c7-c0efe25b0b82 service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-33fd74e3-15d7-456d-9b94-e06e2e40383a req-18e2144f-ef57-4caf-b1c7-c0efe25b0b82 service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-33fd74e3-15d7-456d-9b94-e06e2e40383a req-18e2144f-ef57-4caf-b1c7-c0efe25b0b82 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] No waiting events found dispatching network-vif-unplugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:19:48 user nova-compute[74242]: WARNING nova.compute.manager [req-33fd74e3-15d7-456d-9b94-e06e2e40383a req-18e2144f-ef57-4caf-b1c7-c0efe25b0b82 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received unexpected event network-vif-unplugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 for instance with vm_state resized and task_state resize_reverting.
Oct 20 02:19:48 user nova-compute[74242]: WARNING nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Oct 20 02:19:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 0636ce59-3cfb-4959-bb28-bce8f4c30043 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 39a5ba0f-e581-49c3-a179-62d6c333fa59 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid c98e383a-e1e5-4130-9cc6-a9823db0b88c {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 2645af84-8ba4-4a34-beb1-9676cce3dc5f {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 3038a67c-0ffd-4652-a3d1-23e4bfda10fe {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid fdccf817-4784-472a-85d1-96b5cc37722c {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 531961c2-d07a-4edc-8714-16ff1fa1a925 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 876f8f80-9640-43ba-8ec7-0ffe06c82086 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "0636ce59-3cfb-4959-bb28-bce8f4c30043" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "39a5ba0f-e581-49c3-a179-62d6c333fa59" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:48 user nova-compute[74242]: INFO nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "fdccf817-4784-472a-85d1-96b5cc37722c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "531961c2-d07a-4edc-8714-16ff1fa1a925" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "876f8f80-9640-43ba-8ec7-0ffe06c82086" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.058s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "fdccf817-4784-472a-85d1-96b5cc37722c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.074s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.079s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:49 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Instance destroyed successfully.
Oct 20 02:19:49 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lazy-loading 'resources' on Instance uuid 2645af84-8ba4-4a34-beb1-9676cce3dc5f {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-346873381',display_name='tempest-ServerActionsTestOtherB-server-346873381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-346873381',id=25,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIglcMR+peRa0oE4XH1xEQPQIqhuBje0KSTUzv/TpZRtBBqkKyYxWmNpC0JGbnCtrC95IJdTO6AdIgwEwg+bzGJkzWbXrKT8XXGF365xukpUOAemIbyOpaYNjhmP5ri2Q==',key_name='tempest-keypair-921939156',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f72d19ab869b4bdeb6798f12ca2ef6ae',ramdisk_id='',reservation_id='r-r3xavz7r',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-215383043',owner_user_name='tempest-ServerActionsTestOtherB-215383043-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:18:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de983dabe464ac8a720fc45fc311bf5',uuid=2645af84-8ba4-4a34-beb1-9676cce3dc5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converting VIF {"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_vif [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfec951d-2a, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9d89ce1-6c84-4e82-ab65-002d84113427) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:19:49 user nova-compute[74242]: INFO os_vif [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a')
Oct 20 02:19:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AedRuVJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:19:49 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[29902037-0a63-4684-bfa8-9164fd058574]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:19:49 user nova-compute[74242]: No targets found.
Oct 20 02:19:49 user nova-compute[74242]: iSNS:
Oct 20 02:19:49 user nova-compute[74242]: No targets found.
Oct 20 02:19:49 user nova-compute[74242]: STATIC:
Oct 20 02:19:49 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33
Oct 20 02:19:49 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:19:49 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:19:49 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5
Oct 20 02:19:49 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:19:49 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:19:49 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:19:49 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:19:49 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:19:49 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155
Oct 20 02:19:49 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:19:49 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:19:49 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1
Oct 20 02:19:49 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:19:49 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:19:49 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610
Oct 20 02:19:49 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:19:49 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:19:49 user nova-compute[74242]: FIRMWARE:
Oct 20 02:19:49 user nova-compute[74242]: No targets found.
Oct 20 02:19:49 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:19:49 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:19:49 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ad64e2-4d3a-434a-af38-e3b0ee021bb7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d93dc7-c551-4f03-b0c1-97e694f10b4e]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:49 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:49 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:49 user nova-compute[74242]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:19:49 user nova-compute[74242]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:19:49 user nova-compute[74242]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)
Oct 20 02:19:49 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:49 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:49 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:49 user nova-compute[74242]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:19:49 user nova-compute[74242]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:19:49 user nova-compute[74242]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)
Oct 20 02:19:49 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d00e79a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5'): ({'sdf'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Removing single pathed devices sdf {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07954bd-221e-4a05-9388-99ba19f5142c]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[06207491-512a-42ce-bbc0-1a3cfab55f8e]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Flushing IO for device /dev/sdf {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6196aefb-2b93-4779-9bb5-17c3eb92054e]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba5c59a-75e3-403c-a77f-131390a403fa]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] SCSI volumes sdf have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fd8039-bb2f-4c38-9d8e-39c90b3dd522]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0b1811-8e76-40c7-a738-17a8a0b69a8d]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260]
Oct 20 02:19:49 user nova-compute[74242]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260] successful.
Oct 20 02:19:49 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44e68cc-a1b2-4766-9932-a1a2b7b7a63d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.338s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] <== disconnect_volume: return (339ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:19:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:50 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lazy-loading 'migration_context' on Instance uuid 2645af84-8ba4-4a34-beb1-9676cce3dc5f {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:19:50 user nova-compute[74242]: DEBUG nova.objects.base [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Object Instance<2645af84-8ba4-4a34-beb1-9676cce3dc5f> lazy-loaded attributes: resources,migration_context {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:19:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-6d34e36b-6e86-412f-bb01-e3f4fbb93e7b req-61ae28a2-fde9-4c5f-b06d-18df0b286020 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:19:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6d34e36b-6e86-412f-bb01-e3f4fbb93e7b req-61ae28a2-fde9-4c5f-b06d-18df0b286020 service nova] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6d34e36b-6e86-412f-bb01-e3f4fbb93e7b req-61ae28a2-fde9-4c5f-b06d-18df0b286020 service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6d34e36b-6e86-412f-bb01-e3f4fbb93e7b req-61ae28a2-fde9-4c5f-b06d-18df0b286020 service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-6d34e36b-6e86-412f-bb01-e3f4fbb93e7b req-61ae28a2-fde9-4c5f-b06d-18df0b286020 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] No waiting events found dispatching network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:19:50 user nova-compute[74242]: WARNING nova.compute.manager [req-6d34e36b-6e86-412f-bb01-e3f4fbb93e7b req-61ae28a2-fde9-4c5f-b06d-18df0b286020 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received unexpected event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 for instance with vm_state resized and task_state resize_reverting.
Oct 20 02:19:51 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:19:51 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:19:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.464s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:51 user nova-compute[74242]: INFO nova.compute.manager [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Swapping old allocation on dict_keys(['07b40460-b6ac-48c1-8447-e1778d50b26e']) held by migration 2a63d998-3ba0-4cca-be80-2ab6d2c5b6ff for instance
Oct 20 02:19:51 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Overwriting current allocation {'allocations': {'07b40460-b6ac-48c1-8447-e1778d50b26e': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 42}}, 'project_id': 'f72d19ab869b4bdeb6798f12ca2ef6ae', 'user_id': '7de983dabe464ac8a720fc45fc311bf5', 'consumer_generation': 1} on consumer 2645af84-8ba4-4a34-beb1-9676cce3dc5f {{(pid=74242) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Oct 20 02:19:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:19:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquired lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:19:51 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updating instance_info_cache with network_info: [{"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Releasing lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG os_brick.utils [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0c72ec-a4ee-41e8-bcca-fe3ff14affdb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40d5331-b6eb-4e6f-b9a3-e6e8f247c146]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd461ae1-c603-4cd9-875d-9c734cd5ea18]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1242d835-f149-48d2-b443-047f8801958d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:19:52 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:19:52 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db734fe-a0f6-4d55-bf75-2daf65a65452]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:19:52 user nova-compute[74242]: DEBUG os_brick.utils [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:19:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "fdccf817-4784-472a-85d1-96b5cc37722c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:57 user nova-compute[74242]: INFO nova.compute.manager [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Rebooting instance
Oct 20 02:19:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquired lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updating instance_info_cache with network_info: [{"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Releasing lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-da907362-d230-4855-bf49-d069e833c9aa req-d5e28f33-a4d2-49d2-83c2-ac33bcf020aa service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received event network-vif-unplugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-da907362-d230-4855-bf49-d069e833c9aa req-d5e28f33-a4d2-49d2-83c2-ac33bcf020aa service nova] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-da907362-d230-4855-bf49-d069e833c9aa req-d5e28f33-a4d2-49d2-83c2-ac33bcf020aa service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-da907362-d230-4855-bf49-d069e833c9aa req-d5e28f33-a4d2-49d2-83c2-ac33bcf020aa service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:19:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-da907362-d230-4855-bf49-d069e833c9aa req-d5e28f33-a4d2-49d2-83c2-ac33bcf020aa service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] No waiting events found dispatching network-vif-unplugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:19:57 user nova-compute[74242]: WARNING nova.compute.manager [req-da907362-d230-4855-bf49-d069e833c9aa req-d5e28f33-a4d2-49d2-83c2-ac33bcf020aa service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received unexpected event network-vif-unplugged-006062cf-dcc6-4756-a074-1bf376c16abf for instance with vm_state active and task_state reboot_started_hard.
Oct 20 02:19:58 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Instance destroyed successfully.
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.objects.instance [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lazy-loading 'resources' on Instance uuid fdccf817-4784-472a-85d1-96b5cc37722c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1250993369',display_name='tempest-TestMinimumBasicScenario-server-1250993369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1250993369',id=29,image_ref='e5234cc4-11f6-4a2e-aabc-4d507a10c9e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK58nK6/P7M9XX8Wto2o2Cy7i0fJFGM0D+C6eoGBe2je56k+b9odApg/kqd46JoZFSmd1A/ZjHKFUC29opF6ojgFuWZQ/K0Qwz/+Yn0qBXWUi5tHm6qeiPFv0smmEhnRw==',key_name='tempest-TestMinimumBasicScenario-1841214259',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:16:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7331dc1aa6464021bb371a8ebcf3a42b',ramdisk_id='',reservation_id='r-0b9t5znw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e5234cc4-11f6-4a2e-aabc-4d507a10c9e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-504118242',owner_user_name='tempest-TestMinimumBasicScenario-504118242-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:19:58Z,user_data=None,user_id='8b64ecd6426f429ba929925fca497c82',uuid=fdccf817-4784-472a-85d1-96b5cc37722c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converting VIF {"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:a9:46,bridge_name='br-int',has_traffic_filtering=True,id=006062cf-dcc6-4756-a074-1bf376c16abf,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap006062cf-dc') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_vif [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:a9:46,bridge_name='br-int',has_traffic_filtering=True,id=006062cf-dcc6-4756-a074-1bf376c16abf,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap006062cf-dc') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap006062cf-dc, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=29c00bef-7294-4dee-b3be-0b3d71220fa6) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:19:58 user nova-compute[74242]: INFO os_vif [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:a9:46,bridge_name='br-int',has_traffic_filtering=True,id=006062cf-dcc6-4756-a074-1bf376c16abf,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap006062cf-dc')
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGZLuUzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:19:58 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d576004a-ddff-4d17-ac74-b6d9da8464f4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:19:58 user nova-compute[74242]: No targets found.
Oct 20 02:19:58 user nova-compute[74242]: iSNS:
Oct 20 02:19:58 user nova-compute[74242]: No targets found.
Oct 20 02:19:58 user nova-compute[74242]: STATIC:
Oct 20 02:19:58 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33
Oct 20 02:19:58 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:19:58 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:19:58 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:19:58 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:19:58 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:19:58 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155
Oct 20 02:19:58 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:19:58 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:19:58 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1
Oct 20 02:19:58 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:19:58 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:19:58 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610
Oct 20 02:19:58 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:19:58 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:19:58 user nova-compute[74242]: FIRMWARE:
Oct 20 02:19:58 user nova-compute[74242]: No targets found.
Oct 20 02:19:58 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:19:58 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:19:58 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[be052d4a-1766-4296-9e7e-ff4909570dd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2512814a-20eb-492d-b46a-38beb0aebd4c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:58 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:58 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:58 user nova-compute[74242]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:19:58 user nova-compute[74242]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)
Oct 20 02:19:58 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:58 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:58 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:58 user nova-compute[74242]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:19:58 user nova-compute[74242]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)
Oct 20 02:19:58 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb89477f490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33'): ({'sde'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Removing single pathed devices sde {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[af33005a-f5fb-4268-8870-d08df3ac292a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fcdd98-6aa7-4987-97dc-73cd60cf16d0]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Flushing IO for device /dev/sde {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e099c4f1-2b28-4a32-a1dc-12393502869e]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[29355541-9787-4e96-98f0-098d2f50624d]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[329ff2f7-340d-4c0e-8078-40596a6d7b6a]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[833cd22f-f08d-4b0d-ba44-21e6ef4aa2e7]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260]
Oct 20 02:19:58 user nova-compute[74242]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260] successful.
Oct 20 02:19:58 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.040s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7c8d7e-7557-45da-92d8-b120c3219db4]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] <== disconnect_volume: return (341ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Start _get_guest_xml network_info=[{"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5234cc4-11f6-4a2e-aabc-4d507a10c9e3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'e5234cc4-11f6-4a2e-aabc-4d507a10c9e3'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '8332a44f-77a4-4d73-a457-e74edfeb8e2d', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGZLuUzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'fdccf817-4784-472a-85d1-96b5cc37722c', 'attached_at': '', 'detached_at': '', 'volume_id': '9ddad15b-604d-4140-bf1b-845eaa5bda33', 'serial': '9ddad15b-604d-4140-bf1b-845eaa5bda33'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:19:58 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:19:58 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e5234cc4-11f6-4a2e-aabc-4d507a10c9e3,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.objects.instance [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lazy-loading 'vcpu_model' on Instance uuid fdccf817-4784-472a-85d1-96b5cc37722c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.objects.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Object Instance<fdccf817-4784-472a-85d1-96b5cc37722c> lazy-loaded attributes: resources,vcpu_model {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:19:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGZLuUzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:19:59 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:19:59 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:19:59 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e0ffaa8-92a0-4602-9508-335916ec83ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:19:59 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a29fb5-27fc-48e3-b5b1-a1209be13b1f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33] added
Oct 20 02:19:59 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb942cc-f712-4169-a22e-e2f43e9887d9]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8209608f-b14c-444b-a9b2-39a288aed6a4]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XGZLuUzg {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XGZLuUzg" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad2cde6-43d7-4a65-9bc7-c66164d623dd]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XGZLuUzg'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[917c2eb2-07ef-4f1d-a0b4-ef378ab32193]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3672808f-1959-4259-8fea-fb6f6ff6c9a3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[498a3d2a-d8a8-45e0-8878-c0ce39ff4919]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260]
Oct 20 02:19:59 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260] successful.
Oct 20 02:19:59 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.042s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[14658ad4-4bf9-4c1f-aac0-a3205ce3b7cd]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4600169a-d80f-4332-8380-fe0bb1050d8c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:19:59 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] HCTL ('36', '-', '-', 0) found on session 38 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[78cdfd43-2a3f-426c-998f-f8e39cd04472]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Searching for a device in session 38 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGZLuUzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:19:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-df500b0f-2fc3-4513-a478-2767f7300a81 req-b9b2cf61-9cf9-4404-ac56-e8abbf6c0517 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received event network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-df500b0f-2fc3-4513-a478-2767f7300a81 req-b9b2cf61-9cf9-4404-ac56-e8abbf6c0517 service nova] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-df500b0f-2fc3-4513-a478-2767f7300a81 req-b9b2cf61-9cf9-4404-ac56-e8abbf6c0517 service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-df500b0f-2fc3-4513-a478-2767f7300a81 req-b9b2cf61-9cf9-4404-ac56-e8abbf6c0517 service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-df500b0f-2fc3-4513-a478-2767f7300a81 req-b9b2cf61-9cf9-4404-ac56-e8abbf6c0517 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] No waiting events found dispatching network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:20:00 user nova-compute[74242]: WARNING nova.compute.manager [req-df500b0f-2fc3-4513-a478-2767f7300a81 req-b9b2cf61-9cf9-4404-ac56-e8abbf6c0517 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received unexpected event network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf for instance with vm_state active and task_state reboot_started_hard.
Oct 20 02:20:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] <== connect_volume: return (1377ms) {'type': 'block', 'scsi_wwn': '26365333833316365', 'path': '/dev/sde'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26365333833316365', 'path': '/dev/sde'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1250993369',display_name='tempest-TestMinimumBasicScenario-server-1250993369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1250993369',id=29,image_ref='e5234cc4-11f6-4a2e-aabc-4d507a10c9e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK58nK6/P7M9XX8Wto2o2Cy7i0fJFGM0D+C6eoGBe2je56k+b9odApg/kqd46JoZFSmd1A/ZjHKFUC29opF6ojgFuWZQ/K0Qwz/+Yn0qBXWUi5tHm6qeiPFv0smmEhnRw==',key_name='tempest-TestMinimumBasicScenario-1841214259',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:16:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7331dc1aa6464021bb371a8ebcf3a42b',ramdisk_id='',reservation_id='r-0b9t5znw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e5234cc4-11f6-4a2e-aabc-4d507a10c9e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-504118242',owner_user_name='tempest-TestMinimumBasicScenario-504118242-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:19:58Z,user_data=None,user_id='8b64ecd6426f429ba929925fca497c82',uuid=fdccf817-4784-472a-85d1-96b5cc37722c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converting VIF {"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:a9:46,bridge_name='br-int',has_traffic_filtering=True,id=006062cf-dcc6-4756-a074-1bf376c16abf,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap006062cf-dc') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG nova.objects.instance [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lazy-loading 'pci_devices' on Instance uuid fdccf817-4784-472a-85d1-96b5cc37722c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG nova.objects.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Object Instance<fdccf817-4784-472a-85d1-96b5cc37722c> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:20:00 user nova-compute[74242]:   <uuid>fdccf817-4784-472a-85d1-96b5cc37722c</uuid>
Oct 20 02:20:00 user nova-compute[74242]:   <name>instance-0000001d</name>
Oct 20 02:20:00 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:20:00 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:20:00 user nova-compute[74242]:   <metadata>
Oct 20 02:20:00 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:20:00 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:20:00 user nova-compute[74242]:       <nova:name>tempest-TestMinimumBasicScenario-server-1250993369</nova:name>
Oct 20 02:20:00 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:19:58</nova:creationTime>
Oct 20 02:20:00 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:20:00 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:20:00 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:20:00 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:20:00 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:20:00 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:20:00 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:20:00 user nova-compute[74242]:       <nova:owner>
Oct 20 02:20:00 user nova-compute[74242]:         <nova:user uuid="8b64ecd6426f429ba929925fca497c82">tempest-TestMinimumBasicScenario-504118242-project-member</nova:user>
Oct 20 02:20:00 user nova-compute[74242]:         <nova:project uuid="7331dc1aa6464021bb371a8ebcf3a42b">tempest-TestMinimumBasicScenario-504118242</nova:project>
Oct 20 02:20:00 user nova-compute[74242]:       </nova:owner>
Oct 20 02:20:00 user nova-compute[74242]:       <nova:root type="image" uuid="e5234cc4-11f6-4a2e-aabc-4d507a10c9e3"/>
Oct 20 02:20:00 user nova-compute[74242]:       <nova:ports>
Oct 20 02:20:00 user nova-compute[74242]:         <nova:port uuid="006062cf-dcc6-4756-a074-1bf376c16abf">
Oct 20 02:20:00 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 20 02:20:00 user nova-compute[74242]:         </nova:port>
Oct 20 02:20:00 user nova-compute[74242]:       </nova:ports>
Oct 20 02:20:00 user nova-compute[74242]:     </nova:instance>
Oct 20 02:20:00 user nova-compute[74242]:   </metadata>
Oct 20 02:20:00 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:20:00 user nova-compute[74242]:     <system>
Oct 20 02:20:00 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:20:00 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:20:00 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:20:00 user nova-compute[74242]:       <entry name="serial">fdccf817-4784-472a-85d1-96b5cc37722c</entry>
Oct 20 02:20:00 user nova-compute[74242]:       <entry name="uuid">fdccf817-4784-472a-85d1-96b5cc37722c</entry>
Oct 20 02:20:00 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:20:00 user nova-compute[74242]:     </system>
Oct 20 02:20:00 user nova-compute[74242]:   </sysinfo>
Oct 20 02:20:00 user nova-compute[74242]:   <os>
Oct 20 02:20:00 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:20:00 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:20:00 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:20:00 user nova-compute[74242]:   </os>
Oct 20 02:20:00 user nova-compute[74242]:   <features>
Oct 20 02:20:00 user nova-compute[74242]:     <acpi/>
Oct 20 02:20:00 user nova-compute[74242]:     <apic/>
Oct 20 02:20:00 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:20:00 user nova-compute[74242]:   </features>
Oct 20 02:20:00 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:20:00 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:20:00 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:20:00 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:20:00 user nova-compute[74242]:   </clock>
Oct 20 02:20:00 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:20:00 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:20:00 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:20:00 user nova-compute[74242]:   </cpu>
Oct 20 02:20:00 user nova-compute[74242]:   <devices>
Oct 20 02:20:00 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:20:00 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:20:00 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk"/>
Oct 20 02:20:00 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:20:00 user nova-compute[74242]:     </disk>
Oct 20 02:20:00 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:20:00 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:20:00 user nova-compute[74242]:       <source dev="/dev/sde"/>
Oct 20 02:20:00 user nova-compute[74242]:       <target dev="vdb" bus="virtio"/>
Oct 20 02:20:00 user nova-compute[74242]:       <serial>9ddad15b-604d-4140-bf1b-845eaa5bda33</serial>
Oct 20 02:20:00 user nova-compute[74242]:     </disk>
Oct 20 02:20:00 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:20:00 user nova-compute[74242]:       <mac address="fa:16:3e:88:a9:46"/>
Oct 20 02:20:00 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:20:00 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:20:00 user nova-compute[74242]:       <target dev="tap006062cf-dc"/>
Oct 20 02:20:00 user nova-compute[74242]:     </interface>
Oct 20 02:20:00 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:20:00 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/console.log" append="off"/>
Oct 20 02:20:00 user nova-compute[74242]:     </serial>
Oct 20 02:20:00 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:20:00 user nova-compute[74242]:     <video>
Oct 20 02:20:00 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:20:00 user nova-compute[74242]:     </video>
Oct 20 02:20:00 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:20:00 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:20:00 user nova-compute[74242]:     </rng>
Oct 20 02:20:00 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:20:00 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:20:00 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:20:00 user nova-compute[74242]:     </memballoon>
Oct 20 02:20:00 user nova-compute[74242]:   </devices>
Oct 20 02:20:00 user nova-compute[74242]: </domain>
Oct 20 02:20:00 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG nova.objects.instance [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lazy-loading 'trusted_certs' on Instance uuid fdccf817-4784-472a-85d1-96b5cc37722c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG nova.objects.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Object Instance<fdccf817-4784-472a-85d1-96b5cc37722c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:20:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8 --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Cannot resize image /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG nova.objects.instance [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lazy-loading 'migration_context' on Instance uuid fdccf817-4784-472a-85d1-96b5cc37722c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG nova.objects.base [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Object Instance<fdccf817-4784-472a-85d1-96b5cc37722c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1250993369',display_name='tempest-TestMinimumBasicScenario-server-1250993369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1250993369',id=29,image_ref='e5234cc4-11f6-4a2e-aabc-4d507a10c9e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK58nK6/P7M9XX8Wto2o2Cy7i0fJFGM0D+C6eoGBe2je56k+b9odApg/kqd46JoZFSmd1A/ZjHKFUC29opF6ojgFuWZQ/K0Qwz/+Yn0qBXWUi5tHm6qeiPFv0smmEhnRw==',key_name='tempest-TestMinimumBasicScenario-1841214259',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:16:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='7331dc1aa6464021bb371a8ebcf3a42b',ramdisk_id='',reservation_id='r-0b9t5znw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e5234cc4-11f6-4a2e-aabc-4d507a10c9e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-504118242',owner_user_name='tempest-TestMinimumBasicScenario-504118242-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:19:58Z,user_data=None,user_id='8b64ecd6426f429ba929925fca497c82',uuid=fdccf817-4784-472a-85d1-96b5cc37722c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converting VIF {"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:a9:46,bridge_name='br-int',has_traffic_filtering=True,id=006062cf-dcc6-4756-a074-1bf376c16abf,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap006062cf-dc') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG os_vif [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:a9:46,bridge_name='br-int',has_traffic_filtering=True,id=006062cf-dcc6-4756-a074-1bf376c16abf,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap006062cf-dc') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be17e708-d89f-5e30-b3e0-d06fe919dd25', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap006062cf-dc, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap006062cf-dc, col_values=(('qos', UUID('6fa0147f-5c71-4677-baae-1ebde75fc777')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap006062cf-dc, col_values=(('external_ids', {'iface-id': '006062cf-dcc6-4756-a074-1bf376c16abf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:88:a9:46', 'vm-uuid': 'fdccf817-4784-472a-85d1-96b5cc37722c'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:01 user nova-compute[74242]: INFO os_vif [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:a9:46,bridge_name='br-int',has_traffic_filtering=True,id=006062cf-dcc6-4756-a074-1bf376c16abf,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap006062cf-dc')
Oct 20 02:20:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "62ca0d11-07be-4998-8404-b4d31f1e57da" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG nova.compute.manager [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:20:01 user nova-compute[74242]: INFO nova.compute.claims [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Claim successful on node user
Oct 20 02:20:02 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG nova.network.neutron [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:20:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:20:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:02 user nova-compute[74242]: INFO nova.compute.manager [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Detaching volume e797a789-31bb-4cb6-acfa-c54b5970a610
Oct 20 02:20:02 user nova-compute[74242]: DEBUG nova.policy [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd3069dcf63864aa08f632601c3a849c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e74cc27f49384dc78190bd5d9ed7fab9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:20:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Creating image(s)
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "/opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "/opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "/opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:02 user nova-compute[74242]: INFO nova.virt.block_device [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Attempting to driver detach volume e797a789-31bb-4cb6-acfa-c54b5970a610 from mountpoint /dev/vdb
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Attempting to detach device vdb from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:20:02 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:20:02 user nova-compute[74242]:   <source dev="/dev/sdg"/>
Oct 20 02:20:02 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:20:02 user nova-compute[74242]:   <serial>e797a789-31bb-4cb6-acfa-c54b5970a610</serial>
Oct 20 02:20:02 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:20:02 user nova-compute[74242]: </disk>
Oct 20 02:20:02 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:20:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Successfully detached device vdb from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the persistent domain config.
Oct 20 02:20:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:20:02 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:20:02 user nova-compute[74242]:   <source dev="/dev/sdg"/>
Oct 20 02:20:02 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:20:02 user nova-compute[74242]:   <serial>e797a789-31bb-4cb6-acfa-c54b5970a610</serial>
Oct 20 02:20:02 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:20:02 user nova-compute[74242]: </disk>
Oct 20 02:20:02 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.183s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk 1073741824" returned: 0 in 0.071s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-0b81f04d-5fe9-4623-a3cd-1ea23100ec0d req-c95bbafb-3fdb-4a94-b91c-eff0bd61d0a0 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received event network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0b81f04d-5fe9-4623-a3cd-1ea23100ec0d req-c95bbafb-3fdb-4a94-b91c-eff0bd61d0a0 service nova] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0b81f04d-5fe9-4623-a3cd-1ea23100ec0d req-c95bbafb-3fdb-4a94-b91c-eff0bd61d0a0 service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0b81f04d-5fe9-4623-a3cd-1ea23100ec0d req-c95bbafb-3fdb-4a94-b91c-eff0bd61d0a0 service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-0b81f04d-5fe9-4623-a3cd-1ea23100ec0d req-c95bbafb-3fdb-4a94-b91c-eff0bd61d0a0 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] No waiting events found dispatching network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:20:02 user nova-compute[74242]: WARNING nova.compute.manager [req-0b81f04d-5fe9-4623-a3cd-1ea23100ec0d req-c95bbafb-3fdb-4a94-b91c-eff0bd61d0a0 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received unexpected event network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf for instance with vm_state active and task_state reboot_started_hard.
Oct 20 02:20:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.179s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Checking if we can resize image /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG nova.network.neutron [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Successfully created port: 484c4400-d38e-4b70-9da3-156953fd5c3e {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Cannot resize image /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Ensure instance console log exists: /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG nova.network.neutron [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Successfully updated port: 484c4400-d38e-4b70-9da3-156953fd5c3e {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "refresh_cache-62ca0d11-07be-4998-8404-b4d31f1e57da" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquired lock "refresh_cache-62ca0d11-07be-4998-8404-b4d31f1e57da" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG nova.network.neutron [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG nova.compute.manager [req-86eca0c7-1daf-4a33-b7d1-3bb20121eba4 req-154c7e37-9156-4d55-8d88-a52b0b266c34 service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Received event network-changed-484c4400-d38e-4b70-9da3-156953fd5c3e {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG nova.compute.manager [req-86eca0c7-1daf-4a33-b7d1-3bb20121eba4 req-154c7e37-9156-4d55-8d88-a52b0b266c34 service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Refreshing instance network info cache due to event network-changed-484c4400-d38e-4b70-9da3-156953fd5c3e. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-86eca0c7-1daf-4a33-b7d1-3bb20121eba4 req-154c7e37-9156-4d55-8d88-a52b0b266c34 service nova] Acquiring lock "refresh_cache-62ca0d11-07be-4998-8404-b4d31f1e57da" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:20:03 user nova-compute[74242]: DEBUG nova.network.neutron [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.network.neutron [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Updating instance_info_cache with network_info: [{"id": "484c4400-d38e-4b70-9da3-156953fd5c3e", "address": "fa:16:3e:e1:37:0a", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c4400-d3", "ovs_interfaceid": "484c4400-d38e-4b70-9da3-156953fd5c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Releasing lock "refresh_cache-62ca0d11-07be-4998-8404-b4d31f1e57da" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.compute.manager [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Instance network_info: |[{"id": "484c4400-d38e-4b70-9da3-156953fd5c3e", "address": "fa:16:3e:e1:37:0a", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c4400-d3", "ovs_interfaceid": "484c4400-d38e-4b70-9da3-156953fd5c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-86eca0c7-1daf-4a33-b7d1-3bb20121eba4 req-154c7e37-9156-4d55-8d88-a52b0b266c34 service nova] Acquired lock "refresh_cache-62ca0d11-07be-4998-8404-b4d31f1e57da" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.network.neutron [req-86eca0c7-1daf-4a33-b7d1-3bb20121eba4 req-154c7e37-9156-4d55-8d88-a52b0b266c34 service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Refreshing network info cache for port 484c4400-d38e-4b70-9da3-156953fd5c3e {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Start _get_guest_xml network_info=[{"id": "484c4400-d38e-4b70-9da3-156953fd5c3e", "address": "fa:16:3e:e1:37:0a", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c4400-d3", "ovs_interfaceid": "484c4400-d38e-4b70-9da3-156953fd5c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:20:04 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:20:04 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2065440011',display_name='tempest-AttachVolumeNegativeTest-server-2065440011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2065440011',id=34,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1y2DRKICypqjUCM0U668QPL0QUC1OHghnOuidc/y6poro9sGRPihGgSG/3LUwEymlLnbxL/jm0luYf93CSAu5Eh14NJvT2ViezybIgiYWP8k8wkJ58X+RdxiRVVwaK5Q==',key_name='tempest-keypair-1026500807',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e74cc27f49384dc78190bd5d9ed7fab9',ramdisk_id='',reservation_id='r-ib3y0jtu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1292543897',owner_user_name='tempest-AttachVolumeNegativeTest-1292543897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3069dcf63864aa08f632601c3a849c5',uuid=62ca0d11-07be-4998-8404-b4d31f1e57da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "484c4400-d38e-4b70-9da3-156953fd5c3e", "address": "fa:16:3e:e1:37:0a", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c4400-d3", "ovs_interfaceid": "484c4400-d38e-4b70-9da3-156953fd5c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converting VIF {"id": "484c4400-d38e-4b70-9da3-156953fd5c3e", "address": "fa:16:3e:e1:37:0a", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c4400-d3", "ovs_interfaceid": "484c4400-d38e-4b70-9da3-156953fd5c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:37:0a,bridge_name='br-int',has_traffic_filtering=True,id=484c4400-d38e-4b70-9da3-156953fd5c3e,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484c4400-d3') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.objects.instance [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lazy-loading 'pci_devices' on Instance uuid 62ca0d11-07be-4998-8404-b4d31f1e57da {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:20:04 user nova-compute[74242]:   <uuid>62ca0d11-07be-4998-8404-b4d31f1e57da</uuid>
Oct 20 02:20:04 user nova-compute[74242]:   <name>instance-00000022</name>
Oct 20 02:20:04 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:20:04 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:20:04 user nova-compute[74242]:   <metadata>
Oct 20 02:20:04 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:20:04 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:20:04 user nova-compute[74242]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2065440011</nova:name>
Oct 20 02:20:04 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:20:04</nova:creationTime>
Oct 20 02:20:04 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:20:04 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:20:04 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:20:04 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:20:04 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:20:04 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:20:04 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:20:04 user nova-compute[74242]:       <nova:owner>
Oct 20 02:20:04 user nova-compute[74242]:         <nova:user uuid="d3069dcf63864aa08f632601c3a849c5">tempest-AttachVolumeNegativeTest-1292543897-project-member</nova:user>
Oct 20 02:20:04 user nova-compute[74242]:         <nova:project uuid="e74cc27f49384dc78190bd5d9ed7fab9">tempest-AttachVolumeNegativeTest-1292543897</nova:project>
Oct 20 02:20:04 user nova-compute[74242]:       </nova:owner>
Oct 20 02:20:04 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:20:04 user nova-compute[74242]:       <nova:ports>
Oct 20 02:20:04 user nova-compute[74242]:         <nova:port uuid="484c4400-d38e-4b70-9da3-156953fd5c3e">
Oct 20 02:20:04 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 20 02:20:04 user nova-compute[74242]:         </nova:port>
Oct 20 02:20:04 user nova-compute[74242]:       </nova:ports>
Oct 20 02:20:04 user nova-compute[74242]:     </nova:instance>
Oct 20 02:20:04 user nova-compute[74242]:   </metadata>
Oct 20 02:20:04 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:20:04 user nova-compute[74242]:     <system>
Oct 20 02:20:04 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:20:04 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:20:04 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:20:04 user nova-compute[74242]:       <entry name="serial">62ca0d11-07be-4998-8404-b4d31f1e57da</entry>
Oct 20 02:20:04 user nova-compute[74242]:       <entry name="uuid">62ca0d11-07be-4998-8404-b4d31f1e57da</entry>
Oct 20 02:20:04 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:20:04 user nova-compute[74242]:     </system>
Oct 20 02:20:04 user nova-compute[74242]:   </sysinfo>
Oct 20 02:20:04 user nova-compute[74242]:   <os>
Oct 20 02:20:04 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:20:04 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:20:04 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:20:04 user nova-compute[74242]:   </os>
Oct 20 02:20:04 user nova-compute[74242]:   <features>
Oct 20 02:20:04 user nova-compute[74242]:     <acpi/>
Oct 20 02:20:04 user nova-compute[74242]:     <apic/>
Oct 20 02:20:04 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:20:04 user nova-compute[74242]:   </features>
Oct 20 02:20:04 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:20:04 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:20:04 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:20:04 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:20:04 user nova-compute[74242]:   </clock>
Oct 20 02:20:04 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:20:04 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:20:04 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:20:04 user nova-compute[74242]:   </cpu>
Oct 20 02:20:04 user nova-compute[74242]:   <devices>
Oct 20 02:20:04 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:20:04 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:20:04 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk"/>
Oct 20 02:20:04 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:20:04 user nova-compute[74242]:     </disk>
Oct 20 02:20:04 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:20:04 user nova-compute[74242]:       <mac address="fa:16:3e:e1:37:0a"/>
Oct 20 02:20:04 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:20:04 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:20:04 user nova-compute[74242]:       <target dev="tap484c4400-d3"/>
Oct 20 02:20:04 user nova-compute[74242]:     </interface>
Oct 20 02:20:04 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:20:04 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/console.log" append="off"/>
Oct 20 02:20:04 user nova-compute[74242]:     </serial>
Oct 20 02:20:04 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:20:04 user nova-compute[74242]:     <video>
Oct 20 02:20:04 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:20:04 user nova-compute[74242]:     </video>
Oct 20 02:20:04 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:20:04 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:20:04 user nova-compute[74242]:     </rng>
Oct 20 02:20:04 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:20:04 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:20:04 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:20:04 user nova-compute[74242]:     </memballoon>
Oct 20 02:20:04 user nova-compute[74242]:   </devices>
Oct 20 02:20:04 user nova-compute[74242]: </domain>
Oct 20 02:20:04 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2065440011',display_name='tempest-AttachVolumeNegativeTest-server-2065440011',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2065440011',id=34,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1y2DRKICypqjUCM0U668QPL0QUC1OHghnOuidc/y6poro9sGRPihGgSG/3LUwEymlLnbxL/jm0luYf93CSAu5Eh14NJvT2ViezybIgiYWP8k8wkJ58X+RdxiRVVwaK5Q==',key_name='tempest-keypair-1026500807',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e74cc27f49384dc78190bd5d9ed7fab9',ramdisk_id='',reservation_id='r-ib3y0jtu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1292543897',owner_user_name='tempest-AttachVolumeNegativeTest-1292543897-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:20:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3069dcf63864aa08f632601c3a849c5',uuid=62ca0d11-07be-4998-8404-b4d31f1e57da,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "484c4400-d38e-4b70-9da3-156953fd5c3e", "address": "fa:16:3e:e1:37:0a", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c4400-d3", "ovs_interfaceid": "484c4400-d38e-4b70-9da3-156953fd5c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converting VIF {"id": "484c4400-d38e-4b70-9da3-156953fd5c3e", "address": "fa:16:3e:e1:37:0a", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c4400-d3", "ovs_interfaceid": "484c4400-d38e-4b70-9da3-156953fd5c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:37:0a,bridge_name='br-int',has_traffic_filtering=True,id=484c4400-d38e-4b70-9da3-156953fd5c3e,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484c4400-d3') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG os_vif [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:37:0a,bridge_name='br-int',has_traffic_filtering=True,id=484c4400-d38e-4b70-9da3-156953fd5c3e,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484c4400-d3') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec90ee13-50e1-5b37-8177-ab56dc7cc51d', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap484c4400-d3, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap484c4400-d3, col_values=(('qos', UUID('ca48ac25-0108-44e1-9ffd-b40a265156db')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap484c4400-d3, col_values=(('external_ids', {'iface-id': '484c4400-d38e-4b70-9da3-156953fd5c3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:37:0a', 'vm-uuid': '62ca0d11-07be-4998-8404-b4d31f1e57da'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:04 user nova-compute[74242]: INFO os_vif [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:37:0a,bridge_name='br-int',has_traffic_filtering=True,id=484c4400-d38e-4b70-9da3-156953fd5c3e,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484c4400-d3')
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] No VIF found with MAC fa:16:3e:e1:37:0a, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.network.neutron [req-86eca0c7-1daf-4a33-b7d1-3bb20121eba4 req-154c7e37-9156-4d55-8d88-a52b0b266c34 service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Updated VIF entry in instance network info cache for port 484c4400-d38e-4b70-9da3-156953fd5c3e. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.network.neutron [req-86eca0c7-1daf-4a33-b7d1-3bb20121eba4 req-154c7e37-9156-4d55-8d88-a52b0b266c34 service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Updating instance_info_cache with network_info: [{"id": "484c4400-d38e-4b70-9da3-156953fd5c3e", "address": "fa:16:3e:e1:37:0a", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c4400-d3", "ovs_interfaceid": "484c4400-d38e-4b70-9da3-156953fd5c3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-86eca0c7-1daf-4a33-b7d1-3bb20121eba4 req-154c7e37-9156-4d55-8d88-a52b0b266c34 service nova] Releasing lock "refresh_cache-62ca0d11-07be-4998-8404-b4d31f1e57da" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG nova.compute.manager [req-6b81db9c-81ec-4872-9797-edbd14c6f8f9 req-09206cc2-e5e8-4a9a-8617-c7b921d8a416 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received event network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:20:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6b81db9c-81ec-4872-9797-edbd14c6f8f9 req-09206cc2-e5e8-4a9a-8617-c7b921d8a416 service nova] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6b81db9c-81ec-4872-9797-edbd14c6f8f9 req-09206cc2-e5e8-4a9a-8617-c7b921d8a416 service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6b81db9c-81ec-4872-9797-edbd14c6f8f9 req-09206cc2-e5e8-4a9a-8617-c7b921d8a416 service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-6b81db9c-81ec-4872-9797-edbd14c6f8f9 req-09206cc2-e5e8-4a9a-8617-c7b921d8a416 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] No waiting events found dispatching network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:20:05 user nova-compute[74242]: WARNING nova.compute.manager [req-6b81db9c-81ec-4872-9797-edbd14c6f8f9 req-09206cc2-e5e8-4a9a-8617-c7b921d8a416 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received unexpected event network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf for instance with vm_state active and task_state reboot_started_hard.
Oct 20 02:20:05 user nova-compute[74242]: DEBUG nova.compute.manager [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:20:05 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Instance rebooted successfully.
Oct 20 02:20:05 user nova-compute[74242]: DEBUG nova.compute.manager [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:20:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2b96fddd-4465-45a0-bc64-de29f2e93dca tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "fdccf817-4784-472a-85d1-96b5cc37722c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.340s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7ee43c5-9f06-4e32-9a9c-32e813131ffb req-3dfebd71-6e2c-42e4-8d6e-e9eaad2cd51e service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Received event network-vif-plugged-484c4400-d38e-4b70-9da3-156953fd5c3e {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:20:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7ee43c5-9f06-4e32-9a9c-32e813131ffb req-3dfebd71-6e2c-42e4-8d6e-e9eaad2cd51e service nova] Acquiring lock "62ca0d11-07be-4998-8404-b4d31f1e57da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7ee43c5-9f06-4e32-9a9c-32e813131ffb req-3dfebd71-6e2c-42e4-8d6e-e9eaad2cd51e service nova] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7ee43c5-9f06-4e32-9a9c-32e813131ffb req-3dfebd71-6e2c-42e4-8d6e-e9eaad2cd51e service nova] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7ee43c5-9f06-4e32-9a9c-32e813131ffb req-3dfebd71-6e2c-42e4-8d6e-e9eaad2cd51e service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] No waiting events found dispatching network-vif-plugged-484c4400-d38e-4b70-9da3-156953fd5c3e {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:20:07 user nova-compute[74242]: WARNING nova.compute.manager [req-d7ee43c5-9f06-4e32-9a9c-32e813131ffb req-3dfebd71-6e2c-42e4-8d6e-e9eaad2cd51e service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Received unexpected event network-vif-plugged-484c4400-d38e-4b70-9da3-156953fd5c3e for instance with vm_state building and task_state spawning.
Oct 20 02:20:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7ee43c5-9f06-4e32-9a9c-32e813131ffb req-3dfebd71-6e2c-42e4-8d6e-e9eaad2cd51e service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Received event network-vif-plugged-484c4400-d38e-4b70-9da3-156953fd5c3e {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:20:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7ee43c5-9f06-4e32-9a9c-32e813131ffb req-3dfebd71-6e2c-42e4-8d6e-e9eaad2cd51e service nova] Acquiring lock "62ca0d11-07be-4998-8404-b4d31f1e57da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7ee43c5-9f06-4e32-9a9c-32e813131ffb req-3dfebd71-6e2c-42e4-8d6e-e9eaad2cd51e service nova] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7ee43c5-9f06-4e32-9a9c-32e813131ffb req-3dfebd71-6e2c-42e4-8d6e-e9eaad2cd51e service nova] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7ee43c5-9f06-4e32-9a9c-32e813131ffb req-3dfebd71-6e2c-42e4-8d6e-e9eaad2cd51e service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] No waiting events found dispatching network-vif-plugged-484c4400-d38e-4b70-9da3-156953fd5c3e {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:20:07 user nova-compute[74242]: WARNING nova.compute.manager [req-d7ee43c5-9f06-4e32-9a9c-32e813131ffb req-3dfebd71-6e2c-42e4-8d6e-e9eaad2cd51e service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Received unexpected event network-vif-plugged-484c4400-d38e-4b70-9da3-156953fd5c3e for instance with vm_state building and task_state spawning.
Oct 20 02:20:08 user nova-compute[74242]: DEBUG nova.compute.manager [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:20:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:20:08 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Instance spawned successfully.
Oct 20 02:20:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:20:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:20:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:20:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:20:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:20:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:20:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:20:08 user nova-compute[74242]: INFO nova.compute.manager [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Took 5.76 seconds to spawn the instance on the hypervisor.
Oct 20 02:20:08 user nova-compute[74242]: DEBUG nova.compute.manager [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:20:08 user nova-compute[74242]: INFO nova.compute.manager [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Took 6.68 seconds to build instance.
Oct 20 02:20:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5b3e8616-9770-4298-bcbc-1320bc3b7ca1 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.795s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:20:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:22 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:20:22 user nova-compute[74242]: INFO nova.compute.manager [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] instance snapshotting
Oct 20 02:20:22 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Beginning live snapshot process
Oct 20 02:20:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json -f qcow2 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json -f qcow2" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json -f qcow2 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json -f qcow2" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.172s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv6cr49op/fc41fd5225164c1ea7afde188c815662.delta 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:23 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 is timed out.
Oct 20 02:20:23 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Successfully detached device vdb from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the live domain config.
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpv6cr49op/fc41fd5225164c1ea7afde188c815662.delta 1073741824" returned: 0 in 0.051s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:23 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 02:20:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QMosateW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:20:23 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb515d99-a3a4-437b-b037-dd1f8eeb0f0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:20:23 user nova-compute[74242]: No targets found.
Oct 20 02:20:23 user nova-compute[74242]: iSNS:
Oct 20 02:20:23 user nova-compute[74242]: No targets found.
Oct 20 02:20:23 user nova-compute[74242]: STATIC:
Oct 20 02:20:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33
Oct 20 02:20:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:20:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:20:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:20:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:20:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:20:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155
Oct 20 02:20:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:20:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:20:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1
Oct 20 02:20:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:20:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:20:23 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610
Oct 20 02:20:23 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:20:23 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:20:23 user nova-compute[74242]: FIRMWARE:
Oct 20 02:20:23 user nova-compute[74242]: No targets found.
Oct 20 02:20:23 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:20:23 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:20:23 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bfcacb-9ade-480f-a2cb-27130ebaaa66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[89bf4806-ba0a-44b2-9107-82106b264f26]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:20:23 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:20:23 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:20:23 user nova-compute[74242]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)
Oct 20 02:20:23 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:20:23 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:20:23 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:20:23 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:20:23 user nova-compute[74242]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 (non-flash)
Oct 20 02:20:23 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:20:23 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b84d6320>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610'): ({'sdg'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Removing single pathed devices sdg {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6718877e-66d4-4c32-a0d1-a8640b939ef0]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[627cd392-8706-40d3-9ae3-3e147bc716ba]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Flushing IO for device /dev/sdg {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8512120c-bb34-461b-ac0d-0c00d696af80]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[92878ce8-e138-4fb0-9e17-25d0e448dba4]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] SCSI volumes sdg have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6e8c7b4-aa70-4ab0-90a7-58655c6c23ec]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7c387a-7807-4725-9455-df644e47ce86]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610, portal: 172.16.0.220,3260]
Oct 20 02:20:23 user nova-compute[74242]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610, portal: 172.16.0.220,3260] successful.
Oct 20 02:20:23 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e797a789-31bb-4cb6-acfa-c54b5970a610 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[572b45a1-1ce5-4c73-b88f-3f87e43174a3]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] <== disconnect_volume: return (319ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:20:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:20:24 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lazy-loading 'flavor' on Instance uuid 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:20:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:20:24 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 02:20:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1fdc0d4e-1b94-4de1-b2b5-7adc42d22ff1 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.023s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:24 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:20:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv6cr49op/fc41fd5225164c1ea7afde188c815662.delta /opt/stack/data/nova/instances/snapshots/tmpv6cr49op/fc41fd5225164c1ea7afde188c815662 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpv6cr49op/fc41fd5225164c1ea7afde188c815662.delta /opt/stack/data/nova/instances/snapshots/tmpv6cr49op/fc41fd5225164c1ea7afde188c815662" returned: 0 in 0.435s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:24 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Snapshot extracted, beginning image upload
Oct 20 02:20:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:27 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Snapshot image upload complete
Oct 20 02:20:27 user nova-compute[74242]: INFO nova.compute.manager [None req-e07557c3-dcb0-45bc-94a4-7adc39ed435f tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Took 5.37 seconds to snapshot the instance on the hypervisor.
Oct 20 02:20:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Starting finish_revert_migration {{(pid=74242) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Start _get_guest_xml network_info=[{"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': '7e2c22b7-8513-477c-819f-fce8260e5e4f', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AedRuVJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '2645af84-8ba4-4a34-beb1-9676cce3dc5f', 'attached_at': '2023-10-20T02:20:29.000000', 'detached_at': '', 'volume_id': 'bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 'serial': 'bb8530dc-d2f2-4f73-a60d-f7acd7be85f5'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:20:29 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:20:29 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2645af84-8ba4-4a34-beb1-9676cce3dc5f {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AedRuVJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:20:29 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:20:29 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:20:29 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:20:29 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Creating image(s)
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Ensure instance console log exists: /opt/stack/data/nova/instances/9a457b3f-924a-4f7b-9a8b-44ea3c3c1339/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Start _get_guest_xml network_info=[{"id": "3e12123a-bc10-4890-b661-b8dbfc74e420", "address": "fa:16:3e:5e:d6:a5", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e12123a-bc", "ovs_interfaceid": "3e12123a-bc10-4890-b661-b8dbfc74e420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': 'c43b276d-062e-4fa0-a78a-8a7a5a9d3778', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAPnXGtu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9a457b3f-924a-4f7b-9a8b-44ea3c3c1339', 'attached_at': '', 'detached_at': '', 'volume_id': '43ee55e4-2aa2-4b93-ac99-5927df75b7ad', 'serial': '43ee55e4-2aa2-4b93-ac99-5927df75b7ad'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:29 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:20:29 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a1ae8d-54f8-4998-852f-785b110c3186]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:20:29 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAPnXGtu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:20:29 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec78c26-9bef-45d6-a0b6-c4cc75fd564a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5] added
Oct 20 02:20:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae6bd34-ca63-4422-8c15-7ba928689a62]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.056s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83d36fc-5ec4-40e0-84b1-65b61673d19f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AedRuVJG {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AedRuVJG" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[699d1fab-4bea-4c4b-b661-b404800f16ae]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AedRuVJG'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[946f1484-adcb-4c91-9032-0e4162da9475]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[557c077f-07cf-4ce6-b68b-28165a776198]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d610e2-b358-49a3-98b0-794ce854cdac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260]
Oct 20 02:20:29 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260] successful.
Oct 20 02:20:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af79293-d772-4831-b825-d0464f6ed01a]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c9a8eaa-2b4b-49dc-9ebc-0a3b4884ae0d]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:20:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.350s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] HCTL ('37', '-', '-', 0) found on session 39 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb0699f-eec2-4d1e-a812-ed4a5387298b]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Searching for a device in session 39 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AedRuVJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:20:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '23735643833386538', 'path': '/dev/sdf'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735643833386538', 'path': '/dev/sdf'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.323s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:20:30 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:20:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:20:30 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:20:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e0a817-6186-44f7-895e-aa3247ac4868]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:20:30 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-346873381',display_name='tempest-ServerActionsTestOtherB-server-346873381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-346873381',id=25,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIglcMR+peRa0oE4XH1xEQPQIqhuBje0KSTUzv/TpZRtBBqkKyYxWmNpC0JGbnCtrC95IJdTO6AdIgwEwg+bzGJkzWbXrKT8XXGF365xukpUOAemIbyOpaYNjhmP5ri2Q==',key_name='tempest-keypair-921939156',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f72d19ab869b4bdeb6798f12ca2ef6ae',ramdisk_id='',reservation_id='r-r3xavz7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-215383043',owner_user_name='tempest-ServerActionsTestOtherB-215383043-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de983dabe464ac8a720fc45fc311bf5',uuid=2645af84-8ba4-4a34-beb1-9676cce3dc5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converting VIF {"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:20:30 user nova-compute[74242]:   <uuid>2645af84-8ba4-4a34-beb1-9676cce3dc5f</uuid>
Oct 20 02:20:30 user nova-compute[74242]:   <name>instance-00000019</name>
Oct 20 02:20:30 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:20:30 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:20:30 user nova-compute[74242]:   <metadata>
Oct 20 02:20:30 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:20:30 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:20:30 user nova-compute[74242]:       <nova:name>tempest-ServerActionsTestOtherB-server-346873381</nova:name>
Oct 20 02:20:30 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:20:29</nova:creationTime>
Oct 20 02:20:30 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:20:30 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:20:30 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:20:30 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:20:30 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:20:30 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:20:30 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:20:30 user nova-compute[74242]:       <nova:owner>
Oct 20 02:20:30 user nova-compute[74242]:         <nova:user uuid="7de983dabe464ac8a720fc45fc311bf5">tempest-ServerActionsTestOtherB-215383043-project-member</nova:user>
Oct 20 02:20:30 user nova-compute[74242]:         <nova:project uuid="f72d19ab869b4bdeb6798f12ca2ef6ae">tempest-ServerActionsTestOtherB-215383043</nova:project>
Oct 20 02:20:30 user nova-compute[74242]:       </nova:owner>
Oct 20 02:20:30 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:20:30 user nova-compute[74242]:       <nova:ports>
Oct 20 02:20:30 user nova-compute[74242]:         <nova:port uuid="bfec951d-2a9f-4fec-98a8-e9683bc83787">
Oct 20 02:20:30 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 02:20:30 user nova-compute[74242]:         </nova:port>
Oct 20 02:20:30 user nova-compute[74242]:       </nova:ports>
Oct 20 02:20:30 user nova-compute[74242]:     </nova:instance>
Oct 20 02:20:30 user nova-compute[74242]:   </metadata>
Oct 20 02:20:30 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:20:30 user nova-compute[74242]:     <system>
Oct 20 02:20:30 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:20:30 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:20:30 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:20:30 user nova-compute[74242]:       <entry name="serial">2645af84-8ba4-4a34-beb1-9676cce3dc5f</entry>
Oct 20 02:20:30 user nova-compute[74242]:       <entry name="uuid">2645af84-8ba4-4a34-beb1-9676cce3dc5f</entry>
Oct 20 02:20:30 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:20:30 user nova-compute[74242]:     </system>
Oct 20 02:20:30 user nova-compute[74242]:   </sysinfo>
Oct 20 02:20:30 user nova-compute[74242]:   <os>
Oct 20 02:20:30 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:20:30 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:20:30 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:20:30 user nova-compute[74242]:   </os>
Oct 20 02:20:30 user nova-compute[74242]:   <features>
Oct 20 02:20:30 user nova-compute[74242]:     <acpi/>
Oct 20 02:20:30 user nova-compute[74242]:     <apic/>
Oct 20 02:20:30 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:20:30 user nova-compute[74242]:   </features>
Oct 20 02:20:30 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:20:30 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:20:30 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:20:30 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:20:30 user nova-compute[74242]:   </clock>
Oct 20 02:20:30 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:20:30 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:20:30 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:20:30 user nova-compute[74242]:   </cpu>
Oct 20 02:20:30 user nova-compute[74242]:   <devices>
Oct 20 02:20:30 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:20:30 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:20:30 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk"/>
Oct 20 02:20:30 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:20:30 user nova-compute[74242]:     </disk>
Oct 20 02:20:30 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:20:30 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:20:30 user nova-compute[74242]:       <source dev="/dev/sdf"/>
Oct 20 02:20:30 user nova-compute[74242]:       <target dev="vdb" bus="virtio"/>
Oct 20 02:20:30 user nova-compute[74242]:       <serial>bb8530dc-d2f2-4f73-a60d-f7acd7be85f5</serial>
Oct 20 02:20:30 user nova-compute[74242]:     </disk>
Oct 20 02:20:30 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:20:30 user nova-compute[74242]:       <mac address="fa:16:3e:1f:ee:0a"/>
Oct 20 02:20:30 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:20:30 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:20:30 user nova-compute[74242]:       <target dev="tapbfec951d-2a"/>
Oct 20 02:20:30 user nova-compute[74242]:     </interface>
Oct 20 02:20:30 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:20:30 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/console.log" append="off"/>
Oct 20 02:20:30 user nova-compute[74242]:     </serial>
Oct 20 02:20:30 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:20:30 user nova-compute[74242]:     <video>
Oct 20 02:20:30 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:20:30 user nova-compute[74242]:     </video>
Oct 20 02:20:30 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:20:30 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:20:30 user nova-compute[74242]:     </rng>
Oct 20 02:20:30 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:20:30 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:20:30 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:20:30 user nova-compute[74242]:     </memballoon>
Oct 20 02:20:30 user nova-compute[74242]:   </devices>
Oct 20 02:20:30 user nova-compute[74242]: </domain>
Oct 20 02:20:30 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-346873381',display_name='tempest-ServerActionsTestOtherB-server-346873381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-346873381',id=25,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIglcMR+peRa0oE4XH1xEQPQIqhuBje0KSTUzv/TpZRtBBqkKyYxWmNpC0JGbnCtrC95IJdTO6AdIgwEwg+bzGJkzWbXrKT8XXGF365xukpUOAemIbyOpaYNjhmP5ri2Q==',key_name='tempest-keypair-921939156',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='f72d19ab869b4bdeb6798f12ca2ef6ae',ramdisk_id='',reservation_id='r-r3xavz7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-215383043',owner_user_name='tempest-ServerActionsTestOtherB-215383043-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:19:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de983dabe464ac8a720fc45fc311bf5',uuid=2645af84-8ba4-4a34-beb1-9676cce3dc5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converting VIF {"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG os_vif [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '71336896-7a38-5f9b-8f8b-61b4705073c9', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9a69bf-fe4b-43d8-ace6-b35f4c57a2ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad] added
Oct 20 02:20:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbfec951d-2a, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbfec951d-2a, col_values=(('qos', UUID('bca511d4-2d33-4935-93ce-60fcf08f2a94')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbfec951d-2a, col_values=(('external_ids', {'iface-id': 'bfec951d-2a9f-4fec-98a8-e9683bc83787', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:ee:0a', 'vm-uuid': '2645af84-8ba4-4a34-beb1-9676cce3dc5f'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:31 user nova-compute[74242]: INFO os_vif [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a')
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47357ff-457c-482f-b819-923abb76397a]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[65916dee-59c5-4485-9ef8-f84684118505]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sAPnXGtu {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sAPnXGtu" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae660e37-d8fc-48e5-86c0-02875a127dce]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sAPnXGtu'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e29217-5036-457c-ade6-d7358a644bd7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7f5379-cb96-412b-bda3-051a20785aa2]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[25420dc5-5db3-4b59-a531-17b5ff155e66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad, portal: 172.16.0.220,3260]
Oct 20 02:20:31 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad, portal: 172.16.0.220,3260] successful.
Oct 20 02:20:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ce43cce-527c-4e47-9726-7a0d118f1137]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b08bab-4a9c-45bc-94ee-c5c499545d6b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:20:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:20:31 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:20:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9ab2155-5196-4535-a791-f959c54683c3]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:20:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAPnXGtu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.360s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== connect_volume: return (2683ms) {'type': 'block', 'scsi_wwn': '26464306638343363', 'path': '/dev/sdg'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464306638343363', 'path': '/dev/sdg'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:19:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-772823707',display_name='tempest-TestVolumeBootPattern-server-772823707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-772823707',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYHgQrnRlQ4jBKzblQ3DfxaEfVjuxo/NC6O+ICak+0aaFoFY7UzIhNxrdgQLtBAfBOsL0Lu2xLtyVpinmCCfqmljj/P6GdvFSKRfnZG4N6/Y2tUqR86uaxeDlehlPmATw==',key_name='tempest-TestVolumeBootPattern-887907135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-hrp6qf9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:19:45Z,user_data=None,user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=9a457b3f-924a-4f7b-9a8b-44ea3c3c1339,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e12123a-bc10-4890-b661-b8dbfc74e420", "address": "fa:16:3e:5e:d6:a5", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e12123a-bc", "ovs_interfaceid": "3e12123a-bc10-4890-b661-b8dbfc74e420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "3e12123a-bc10-4890-b661-b8dbfc74e420", "address": "fa:16:3e:5e:d6:a5", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e12123a-bc", "ovs_interfaceid": "3e12123a-bc10-4890-b661-b8dbfc74e420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d6:a5,bridge_name='br-int',has_traffic_filtering=True,id=3e12123a-bc10-4890-b661-b8dbfc74e420,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e12123a-bc') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lazy-loading 'pci_devices' on Instance uuid 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:20:32 user nova-compute[74242]:   <uuid>9a457b3f-924a-4f7b-9a8b-44ea3c3c1339</uuid>
Oct 20 02:20:32 user nova-compute[74242]:   <name>instance-00000021</name>
Oct 20 02:20:32 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:20:32 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:20:32 user nova-compute[74242]:   <metadata>
Oct 20 02:20:32 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:20:32 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:20:32 user nova-compute[74242]:       <nova:name>tempest-TestVolumeBootPattern-server-772823707</nova:name>
Oct 20 02:20:32 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:20:29</nova:creationTime>
Oct 20 02:20:32 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:20:32 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:20:32 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:20:32 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:20:32 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:20:32 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:20:32 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:20:32 user nova-compute[74242]:       <nova:owner>
Oct 20 02:20:32 user nova-compute[74242]:         <nova:user uuid="00ea297f598040fbb338b9ab2e1a1d3a">tempest-TestVolumeBootPattern-882774340-project-member</nova:user>
Oct 20 02:20:32 user nova-compute[74242]:         <nova:project uuid="e137c75824d7429585ddd2245f86a6d0">tempest-TestVolumeBootPattern-882774340</nova:project>
Oct 20 02:20:32 user nova-compute[74242]:       </nova:owner>
Oct 20 02:20:32 user nova-compute[74242]:       <nova:ports>
Oct 20 02:20:32 user nova-compute[74242]:         <nova:port uuid="3e12123a-bc10-4890-b661-b8dbfc74e420">
Oct 20 02:20:32 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 02:20:32 user nova-compute[74242]:         </nova:port>
Oct 20 02:20:32 user nova-compute[74242]:       </nova:ports>
Oct 20 02:20:32 user nova-compute[74242]:     </nova:instance>
Oct 20 02:20:32 user nova-compute[74242]:   </metadata>
Oct 20 02:20:32 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:20:32 user nova-compute[74242]:     <system>
Oct 20 02:20:32 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:20:32 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:20:32 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:20:32 user nova-compute[74242]:       <entry name="serial">9a457b3f-924a-4f7b-9a8b-44ea3c3c1339</entry>
Oct 20 02:20:32 user nova-compute[74242]:       <entry name="uuid">9a457b3f-924a-4f7b-9a8b-44ea3c3c1339</entry>
Oct 20 02:20:32 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:20:32 user nova-compute[74242]:     </system>
Oct 20 02:20:32 user nova-compute[74242]:   </sysinfo>
Oct 20 02:20:32 user nova-compute[74242]:   <os>
Oct 20 02:20:32 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:20:32 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:20:32 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:20:32 user nova-compute[74242]:   </os>
Oct 20 02:20:32 user nova-compute[74242]:   <features>
Oct 20 02:20:32 user nova-compute[74242]:     <acpi/>
Oct 20 02:20:32 user nova-compute[74242]:     <apic/>
Oct 20 02:20:32 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:20:32 user nova-compute[74242]:   </features>
Oct 20 02:20:32 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:20:32 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:20:32 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:20:32 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:20:32 user nova-compute[74242]:   </clock>
Oct 20 02:20:32 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:20:32 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:20:32 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:20:32 user nova-compute[74242]:   </cpu>
Oct 20 02:20:32 user nova-compute[74242]:   <devices>
Oct 20 02:20:32 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:20:32 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:20:32 user nova-compute[74242]:       <source dev="/dev/sdg"/>
Oct 20 02:20:32 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:20:32 user nova-compute[74242]:       <serial>43ee55e4-2aa2-4b93-ac99-5927df75b7ad</serial>
Oct 20 02:20:32 user nova-compute[74242]:     </disk>
Oct 20 02:20:32 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:20:32 user nova-compute[74242]:       <mac address="fa:16:3e:5e:d6:a5"/>
Oct 20 02:20:32 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:20:32 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:20:32 user nova-compute[74242]:       <target dev="tap3e12123a-bc"/>
Oct 20 02:20:32 user nova-compute[74242]:     </interface>
Oct 20 02:20:32 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:20:32 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/9a457b3f-924a-4f7b-9a8b-44ea3c3c1339/console.log" append="off"/>
Oct 20 02:20:32 user nova-compute[74242]:     </serial>
Oct 20 02:20:32 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:20:32 user nova-compute[74242]:     <video>
Oct 20 02:20:32 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:20:32 user nova-compute[74242]:     </video>
Oct 20 02:20:32 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:20:32 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:20:32 user nova-compute[74242]:     </rng>
Oct 20 02:20:32 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:20:32 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:20:32 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:20:32 user nova-compute[74242]:     </memballoon>
Oct 20 02:20:32 user nova-compute[74242]:   </devices>
Oct 20 02:20:32 user nova-compute[74242]: </domain>
Oct 20 02:20:32 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:19:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-772823707',display_name='tempest-TestVolumeBootPattern-server-772823707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-772823707',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYHgQrnRlQ4jBKzblQ3DfxaEfVjuxo/NC6O+ICak+0aaFoFY7UzIhNxrdgQLtBAfBOsL0Lu2xLtyVpinmCCfqmljj/P6GdvFSKRfnZG4N6/Y2tUqR86uaxeDlehlPmATw==',key_name='tempest-TestVolumeBootPattern-887907135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-hrp6qf9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:19:45Z,user_data=None,user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=9a457b3f-924a-4f7b-9a8b-44ea3c3c1339,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e12123a-bc10-4890-b661-b8dbfc74e420", "address": "fa:16:3e:5e:d6:a5", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e12123a-bc", "ovs_interfaceid": "3e12123a-bc10-4890-b661-b8dbfc74e420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "3e12123a-bc10-4890-b661-b8dbfc74e420", "address": "fa:16:3e:5e:d6:a5", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e12123a-bc", "ovs_interfaceid": "3e12123a-bc10-4890-b661-b8dbfc74e420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d6:a5,bridge_name='br-int',has_traffic_filtering=True,id=3e12123a-bc10-4890-b661-b8dbfc74e420,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e12123a-bc') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG os_vif [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d6:a5,bridge_name='br-int',has_traffic_filtering=True,id=3e12123a-bc10-4890-b661-b8dbfc74e420,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e12123a-bc') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0a9ca984-d36b-52b5-9130-47b3094f69bf', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e12123a-bc, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e12123a-bc, col_values=(('qos', UUID('a41fb187-4d29-4aef-9eba-d430e1cf483c')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e12123a-bc, col_values=(('external_ids', {'iface-id': '3e12123a-bc10-4890-b661-b8dbfc74e420', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:d6:a5', 'vm-uuid': '9a457b3f-924a-4f7b-9a8b-44ea3c3c1339'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:32 user nova-compute[74242]: INFO os_vif [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d6:a5,bridge_name='br-int',has_traffic_filtering=True,id=3e12123a-bc10-4890-b661-b8dbfc74e420,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e12123a-bc')
Oct 20 02:20:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] No VIF found with MAC fa:16:3e:5e:d6:a5, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-0db81edd-93ae-49de-a831-dc9a5a820c68 req-ec34323f-995c-4da9-be1b-4e4abb135cad service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0db81edd-93ae-49de-a831-dc9a5a820c68 req-ec34323f-995c-4da9-be1b-4e4abb135cad service nova] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0db81edd-93ae-49de-a831-dc9a5a820c68 req-ec34323f-995c-4da9-be1b-4e4abb135cad service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0db81edd-93ae-49de-a831-dc9a5a820c68 req-ec34323f-995c-4da9-be1b-4e4abb135cad service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-0db81edd-93ae-49de-a831-dc9a5a820c68 req-ec34323f-995c-4da9-be1b-4e4abb135cad service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] No waiting events found dispatching network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:20:32 user nova-compute[74242]: WARNING nova.compute.manager [req-0db81edd-93ae-49de-a831-dc9a5a820c68 req-ec34323f-995c-4da9-be1b-4e4abb135cad service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received unexpected event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 for instance with vm_state resized and task_state resize_reverting.
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-2ef30926-a241-4003-bfff-510f54664b75 req-a531414f-040e-48ef-9817-c78defdb4c66 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Received event network-vif-plugged-3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:20:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2ef30926-a241-4003-bfff-510f54664b75 req-a531414f-040e-48ef-9817-c78defdb4c66 service nova] Acquiring lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2ef30926-a241-4003-bfff-510f54664b75 req-a531414f-040e-48ef-9817-c78defdb4c66 service nova] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-2ef30926-a241-4003-bfff-510f54664b75 req-a531414f-040e-48ef-9817-c78defdb4c66 service nova] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-2ef30926-a241-4003-bfff-510f54664b75 req-a531414f-040e-48ef-9817-c78defdb4c66 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] No waiting events found dispatching network-vif-plugged-3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:20:34 user nova-compute[74242]: WARNING nova.compute.manager [req-2ef30926-a241-4003-bfff-510f54664b75 req-a531414f-040e-48ef-9817-c78defdb4c66 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Received unexpected event network-vif-plugged-3e12123a-bc10-4890-b661-b8dbfc74e420 for instance with vm_state building and task_state spawning.
Oct 20 02:20:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-39ef85f4-ec77-48a3-9cdd-d47635ab64ca req-e5cb9adb-2b06-4c99-9130-d781a84558e2 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:20:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-39ef85f4-ec77-48a3-9cdd-d47635ab64ca req-e5cb9adb-2b06-4c99-9130-d781a84558e2 service nova] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-39ef85f4-ec77-48a3-9cdd-d47635ab64ca req-e5cb9adb-2b06-4c99-9130-d781a84558e2 service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-39ef85f4-ec77-48a3-9cdd-d47635ab64ca req-e5cb9adb-2b06-4c99-9130-d781a84558e2 service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-39ef85f4-ec77-48a3-9cdd-d47635ab64ca req-e5cb9adb-2b06-4c99-9130-d781a84558e2 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] No waiting events found dispatching network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:20:34 user nova-compute[74242]: WARNING nova.compute.manager [req-39ef85f4-ec77-48a3-9cdd-d47635ab64ca req-e5cb9adb-2b06-4c99-9130-d781a84558e2 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received unexpected event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 for instance with vm_state resized and task_state resize_reverting.
Oct 20 02:20:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:20:35 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Instance running successfully.
Oct 20 02:20:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] finish_revert_migration finished successfully. {{(pid=74242) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Oct 20 02:20:35 user nova-compute[74242]: INFO nova.compute.manager [None req-8819f187-9a81-4d95-b541-d2518c0c219b tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updating instance to original state: 'active'
Oct 20 02:20:35 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:20:36 user nova-compute[74242]: DEBUG nova.compute.manager [req-24379258-3d62-42f3-b284-a1e1751a1a29 req-fecc0f75-fb48-4176-9455-7a9ef5a8738c service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Received event network-vif-plugged-3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:20:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-24379258-3d62-42f3-b284-a1e1751a1a29 req-fecc0f75-fb48-4176-9455-7a9ef5a8738c service nova] Acquiring lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-24379258-3d62-42f3-b284-a1e1751a1a29 req-fecc0f75-fb48-4176-9455-7a9ef5a8738c service nova] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-24379258-3d62-42f3-b284-a1e1751a1a29 req-fecc0f75-fb48-4176-9455-7a9ef5a8738c service nova] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:36 user nova-compute[74242]: DEBUG nova.compute.manager [req-24379258-3d62-42f3-b284-a1e1751a1a29 req-fecc0f75-fb48-4176-9455-7a9ef5a8738c service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] No waiting events found dispatching network-vif-plugged-3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:20:36 user nova-compute[74242]: WARNING nova.compute.manager [req-24379258-3d62-42f3-b284-a1e1751a1a29 req-fecc0f75-fb48-4176-9455-7a9ef5a8738c service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Received unexpected event network-vif-plugged-3e12123a-bc10-4890-b661-b8dbfc74e420 for instance with vm_state building and task_state spawning.
Oct 20 02:20:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:20:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:20:36 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Instance spawned successfully.
Oct 20 02:20:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:20:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:20:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:20:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:20:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:20:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:20:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:20:36 user nova-compute[74242]: INFO nova.compute.manager [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Took 6.76 seconds to spawn the instance on the hypervisor.
Oct 20 02:20:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:20:36 user nova-compute[74242]: INFO nova.compute.manager [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Took 52.40 seconds to build instance.
Oct 20 02:20:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1a7500cb-0634-489f-851c-337b00bcc51c tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 52.547s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 47.430s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:36 user nova-compute[74242]: INFO nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 20 02:20:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:36 user nova-compute[74242]: INFO nova.compute.manager [None req-807d3168-2dfd-4a38-be18-8960439fd25e tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Get console output
Oct 20 02:20:37 user nova-compute[74242]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 20 02:20:37 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:20:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:20:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:20:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:20:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:20:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Updating instance_info_cache with network_info: [{"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:20:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:20:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:20:38 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:20:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:20:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:40 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:20:41 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:20:42 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:20:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:20:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:44 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:20:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:44 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:20:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:20:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:20:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:20:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:20:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:47 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:20:47 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7585MB free_disk=24.896469116210938GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c98e383a-e1e5-4130-9cc6-a9823db0b88c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance fdccf817-4784-472a-85d1-96b5cc37722c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3038a67c-0ffd-4652-a3d1-23e4bfda10fe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 531961c2-d07a-4edc-8714-16ff1fa1a925 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2645af84-8ba4-4a34-beb1-9676cce3dc5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 876f8f80-9640-43ba-8ec7-0ffe06c82086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 62ca0d11-07be-4998-8404-b4d31f1e57da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:20:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:20:48 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:20:48 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:20:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:20:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.537s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:50 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:20:52 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:20:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:20:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:20:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:20:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:20:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG nova.objects.instance [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lazy-loading 'flavor' on Instance uuid 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:20:57 user nova-compute[74242]: INFO nova.compute.manager [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Attaching volume c1479903-ebbb-4bdf-9afd-9992a567c3c0 to /dev/vdb
Oct 20 02:20:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG os_brick.utils [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7717b2d4-3b5c-49b7-8fb7-e66e1ac6137e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0182bf9f-9ed5-41e9-a49b-c67345dfad9b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc60b2cb-1c3d-46a4-8845-f6d66934a335]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[331dc488-df11-4192-bb56-7acf58ef19c7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:20:57 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:20:57 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c098c96-b452-4390-89ec-02372f3f8eb9]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG os_brick.utils [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:20:57 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Updating existing volume attachment record: 447ad36d-7542-49d1-9674-d6c619e58e66 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:20:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRxuvTig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:21:15 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:21:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:21:15 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:21:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:21:15 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:21:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49ff93f-7769-43e6-9355-e0ca1005b33e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:21:15 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[537d51c1-431d-4edb-96c7-ebdf0f0cba65]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0] added
Oct 20 02:21:15 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5040d65b-e4eb-418b-89eb-f30e842f13ea]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[660de87e-ac2b-468e-a1cc-bcde499bfc4c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:21:15 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kRxuvTig {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kRxuvTig" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[97f2df26-e969-4aa8-8389-31bf354fcf8b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kRxuvTig'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28597f5-6996-431c-94c9-a27717fb1b84]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb8ad5a-8baa-4857-bdb6-0936e8e4ace3]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:21:16 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:21:16 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[45028776-e5ec-4b06-bb5d-ba01ef591821]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0, portal: 172.16.0.220,3260]
Oct 20 02:21:16 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0, portal: 172.16.0.220,3260] successful.
Oct 20 02:21:16 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f66efa-f0b2-4449-9632-6d4d9f36e3f1]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8715ccfb-99e0-4054-9090-b3cf279596ae]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:21:16 user nova-compute[74242]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 (non-flash)
Oct 20 02:21:16 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] HCTL ('39', '-', '-', 0) found on session 41 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2d80f3-7571-4d22-897d-8dd80edd3c5f]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:16 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Searching for a device in session 41 and hctl ['39', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:21:17 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Searching for a device in session 41 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:21:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRxuvTig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:21:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:21:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26361373563353464', 'path': '/dev/sdh'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:21:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361373563353464', 'path': '/dev/sdh'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:21:17 user nova-compute[74242]: DEBUG nova.objects.instance [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lazy-loading 'flavor' on Instance uuid 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:21:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:21:17 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:21:17 user nova-compute[74242]:   <source dev="/dev/sdh"/>
Oct 20 02:21:17 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:21:17 user nova-compute[74242]:   <serial>c1479903-ebbb-4bdf-9afd-9992a567c3c0</serial>
Oct 20 02:21:17 user nova-compute[74242]: </disk>
Oct 20 02:21:17 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:21:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:21:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:21:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] No VIF found with MAC fa:16:3e:6b:ed:0a, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:21:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-74a10301-8b97-4b9e-9c0f-e7c3ab713bc4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.131s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:21:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:19 user nova-compute[74242]: INFO nova.compute.manager [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Detaching volume c1479903-ebbb-4bdf-9afd-9992a567c3c0
Oct 20 02:21:19 user nova-compute[74242]: INFO nova.virt.block_device [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Attempting to driver detach volume c1479903-ebbb-4bdf-9afd-9992a567c3c0 from mountpoint /dev/vdb
Oct 20 02:21:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Attempting to detach device vdb from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:21:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:21:19 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:21:19 user nova-compute[74242]:   <source dev="/dev/sdh"/>
Oct 20 02:21:19 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:21:19 user nova-compute[74242]:   <serial>c1479903-ebbb-4bdf-9afd-9992a567c3c0</serial>
Oct 20 02:21:19 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:21:19 user nova-compute[74242]: </disk>
Oct 20 02:21:19 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:21:19 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Successfully detached device vdb from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the persistent domain config.
Oct 20 02:21:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:21:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:21:19 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:21:19 user nova-compute[74242]:   <source dev="/dev/sdh"/>
Oct 20 02:21:19 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:21:19 user nova-compute[74242]:   <serial>c1479903-ebbb-4bdf-9afd-9992a567c3c0</serial>
Oct 20 02:21:19 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:21:19 user nova-compute[74242]: </disk>
Oct 20 02:21:19 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:21:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:21:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:21:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:21:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:21:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:21:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:21:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "74295e5c-237c-4992-a21a-6f59fd6ff246" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:21:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:30 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:21:30 user nova-compute[74242]: INFO nova.compute.claims [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Claim successful on node user
Oct 20 02:21:30 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:21:30 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:21:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.474s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:21:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:21:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:21:30 user nova-compute[74242]: DEBUG nova.network.neutron [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:21:30 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:21:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:21:31 user nova-compute[74242]: DEBUG nova.policy [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '9ac628a224fb4653932a27e33aa33c9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '112fda62d355421e80e674dc18bb5069', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:21:31 user nova-compute[74242]: INFO nova.virt.block_device [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Booting with volume-backed-image 1ba817e4-0454-4c11-9ff7-3af381824874 at /dev/vda
Oct 20 02:21:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Successfully created port: 6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG nova.network.neutron [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Successfully updated port: 6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "refresh_cache-74295e5c-237c-4992-a21a-6f59fd6ff246" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquired lock "refresh_cache-74295e5c-237c-4992-a21a-6f59fd6ff246" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG nova.network.neutron [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-f7e69a50-865c-4744-b169-aa5581ae7e80 req-4c93d12b-32f5-4db6-aa56-c1ece2db30d8 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received event network-changed-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-f7e69a50-865c-4744-b169-aa5581ae7e80 req-4c93d12b-32f5-4db6-aa56-c1ece2db30d8 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Refreshing instance network info cache due to event network-changed-6a09ec72-a9d4-49cf-8089-04b50109b631. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f7e69a50-865c-4744-b169-aa5581ae7e80 req-4c93d12b-32f5-4db6-aa56-c1ece2db30d8 service nova] Acquiring lock "refresh_cache-74295e5c-237c-4992-a21a-6f59fd6ff246" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG nova.network.neutron [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG nova.network.neutron [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Updating instance_info_cache with network_info: [{"id": "6a09ec72-a9d4-49cf-8089-04b50109b631", "address": "fa:16:3e:cd:60:bc", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a09ec72-a9", "ovs_interfaceid": "6a09ec72-a9d4-49cf-8089-04b50109b631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Releasing lock "refresh_cache-74295e5c-237c-4992-a21a-6f59fd6ff246" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG nova.compute.manager [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Instance network_info: |[{"id": "6a09ec72-a9d4-49cf-8089-04b50109b631", "address": "fa:16:3e:cd:60:bc", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a09ec72-a9", "ovs_interfaceid": "6a09ec72-a9d4-49cf-8089-04b50109b631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f7e69a50-865c-4744-b169-aa5581ae7e80 req-4c93d12b-32f5-4db6-aa56-c1ece2db30d8 service nova] Acquired lock "refresh_cache-74295e5c-237c-4992-a21a-6f59fd6ff246" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-f7e69a50-865c-4744-b169-aa5581ae7e80 req-4c93d12b-32f5-4db6-aa56-c1ece2db30d8 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Refreshing network info cache for port 6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-f7e69a50-865c-4744-b169-aa5581ae7e80 req-4c93d12b-32f5-4db6-aa56-c1ece2db30d8 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Updated VIF entry in instance network info cache for port 6a09ec72-a9d4-49cf-8089-04b50109b631. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-f7e69a50-865c-4744-b169-aa5581ae7e80 req-4c93d12b-32f5-4db6-aa56-c1ece2db30d8 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Updating instance_info_cache with network_info: [{"id": "6a09ec72-a9d4-49cf-8089-04b50109b631", "address": "fa:16:3e:cd:60:bc", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a09ec72-a9", "ovs_interfaceid": "6a09ec72-a9d4-49cf-8089-04b50109b631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:21:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f7e69a50-865c-4744-b169-aa5581ae7e80 req-4c93d12b-32f5-4db6-aa56-c1ece2db30d8 service nova] Releasing lock "refresh_cache-74295e5c-237c-4992-a21a-6f59fd6ff246" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:21:37 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:21:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:21:37 user nova-compute[74242]: INFO nova.compute.manager [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Terminating instance
Oct 20 02:21:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:21:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-01088f8d-3ca1-417b-85cd-17bacb3af1b3 req-dd5ad682-209d-4f93-b3d3-e6a7c90aa1ee service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received event network-vif-unplugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-01088f8d-3ca1-417b-85cd-17bacb3af1b3 req-dd5ad682-209d-4f93-b3d3-e6a7c90aa1ee service nova] Acquiring lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-01088f8d-3ca1-417b-85cd-17bacb3af1b3 req-dd5ad682-209d-4f93-b3d3-e6a7c90aa1ee service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-01088f8d-3ca1-417b-85cd-17bacb3af1b3 req-dd5ad682-209d-4f93-b3d3-e6a7c90aa1ee service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-01088f8d-3ca1-417b-85cd-17bacb3af1b3 req-dd5ad682-209d-4f93-b3d3-e6a7c90aa1ee service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] No waiting events found dispatching network-vif-unplugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-01088f8d-3ca1-417b-85cd-17bacb3af1b3 req-dd5ad682-209d-4f93-b3d3-e6a7c90aa1ee service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received event network-vif-unplugged-a8a2c2c1-7401-4115-8479-bb8939c1397f for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:21:38 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Instance destroyed successfully.
Oct 20 02:21:38 user nova-compute[74242]: DEBUG nova.objects.instance [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lazy-loading 'resources' on Instance uuid 3038a67c-0ffd-4652-a3d1-23e4bfda10fe {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:15:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1719894790',display_name='tempest-ServerActionsTestOtherA-server-1719894790',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1719894790',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB7bL+2x0x/JgolwV73wEpn90TfE93HD11kN8fWTUdskLHr/+qGh8YX2pmWaISRSrg9SBRQDQmulufko6eTLMYIA5vcJ4clYCIWnNXj2Hp2S/9mOnMK73v45XTwiydUrQ==',key_name='tempest-keypair-1706623376',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:17:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cf9b187fe8443aba57a8c629d78978e',ramdisk_id='',reservation_id='r-z5rlmmsm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2076229102',owner_user_name='tempest-ServerActionsTestOtherA-2076229102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:18:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1f488a444de49f5bed5351efd55dafa',uuid=3038a67c-0ffd-4652-a3d1-23e4bfda10fe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converting VIF {"id": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "address": "fa:16:3e:02:1a:d8", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a2c2c1-74", "ovs_interfaceid": "a8a2c2c1-7401-4115-8479-bb8939c1397f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:02:1a:d8,bridge_name='br-int',has_traffic_filtering=True,id=a8a2c2c1-7401-4115-8479-bb8939c1397f,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a2c2c1-74') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG os_vif [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:1a:d8,bridge_name='br-int',has_traffic_filtering=True,id=a8a2c2c1-7401-4115-8479-bb8939c1397f,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a2c2c1-74') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8a2c2c1-74, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f5dd19b1-d570-449f-92aa-78d790173f5c) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:21:38 user nova-compute[74242]: INFO os_vif [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:02:1a:d8,bridge_name='br-int',has_traffic_filtering=True,id=a8a2c2c1-7401-4115-8479-bb8939c1397f,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa8a2c2c1-74')
Oct 20 02:21:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AsWrHYCU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:21:38 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:21:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[51fdd63f-8020-4c7f-93c9-293cb1e86a28]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:21:38 user nova-compute[74242]: No targets found.
Oct 20 02:21:38 user nova-compute[74242]: iSNS:
Oct 20 02:21:38 user nova-compute[74242]: No targets found.
Oct 20 02:21:38 user nova-compute[74242]: STATIC:
Oct 20 02:21:38 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33
Oct 20 02:21:38 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:21:38 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:21:38 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad
Oct 20 02:21:38 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:21:38 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:21:38 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0
Oct 20 02:21:38 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:21:38 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:21:38 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5
Oct 20 02:21:38 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:21:38 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:21:38 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:21:38 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:21:38 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:21:38 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155
Oct 20 02:21:38 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:21:38 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:21:38 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1
Oct 20 02:21:38 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:21:38 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:21:38 user nova-compute[74242]: FIRMWARE:
Oct 20 02:21:38 user nova-compute[74242]: No targets found.
Oct 20 02:21:38 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:21:38 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:21:38 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[22593138-3903-4e81-9210-a162cd1ea5d9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4ede956-bf03-497d-b7cc-9b2add55974c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:21:38 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:21:38 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:21:38 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:21:38 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:21:38 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:21:38 user nova-compute[74242]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 (non-flash)
Oct 20 02:21:38 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:21:38 user nova-compute[74242]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 (non-flash)
Oct 20 02:21:38 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:21:38 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:21:38 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:21:38 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:21:38 user nova-compute[74242]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 (non-flash)
Oct 20 02:21:38 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d022a7a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1'): ({'sdb'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Removing single pathed devices sdb {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf29388-5752-4d91-b2f8-de6be68e983c]: (4, ('path checker states:\nup                  6\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f0460d-f050-4d57-9cf2-20cabc843174]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Flushing IO for device /dev/sdb {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b394f3-3a23-49e9-9eb8-4b7f639378bf]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:38 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updating instance_info_cache with network_info: [{"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.130s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8819261-5620-456b-a6fc-7255243c6343]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-2645af84-8ba4-4a34-beb1-9676cce3dc5f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe607f3b7-50f700dbeaa0183b', '/dev/disk/by-id/scsi-23530663730306462', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e607f3b7') {{(pid=85329) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c015f0b-7056-4f1c-9632-d46ec5fedf66]: (4, None) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f113a269-2059-4a39-88f2-17ecbc5ba36c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[638e148e-5664-4f6c-a76b-217d6f2b0b17]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260]
Oct 20 02:21:39 user nova-compute[74242]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1, portal: 172.16.0.220,3260] successful.
Oct 20 02:21:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:611b143e-0c8f-4e29-a344-97df041319f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.036s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[db362911-92df-4b7a-8db0-1c2bb803a078]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] <== disconnect_volume: return (461ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:21:39 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Deleting instance files /opt/stack/data/nova/instances/3038a67c-0ffd-4652-a3d1-23e4bfda10fe_del
Oct 20 02:21:39 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Deletion of /opt/stack/data/nova/instances/3038a67c-0ffd-4652-a3d1-23e4bfda10fe_del complete
Oct 20 02:21:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:39 user nova-compute[74242]: INFO nova.compute.manager [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Took 1.38 seconds to destroy the instance on the hypervisor.
Oct 20 02:21:39 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:21:39 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:21:39 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Took 0.75 seconds to deallocate network for instance.
Oct 20 02:21:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-0d55020e-0346-46fa-a47c-32654591e7b2 req-d741474c-3a58-4c17-9b07-fe46a1b176ef service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received event network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0d55020e-0346-46fa-a47c-32654591e7b2 req-d741474c-3a58-4c17-9b07-fe46a1b176ef service nova] Acquiring lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0d55020e-0346-46fa-a47c-32654591e7b2 req-d741474c-3a58-4c17-9b07-fe46a1b176ef service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0d55020e-0346-46fa-a47c-32654591e7b2 req-d741474c-3a58-4c17-9b07-fe46a1b176ef service nova] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-0d55020e-0346-46fa-a47c-32654591e7b2 req-d741474c-3a58-4c17-9b07-fe46a1b176ef service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] No waiting events found dispatching network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:21:40 user nova-compute[74242]: WARNING nova.compute.manager [req-0d55020e-0346-46fa-a47c-32654591e7b2 req-d741474c-3a58-4c17-9b07-fe46a1b176ef service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received unexpected event network-vif-plugged-a8a2c2c1-7401-4115-8479-bb8939c1397f for instance with vm_state active and task_state deleting.
Oct 20 02:21:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-0d55020e-0346-46fa-a47c-32654591e7b2 req-d741474c-3a58-4c17-9b07-fe46a1b176ef service nova] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Received event network-vif-deleted-a8a2c2c1-7401-4115-8479-bb8939c1397f {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:21:40 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 is timed out.
Oct 20 02:21:40 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Successfully detached device vdb from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the live domain config.
Oct 20 02:21:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kRxuvTig', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:21:40 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[38849242-1344-4aa8-9f1a-166877af2a82]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:21:40 user nova-compute[74242]: No targets found.
Oct 20 02:21:40 user nova-compute[74242]: iSNS:
Oct 20 02:21:40 user nova-compute[74242]: No targets found.
Oct 20 02:21:40 user nova-compute[74242]: STATIC:
Oct 20 02:21:40 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33
Oct 20 02:21:40 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:21:40 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:21:40 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad
Oct 20 02:21:40 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:21:40 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:21:40 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0
Oct 20 02:21:40 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:21:40 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:21:40 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5
Oct 20 02:21:40 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:21:40 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:21:40 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:21:40 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:21:40 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:21:40 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155
Oct 20 02:21:40 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:21:40 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:21:40 user nova-compute[74242]: FIRMWARE:
Oct 20 02:21:40 user nova-compute[74242]: No targets found.
Oct 20 02:21:40 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:21:40 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:21:40 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df0e8e1-76aa-4b73-9daf-c316eb7f5758]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8479a181-7a86-480b-858a-eb6cd14ed2e9]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:21:40 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:21:40 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:21:40 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:21:40 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:21:40 user nova-compute[74242]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 (non-flash)
Oct 20 02:21:40 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:21:40 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:21:40 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:21:40 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:21:40 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:21:40 user nova-compute[74242]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 (non-flash)
Oct 20 02:21:40 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b87cdd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0'): ({'sdh'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Removing single pathed devices sdh {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b3daf7-4033-47e3-ba73-eb920bad9571]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef30f36-be57-415b-abcf-52987a1506e2]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Flushing IO for device /dev/sdh {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[79966efa-c02d-439b-9f0d-3371bd89f048]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.045s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc2ddd75-d226-4ce1-a582-00aab107f8e4]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] SCSI volumes sdh have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c9ff1f-80ce-4529-bdcd-08ff2cfd4aaf]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.098s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4896deb7-cff0-438f-b6af-cf4c09d68a3d]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0, portal: 172.16.0.220,3260]
Oct 20 02:21:40 user nova-compute[74242]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0, portal: 172.16.0.220,3260] successful.
Oct 20 02:21:40 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1479903-ebbb-4bdf-9afd-9992a567c3c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc20b88-1407-4501-b1a0-8ef8c827a132]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] <== disconnect_volume: return (403ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:21:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:21:41 user nova-compute[74242]: INFO nova.compute.manager [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Took 1.07 seconds to detach 1 volumes for instance.
Oct 20 02:21:41 user nova-compute[74242]: DEBUG nova.compute.manager [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 3038a67c-0ffd-4652-a3d1-23e4bfda10fe] Deleting volume: 611b143e-0c8f-4e29-a344-97df041319f1 {{(pid=74242) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 02:21:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:41 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:21:41 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:21:41 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:21:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:21:41 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Deleted allocations for instance 3038a67c-0ffd-4652-a3d1-23e4bfda10fe
Oct 20 02:21:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6309c7f2-ece4-4ce2-832c-3d3dcb05488b tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "3038a67c-0ffd-4652-a3d1-23e4bfda10fe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.994s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:21:42 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:21:42 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:21:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:21:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:44 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:21:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:21:44 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:21:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:21:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:21:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:45 user nova-compute[74242]: DEBUG nova.objects.instance [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lazy-loading 'flavor' on Instance uuid 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:21:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7cb8b01-5adb-4470-b607-4c49b8654bb4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 26.119s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:21:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG os_brick.utils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[848854ed-516d-483e-aade-384633a33d6f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4c77e3-3107-415f-9d1c-e35c78d8ccff]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[41685659-3c08-44ee-8cb7-8e98c6b3d97e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc1c67c-9e2e-419c-b450-4df08204e433]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:21:47 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cbb794e-9845-4124-bd57-55502bedd27e]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG os_brick.utils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Updating existing volume attachment record: 76467e6c-ebe2-46d2-ad26-f808f7e34ddf {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:47 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:21:47 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:21:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7661MB free_disk=24.885086059570312GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0636ce59-3cfb-4959-bb28-bce8f4c30043 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c98e383a-e1e5-4130-9cc6-a9823db0b88c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance fdccf817-4784-472a-85d1-96b5cc37722c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 531961c2-d07a-4edc-8714-16ff1fa1a925 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2645af84-8ba4-4a34-beb1-9676cce3dc5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 876f8f80-9640-43ba-8ec7-0ffe06c82086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 62ca0d11-07be-4998-8404-b4d31f1e57da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 74295e5c-237c-4992-a21a-6f59fd6ff246 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.548s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:21:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-42241100-dfb9-4d6d-ab1a-e3986acaf03d req-009c33dd-12a4-4ea1-8256-99ac01a8236a service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received event network-changed-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:21:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-42241100-dfb9-4d6d-ab1a-e3986acaf03d req-009c33dd-12a4-4ea1-8256-99ac01a8236a service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Refreshing instance network info cache due to event network-changed-006062cf-dcc6-4756-a074-1bf376c16abf. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:21:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-42241100-dfb9-4d6d-ab1a-e3986acaf03d req-009c33dd-12a4-4ea1-8256-99ac01a8236a service nova] Acquiring lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:21:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-42241100-dfb9-4d6d-ab1a-e3986acaf03d req-009c33dd-12a4-4ea1-8256-99ac01a8236a service nova] Acquired lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:21:49 user nova-compute[74242]: DEBUG nova.network.neutron [req-42241100-dfb9-4d6d-ab1a-e3986acaf03d req-009c33dd-12a4-4ea1-8256-99ac01a8236a service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Refreshing network info cache for port 006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:21:49 user nova-compute[74242]: DEBUG nova.network.neutron [req-42241100-dfb9-4d6d-ab1a-e3986acaf03d req-009c33dd-12a4-4ea1-8256-99ac01a8236a service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updated VIF entry in instance network info cache for port 006062cf-dcc6-4756-a074-1bf376c16abf. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:21:49 user nova-compute[74242]: DEBUG nova.network.neutron [req-42241100-dfb9-4d6d-ab1a-e3986acaf03d req-009c33dd-12a4-4ea1-8256-99ac01a8236a service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updating instance_info_cache with network_info: [{"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:21:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-42241100-dfb9-4d6d-ab1a-e3986acaf03d req-009c33dd-12a4-4ea1-8256-99ac01a8236a service nova] Releasing lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:21:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "fdccf817-4784-472a-85d1-96b5cc37722c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:50 user nova-compute[74242]: INFO nova.compute.manager [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Detaching volume 9ddad15b-604d-4140-bf1b-845eaa5bda33
Oct 20 02:21:50 user nova-compute[74242]: INFO nova.virt.block_device [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Attempting to driver detach volume 9ddad15b-604d-4140-bf1b-845eaa5bda33 from mountpoint /dev/vdb
Oct 20 02:21:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Attempting to detach device vdb from instance fdccf817-4784-472a-85d1-96b5cc37722c from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:21:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:21:50 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:21:50 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:21:50 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:21:50 user nova-compute[74242]:   <serial>9ddad15b-604d-4140-bf1b-845eaa5bda33</serial>
Oct 20 02:21:50 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 02:21:50 user nova-compute[74242]: </disk>
Oct 20 02:21:50 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:21:50 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Successfully detached device vdb from instance fdccf817-4784-472a-85d1-96b5cc37722c from the persistent domain config.
Oct 20 02:21:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fdccf817-4784-472a-85d1-96b5cc37722c from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:21:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:21:50 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:21:50 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:21:50 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:21:50 user nova-compute[74242]:   <serial>9ddad15b-604d-4140-bf1b-845eaa5bda33</serial>
Oct 20 02:21:50 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 02:21:50 user nova-compute[74242]: </disk>
Oct 20 02:21:50 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:21:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fdccf817-4784-472a-85d1-96b5cc37722c {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:21:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-1adbab3f-ab2e-42c3-bb34-917d1252345f req-a9950ef4-29d0-4d86-8ae4-6fe84d3ab4e0 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received event network-changed-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:21:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-1adbab3f-ab2e-42c3-bb34-917d1252345f req-a9950ef4-29d0-4d86-8ae4-6fe84d3ab4e0 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Refreshing instance network info cache due to event network-changed-006062cf-dcc6-4756-a074-1bf376c16abf. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:21:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1adbab3f-ab2e-42c3-bb34-917d1252345f req-a9950ef4-29d0-4d86-8ae4-6fe84d3ab4e0 service nova] Acquiring lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:21:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1adbab3f-ab2e-42c3-bb34-917d1252345f req-a9950ef4-29d0-4d86-8ae4-6fe84d3ab4e0 service nova] Acquired lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:21:51 user nova-compute[74242]: DEBUG nova.network.neutron [req-1adbab3f-ab2e-42c3-bb34-917d1252345f req-a9950ef4-29d0-4d86-8ae4-6fe84d3ab4e0 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Refreshing network info cache for port 006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:21:51 user nova-compute[74242]: DEBUG nova.network.neutron [req-1adbab3f-ab2e-42c3-bb34-917d1252345f req-a9950ef4-29d0-4d86-8ae4-6fe84d3ab4e0 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updated VIF entry in instance network info cache for port 006062cf-dcc6-4756-a074-1bf376c16abf. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:21:51 user nova-compute[74242]: DEBUG nova.network.neutron [req-1adbab3f-ab2e-42c3-bb34-917d1252345f req-a9950ef4-29d0-4d86-8ae4-6fe84d3ab4e0 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updating instance_info_cache with network_info: [{"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:21:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1adbab3f-ab2e-42c3-bb34-917d1252345f req-a9950ef4-29d0-4d86-8ae4-6fe84d3ab4e0 service nova] Releasing lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:21:52 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:21:53 user nova-compute[74242]: DEBUG nova.compute.manager [req-42feb373-dbfc-4d74-aff0-763256c2afd0 req-82dbdaa0-7636-40fe-bb8b-24f650f7590c service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Received event network-changed-484c4400-d38e-4b70-9da3-156953fd5c3e {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:21:53 user nova-compute[74242]: DEBUG nova.compute.manager [req-42feb373-dbfc-4d74-aff0-763256c2afd0 req-82dbdaa0-7636-40fe-bb8b-24f650f7590c service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Refreshing instance network info cache due to event network-changed-484c4400-d38e-4b70-9da3-156953fd5c3e. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:21:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-42feb373-dbfc-4d74-aff0-763256c2afd0 req-82dbdaa0-7636-40fe-bb8b-24f650f7590c service nova] Acquiring lock "refresh_cache-62ca0d11-07be-4998-8404-b4d31f1e57da" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:21:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-42feb373-dbfc-4d74-aff0-763256c2afd0 req-82dbdaa0-7636-40fe-bb8b-24f650f7590c service nova] Acquired lock "refresh_cache-62ca0d11-07be-4998-8404-b4d31f1e57da" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:21:53 user nova-compute[74242]: DEBUG nova.network.neutron [req-42feb373-dbfc-4d74-aff0-763256c2afd0 req-82dbdaa0-7636-40fe-bb8b-24f650f7590c service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Refreshing network info cache for port 484c4400-d38e-4b70-9da3-156953fd5c3e {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:21:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:53 user nova-compute[74242]: DEBUG nova.network.neutron [req-42feb373-dbfc-4d74-aff0-763256c2afd0 req-82dbdaa0-7636-40fe-bb8b-24f650f7590c service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Updated VIF entry in instance network info cache for port 484c4400-d38e-4b70-9da3-156953fd5c3e. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:21:53 user nova-compute[74242]: DEBUG nova.network.neutron [req-42feb373-dbfc-4d74-aff0-763256c2afd0 req-82dbdaa0-7636-40fe-bb8b-24f650f7590c service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Updating instance_info_cache with network_info: [{"id": "484c4400-d38e-4b70-9da3-156953fd5c3e", "address": "fa:16:3e:e1:37:0a", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c4400-d3", "ovs_interfaceid": "484c4400-d38e-4b70-9da3-156953fd5c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:21:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-42feb373-dbfc-4d74-aff0-763256c2afd0 req-82dbdaa0-7636-40fe-bb8b-24f650f7590c service nova] Releasing lock "refresh_cache-62ca0d11-07be-4998-8404-b4d31f1e57da" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:21:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "5162fb94-7344-4193-98c8-c5f165309f60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "5162fb94-7344-4193-98c8-c5f165309f60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:55 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:21:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:55 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:21:55 user nova-compute[74242]: INFO nova.compute.claims [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Claim successful on node user
Oct 20 02:21:56 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:21:56 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:21:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.490s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:21:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:21:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:21:56 user nova-compute[74242]: DEBUG nova.network.neutron [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:21:56 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:21:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:21:56 user nova-compute[74242]: DEBUG nova.policy [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29cd6130817e4b588ce838dd958b5fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b7d7e4e314e7aa95f8ceb39a0dc95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:21:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:21:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:21:56 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Creating image(s)
Oct 20 02:21:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "/opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "/opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "/opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:21:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.201s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Successfully created port: 98d3c10c-2360-41e7-ae7f-9b7657a7326b {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/disk 1073741824" returned: 0 in 0.062s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Cannot resize image /opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Ensure instance console log exists: /opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Successfully updated port: 98d3c10c-2360-41e7-ae7f-9b7657a7326b {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "refresh_cache-5162fb94-7344-4193-98c8-c5f165309f60" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquired lock "refresh_cache-5162fb94-7344-4193-98c8-c5f165309f60" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-5221da03-09cb-49b6-8c0b-07d72d80aa2c req-06b0c198-5218-4460-b7eb-3abb5d8a2ce1 service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Received event network-changed-98d3c10c-2360-41e7-ae7f-9b7657a7326b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-5221da03-09cb-49b6-8c0b-07d72d80aa2c req-06b0c198-5218-4460-b7eb-3abb5d8a2ce1 service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Refreshing instance network info cache due to event network-changed-98d3c10c-2360-41e7-ae7f-9b7657a7326b. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:21:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5221da03-09cb-49b6-8c0b-07d72d80aa2c req-06b0c198-5218-4460-b7eb-3abb5d8a2ce1 service nova] Acquiring lock "refresh_cache-5162fb94-7344-4193-98c8-c5f165309f60" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Updating instance_info_cache with network_info: [{"id": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "address": "fa:16:3e:c5:ef:fd", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d3c10c-23", "ovs_interfaceid": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Releasing lock "refresh_cache-5162fb94-7344-4193-98c8-c5f165309f60" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Instance network_info: |[{"id": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "address": "fa:16:3e:c5:ef:fd", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d3c10c-23", "ovs_interfaceid": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5221da03-09cb-49b6-8c0b-07d72d80aa2c req-06b0c198-5218-4460-b7eb-3abb5d8a2ce1 service nova] Acquired lock "refresh_cache-5162fb94-7344-4193-98c8-c5f165309f60" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.network.neutron [req-5221da03-09cb-49b6-8c0b-07d72d80aa2c req-06b0c198-5218-4460-b7eb-3abb5d8a2ce1 service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Refreshing network info cache for port 98d3c10c-2360-41e7-ae7f-9b7657a7326b {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Start _get_guest_xml network_info=[{"id": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "address": "fa:16:3e:c5:ef:fd", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d3c10c-23", "ovs_interfaceid": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:21:58 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:21:58 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:21:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-714280863',display_name='tempest-VolumesActionsTest-instance-714280863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-714280863',id=36,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f4b7d7e4e314e7aa95f8ceb39a0dc95',ramdisk_id='',reservation_id='r-ao8rgmu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-537401295',owner_user_name='tempest-VolumesActionsTest-537401295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:21:57Z,user_data=None,user_id='29cd6130817e4b588ce838dd958b5fd1',uuid=5162fb94-7344-4193-98c8-c5f165309f60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "address": "fa:16:3e:c5:ef:fd", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d3c10c-23", "ovs_interfaceid": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Converting VIF {"id": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "address": "fa:16:3e:c5:ef:fd", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d3c10c-23", "ovs_interfaceid": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:ef:fd,bridge_name='br-int',has_traffic_filtering=True,id=98d3c10c-2360-41e7-ae7f-9b7657a7326b,network=Network(d67e0969-7ca5-47d9-b6c9-68558277b293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d3c10c-23') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.objects.instance [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lazy-loading 'pci_devices' on Instance uuid 5162fb94-7344-4193-98c8-c5f165309f60 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:21:58 user nova-compute[74242]:   <uuid>5162fb94-7344-4193-98c8-c5f165309f60</uuid>
Oct 20 02:21:58 user nova-compute[74242]:   <name>instance-00000024</name>
Oct 20 02:21:58 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:21:58 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:21:58 user nova-compute[74242]:   <metadata>
Oct 20 02:21:58 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:21:58 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:21:58 user nova-compute[74242]:       <nova:name>tempest-VolumesActionsTest-instance-714280863</nova:name>
Oct 20 02:21:58 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:21:58</nova:creationTime>
Oct 20 02:21:58 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:21:58 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:21:58 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:21:58 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:21:58 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:21:58 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:21:58 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:21:58 user nova-compute[74242]:       <nova:owner>
Oct 20 02:21:58 user nova-compute[74242]:         <nova:user uuid="29cd6130817e4b588ce838dd958b5fd1">tempest-VolumesActionsTest-537401295-project-member</nova:user>
Oct 20 02:21:58 user nova-compute[74242]:         <nova:project uuid="0f4b7d7e4e314e7aa95f8ceb39a0dc95">tempest-VolumesActionsTest-537401295</nova:project>
Oct 20 02:21:58 user nova-compute[74242]:       </nova:owner>
Oct 20 02:21:58 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:21:58 user nova-compute[74242]:       <nova:ports>
Oct 20 02:21:58 user nova-compute[74242]:         <nova:port uuid="98d3c10c-2360-41e7-ae7f-9b7657a7326b">
Oct 20 02:21:58 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 02:21:58 user nova-compute[74242]:         </nova:port>
Oct 20 02:21:58 user nova-compute[74242]:       </nova:ports>
Oct 20 02:21:58 user nova-compute[74242]:     </nova:instance>
Oct 20 02:21:58 user nova-compute[74242]:   </metadata>
Oct 20 02:21:58 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:21:58 user nova-compute[74242]:     <system>
Oct 20 02:21:58 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:21:58 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:21:58 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:21:58 user nova-compute[74242]:       <entry name="serial">5162fb94-7344-4193-98c8-c5f165309f60</entry>
Oct 20 02:21:58 user nova-compute[74242]:       <entry name="uuid">5162fb94-7344-4193-98c8-c5f165309f60</entry>
Oct 20 02:21:58 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:21:58 user nova-compute[74242]:     </system>
Oct 20 02:21:58 user nova-compute[74242]:   </sysinfo>
Oct 20 02:21:58 user nova-compute[74242]:   <os>
Oct 20 02:21:58 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:21:58 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:21:58 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:21:58 user nova-compute[74242]:   </os>
Oct 20 02:21:58 user nova-compute[74242]:   <features>
Oct 20 02:21:58 user nova-compute[74242]:     <acpi/>
Oct 20 02:21:58 user nova-compute[74242]:     <apic/>
Oct 20 02:21:58 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:21:58 user nova-compute[74242]:   </features>
Oct 20 02:21:58 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:21:58 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:21:58 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:21:58 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:21:58 user nova-compute[74242]:   </clock>
Oct 20 02:21:58 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:21:58 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:21:58 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:21:58 user nova-compute[74242]:   </cpu>
Oct 20 02:21:58 user nova-compute[74242]:   <devices>
Oct 20 02:21:58 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:21:58 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:21:58 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/disk"/>
Oct 20 02:21:58 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:21:58 user nova-compute[74242]:     </disk>
Oct 20 02:21:58 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:21:58 user nova-compute[74242]:       <mac address="fa:16:3e:c5:ef:fd"/>
Oct 20 02:21:58 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:21:58 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:21:58 user nova-compute[74242]:       <target dev="tap98d3c10c-23"/>
Oct 20 02:21:58 user nova-compute[74242]:     </interface>
Oct 20 02:21:58 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:21:58 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/console.log" append="off"/>
Oct 20 02:21:58 user nova-compute[74242]:     </serial>
Oct 20 02:21:58 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:21:58 user nova-compute[74242]:     <video>
Oct 20 02:21:58 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:21:58 user nova-compute[74242]:     </video>
Oct 20 02:21:58 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:21:58 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:21:58 user nova-compute[74242]:     </rng>
Oct 20 02:21:58 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:21:58 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:21:58 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:21:58 user nova-compute[74242]:     </memballoon>
Oct 20 02:21:58 user nova-compute[74242]:   </devices>
Oct 20 02:21:58 user nova-compute[74242]: </domain>
Oct 20 02:21:58 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:21:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-714280863',display_name='tempest-VolumesActionsTest-instance-714280863',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-714280863',id=36,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f4b7d7e4e314e7aa95f8ceb39a0dc95',ramdisk_id='',reservation_id='r-ao8rgmu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-537401295',owner_user_name='tempest-VolumesActionsTest-537401295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:21:57Z,user_data=None,user_id='29cd6130817e4b588ce838dd958b5fd1',uuid=5162fb94-7344-4193-98c8-c5f165309f60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "address": "fa:16:3e:c5:ef:fd", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d3c10c-23", "ovs_interfaceid": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Converting VIF {"id": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "address": "fa:16:3e:c5:ef:fd", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d3c10c-23", "ovs_interfaceid": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:ef:fd,bridge_name='br-int',has_traffic_filtering=True,id=98d3c10c-2360-41e7-ae7f-9b7657a7326b,network=Network(d67e0969-7ca5-47d9-b6c9-68558277b293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d3c10c-23') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG os_vif [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:ef:fd,bridge_name='br-int',has_traffic_filtering=True,id=98d3c10c-2360-41e7-ae7f-9b7657a7326b,network=Network(d67e0969-7ca5-47d9-b6c9-68558277b293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d3c10c-23') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b4ab2b3-f361-5a8c-bdee-a6662f19cfa9', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98d3c10c-23, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98d3c10c-23, col_values=(('qos', UUID('7d151b91-d80f-4577-80ea-c64cd94c9c41')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98d3c10c-23, col_values=(('external_ids', {'iface-id': '98d3c10c-2360-41e7-ae7f-9b7657a7326b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:ef:fd', 'vm-uuid': '5162fb94-7344-4193-98c8-c5f165309f60'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:21:58 user nova-compute[74242]: INFO os_vif [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:ef:fd,bridge_name='br-int',has_traffic_filtering=True,id=98d3c10c-2360-41e7-ae7f-9b7657a7326b,network=Network(d67e0969-7ca5-47d9-b6c9-68558277b293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d3c10c-23')
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] No VIF found with MAC fa:16:3e:c5:ef:fd, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.network.neutron [req-5221da03-09cb-49b6-8c0b-07d72d80aa2c req-06b0c198-5218-4460-b7eb-3abb5d8a2ce1 service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Updated VIF entry in instance network info cache for port 98d3c10c-2360-41e7-ae7f-9b7657a7326b. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.network.neutron [req-5221da03-09cb-49b6-8c0b-07d72d80aa2c req-06b0c198-5218-4460-b7eb-3abb5d8a2ce1 service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Updating instance_info_cache with network_info: [{"id": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "address": "fa:16:3e:c5:ef:fd", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d3c10c-23", "ovs_interfaceid": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5221da03-09cb-49b6-8c0b-07d72d80aa2c req-06b0c198-5218-4460-b7eb-3abb5d8a2ce1 service nova] Releasing lock "refresh_cache-5162fb94-7344-4193-98c8-c5f165309f60" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "62ca0d11-07be-4998-8404-b4d31f1e57da" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG nova.objects.instance [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lazy-loading 'flavor' on Instance uuid 62ca0d11-07be-4998-8404-b4d31f1e57da {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:21:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "62ca0d11-07be-4998-8404-b4d31f1e57da" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:21:59 user nova-compute[74242]: INFO nova.compute.manager [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Attaching volume 7c344689-08b8-4604-8db8-a2106115e978 to /dev/vdb
Oct 20 02:21:59 user nova-compute[74242]: DEBUG os_brick.utils [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad534f8-0516-44f4-9a5c-b35b83518e74]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0d9b7d-5f04-4cee-a066-b94318469ed5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e56530b-cac9-4a7d-8d1f-51b66fd90bcd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[904a54f7-ee51-47a8-98d6-161108697e84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:21:59 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:21:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[38105438-76cf-4484-bbc3-48a7fc774709]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG os_brick.utils [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Updating existing volume attachment record: 45f20ca3-fffc-4ff5-a566-db217227d083 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:21:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-eeaeb622-30da-41d0-bf8f-d32e50e6dd83 req-b49ccdb3-0432-4e1f-a2b4-a2799e2ca518 service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Received event network-vif-plugged-98d3c10c-2360-41e7-ae7f-9b7657a7326b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-eeaeb622-30da-41d0-bf8f-d32e50e6dd83 req-b49ccdb3-0432-4e1f-a2b4-a2799e2ca518 service nova] Acquiring lock "5162fb94-7344-4193-98c8-c5f165309f60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-eeaeb622-30da-41d0-bf8f-d32e50e6dd83 req-b49ccdb3-0432-4e1f-a2b4-a2799e2ca518 service nova] Lock "5162fb94-7344-4193-98c8-c5f165309f60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-eeaeb622-30da-41d0-bf8f-d32e50e6dd83 req-b49ccdb3-0432-4e1f-a2b4-a2799e2ca518 service nova] Lock "5162fb94-7344-4193-98c8-c5f165309f60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-eeaeb622-30da-41d0-bf8f-d32e50e6dd83 req-b49ccdb3-0432-4e1f-a2b4-a2799e2ca518 service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] No waiting events found dispatching network-vif-plugged-98d3c10c-2360-41e7-ae7f-9b7657a7326b {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:22:00 user nova-compute[74242]: WARNING nova.compute.manager [req-eeaeb622-30da-41d0-bf8f-d32e50e6dd83 req-b49ccdb3-0432-4e1f-a2b4-a2799e2ca518 service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Received unexpected event network-vif-plugged-98d3c10c-2360-41e7-ae7f-9b7657a7326b for instance with vm_state building and task_state spawning.
Oct 20 02:22:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:22:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:22:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Instance spawned successfully.
Oct 20 02:22:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:22:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:22:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:22:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:22:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:22:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:22:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:22:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-ee328422-0813-4264-b8f0-67741f58db27 req-ef190214-05e6-4caa-b9ed-b30fd4c41acf service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Received event network-vif-plugged-98d3c10c-2360-41e7-ae7f-9b7657a7326b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ee328422-0813-4264-b8f0-67741f58db27 req-ef190214-05e6-4caa-b9ed-b30fd4c41acf service nova] Acquiring lock "5162fb94-7344-4193-98c8-c5f165309f60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ee328422-0813-4264-b8f0-67741f58db27 req-ef190214-05e6-4caa-b9ed-b30fd4c41acf service nova] Lock "5162fb94-7344-4193-98c8-c5f165309f60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ee328422-0813-4264-b8f0-67741f58db27 req-ef190214-05e6-4caa-b9ed-b30fd4c41acf service nova] Lock "5162fb94-7344-4193-98c8-c5f165309f60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-ee328422-0813-4264-b8f0-67741f58db27 req-ef190214-05e6-4caa-b9ed-b30fd4c41acf service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] No waiting events found dispatching network-vif-plugged-98d3c10c-2360-41e7-ae7f-9b7657a7326b {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:22:02 user nova-compute[74242]: WARNING nova.compute.manager [req-ee328422-0813-4264-b8f0-67741f58db27 req-ef190214-05e6-4caa-b9ed-b30fd4c41acf service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Received unexpected event network-vif-plugged-98d3c10c-2360-41e7-ae7f-9b7657a7326b for instance with vm_state building and task_state spawning.
Oct 20 02:22:02 user nova-compute[74242]: INFO nova.compute.manager [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Took 5.78 seconds to spawn the instance on the hypervisor.
Oct 20 02:22:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:22:02 user nova-compute[74242]: INFO nova.compute.manager [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Took 6.66 seconds to build instance.
Oct 20 02:22:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0c1cfc23-d810-4e17-af47-2bace7ffc5e7 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "5162fb94-7344-4193-98c8-c5f165309f60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.761s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:09 user nova-compute[74242]: DEBUG nova.compute.manager [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:22:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:22:09 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Creating image(s)
Oct 20 02:22:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:22:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Ensure instance console log exists: /opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:22:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Start _get_guest_xml network_info=[{"id": "6a09ec72-a9d4-49cf-8089-04b50109b631", "address": "fa:16:3e:cd:60:bc", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a09ec72-a9", "ovs_interfaceid": "6a09ec72-a9d4-49cf-8089-04b50109b631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '76467e6c-ebe2-46d2-ad26-f808f7e34ddf', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWdrhBnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '74295e5c-237c-4992-a21a-6f59fd6ff246', 'attached_at': '', 'detached_at': '', 'volume_id': '3cc7249d-0e6c-479b-8200-c51120c5734d', 'serial': '3cc7249d-0e6c-479b-8200-c51120c5734d'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:22:09 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:22:09 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:22:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:22:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWdrhBnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:22:10 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:22:10 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:22:10 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:22:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16327df-216c-4e73-baf0-d679e75f3869]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:22:10 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf26c97-0fda-48df-b874-fde621b351a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d] added
Oct 20 02:22:10 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b8a056b-4bb8-4d55-8a57-e4037026dd3e]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b82f4c7-0154-4018-baec-973ea29e3d26]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VWdrhBnZ {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VWdrhBnZ" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a8f70c-bc31-4e24-88ef-ae5dccbfda5e]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VWdrhBnZ'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf5cc5e-b02e-45f3-9b47-52dbd597512f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68d7dcc-ef4e-418c-a594-0361135344d7]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:22:10 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:22:10 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[17234813-750a-4656-8c0c-429911f36c62]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d, portal: 172.16.0.220,3260]
Oct 20 02:22:10 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d, portal: 172.16.0.220,3260] successful.
Oct 20 02:22:10 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[20271067-e57e-4ca9-83f5-9943ad4e5cd6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[90fa0a23-749b-447a-823a-35124d4f1c27]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:22:10 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:22:10 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:22:10 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] HCTL ('33', '-', '-', 0) found on session 42 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1697b187-0ab4-4601-9d6e-2b322250bbd5]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching for a device in session 42 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:22:10 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWdrhBnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:22:11 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fdccf817-4784-472a-85d1-96b5cc37722c is timed out.
Oct 20 02:22:11 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Successfully detached device vdb from instance fdccf817-4784-472a-85d1-96b5cc37722c from the live domain config.
Oct 20 02:22:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XGZLuUzg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:22:11 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.373s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23031343038396331', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031343038396331', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.384s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:21:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1378661490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1378661490',id=35,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112fda62d355421e80e674dc18bb5069',ramdisk_id='',reservation_id='r-sg6r9ymm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:21:31Z,user_data=None,user_id='9ac628a224fb4653932a27e33aa33c9d',uuid=74295e5c-237c-4992-a21a-6f59fd6ff246,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a09ec72-a9d4-49cf-8089-04b50109b631", "address": "fa:16:3e:cd:60:bc", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a09ec72-a9", "ovs_interfaceid": "6a09ec72-a9d4-49cf-8089-04b50109b631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converting VIF {"id": "6a09ec72-a9d4-49cf-8089-04b50109b631", "address": "fa:16:3e:cd:60:bc", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a09ec72-a9", "ovs_interfaceid": "6a09ec72-a9d4-49cf-8089-04b50109b631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:60:bc,bridge_name='br-int',has_traffic_filtering=True,id=6a09ec72-a9d4-49cf-8089-04b50109b631,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a09ec72-a9') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG nova.objects.instance [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'pci_devices' on Instance uuid 74295e5c-237c-4992-a21a-6f59fd6ff246 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e225b580-4469-4b47-8f87-c907146bf6d6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:22:11 user nova-compute[74242]: No targets found.
Oct 20 02:22:11 user nova-compute[74242]: iSNS:
Oct 20 02:22:11 user nova-compute[74242]: No targets found.
Oct 20 02:22:11 user nova-compute[74242]: STATIC:
Oct 20 02:22:11 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33
Oct 20 02:22:11 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:11 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:11 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad
Oct 20 02:22:11 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:11 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:11 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5
Oct 20 02:22:11 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:11 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:11 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:22:11 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:11 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:11 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155
Oct 20 02:22:11 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:11 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:11 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d
Oct 20 02:22:11 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:11 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:11 user nova-compute[74242]: FIRMWARE:
Oct 20 02:22:11 user nova-compute[74242]: No targets found.
Oct 20 02:22:11 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:22:11 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:22:11 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:22:11 user nova-compute[74242]:   <uuid>74295e5c-237c-4992-a21a-6f59fd6ff246</uuid>
Oct 20 02:22:11 user nova-compute[74242]:   <name>instance-00000023</name>
Oct 20 02:22:11 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:22:11 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:22:11 user nova-compute[74242]:   <metadata>
Oct 20 02:22:11 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:22:11 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:22:11 user nova-compute[74242]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1378661490</nova:name>
Oct 20 02:22:11 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:22:09</nova:creationTime>
Oct 20 02:22:11 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:22:11 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:22:11 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:22:11 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:22:11 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:22:11 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:22:11 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:22:11 user nova-compute[74242]:       <nova:owner>
Oct 20 02:22:11 user nova-compute[74242]:         <nova:user uuid="9ac628a224fb4653932a27e33aa33c9d">tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member</nova:user>
Oct 20 02:22:11 user nova-compute[74242]:         <nova:project uuid="112fda62d355421e80e674dc18bb5069">tempest-ServerBootFromVolumeStableRescueTest-1661425956</nova:project>
Oct 20 02:22:11 user nova-compute[74242]:       </nova:owner>
Oct 20 02:22:11 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:22:11 user nova-compute[74242]:       <nova:ports>
Oct 20 02:22:11 user nova-compute[74242]:         <nova:port uuid="6a09ec72-a9d4-49cf-8089-04b50109b631">
Oct 20 02:22:11 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 02:22:11 user nova-compute[74242]:         </nova:port>
Oct 20 02:22:11 user nova-compute[74242]:       </nova:ports>
Oct 20 02:22:11 user nova-compute[74242]:     </nova:instance>
Oct 20 02:22:11 user nova-compute[74242]:   </metadata>
Oct 20 02:22:11 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:22:11 user nova-compute[74242]:     <system>
Oct 20 02:22:11 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:22:11 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:22:11 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:22:11 user nova-compute[74242]:       <entry name="serial">74295e5c-237c-4992-a21a-6f59fd6ff246</entry>
Oct 20 02:22:11 user nova-compute[74242]:       <entry name="uuid">74295e5c-237c-4992-a21a-6f59fd6ff246</entry>
Oct 20 02:22:11 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:22:11 user nova-compute[74242]:     </system>
Oct 20 02:22:11 user nova-compute[74242]:   </sysinfo>
Oct 20 02:22:11 user nova-compute[74242]:   <os>
Oct 20 02:22:11 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:22:11 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:22:11 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:22:11 user nova-compute[74242]:   </os>
Oct 20 02:22:11 user nova-compute[74242]:   <features>
Oct 20 02:22:11 user nova-compute[74242]:     <acpi/>
Oct 20 02:22:11 user nova-compute[74242]:     <apic/>
Oct 20 02:22:11 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:22:11 user nova-compute[74242]:   </features>
Oct 20 02:22:11 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:22:11 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:22:11 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:22:11 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:22:11 user nova-compute[74242]:   </clock>
Oct 20 02:22:11 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:22:11 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:22:11 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:22:11 user nova-compute[74242]:   </cpu>
Oct 20 02:22:11 user nova-compute[74242]:   <devices>
Oct 20 02:22:11 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:22:11 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:22:11 user nova-compute[74242]:       <source dev="/dev/sdb"/>
Oct 20 02:22:11 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:22:11 user nova-compute[74242]:       <serial>3cc7249d-0e6c-479b-8200-c51120c5734d</serial>
Oct 20 02:22:11 user nova-compute[74242]:     </disk>
Oct 20 02:22:11 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:22:11 user nova-compute[74242]:       <mac address="fa:16:3e:cd:60:bc"/>
Oct 20 02:22:11 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:22:11 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:22:11 user nova-compute[74242]:       <target dev="tap6a09ec72-a9"/>
Oct 20 02:22:11 user nova-compute[74242]:     </interface>
Oct 20 02:22:11 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:22:11 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/console.log" append="off"/>
Oct 20 02:22:11 user nova-compute[74242]:     </serial>
Oct 20 02:22:11 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:22:11 user nova-compute[74242]:     <video>
Oct 20 02:22:11 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:22:11 user nova-compute[74242]:     </video>
Oct 20 02:22:11 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:22:11 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:22:11 user nova-compute[74242]:     </rng>
Oct 20 02:22:11 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:22:11 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:22:11 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:22:11 user nova-compute[74242]:     </memballoon>
Oct 20 02:22:11 user nova-compute[74242]:   </devices>
Oct 20 02:22:11 user nova-compute[74242]: </domain>
Oct 20 02:22:11 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:21:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1378661490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1378661490',id=35,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='112fda62d355421e80e674dc18bb5069',ramdisk_id='',reservation_id='r-sg6r9ymm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:21:31Z,user_data=None,user_id='9ac628a224fb4653932a27e33aa33c9d',uuid=74295e5c-237c-4992-a21a-6f59fd6ff246,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6a09ec72-a9d4-49cf-8089-04b50109b631", "address": "fa:16:3e:cd:60:bc", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a09ec72-a9", "ovs_interfaceid": "6a09ec72-a9d4-49cf-8089-04b50109b631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converting VIF {"id": "6a09ec72-a9d4-49cf-8089-04b50109b631", "address": "fa:16:3e:cd:60:bc", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a09ec72-a9", "ovs_interfaceid": "6a09ec72-a9d4-49cf-8089-04b50109b631", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:60:bc,bridge_name='br-int',has_traffic_filtering=True,id=6a09ec72-a9d4-49cf-8089-04b50109b631,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a09ec72-a9') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_vif [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:60:bc,bridge_name='br-int',has_traffic_filtering=True,id=6a09ec72-a9d4-49cf-8089-04b50109b631,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a09ec72-a9') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4394d910-d7cf-5ae4-94cd-28eb233ba7da', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6a09ec72-a9, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6a09ec72-a9, col_values=(('qos', UUID('ae12a2eb-a292-4b32-abf5-7d2f0f0c0ac0')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6a09ec72-a9, col_values=(('external_ids', {'iface-id': '6a09ec72-a9d4-49cf-8089-04b50109b631', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:60:bc', 'vm-uuid': '74295e5c-237c-4992-a21a-6f59fd6ff246'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[576f3014-a4cd-43d8-b07e-62e05b0658e9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:11 user nova-compute[74242]: INFO os_vif [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:60:bc,bridge_name='br-int',has_traffic_filtering=True,id=6a09ec72-a9d4-49cf-8089-04b50109b631,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a09ec72-a9')
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[777d9c1f-f8be-4efc-9b53-c9fe6089ac01]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:22:11 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:22:11 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:22:11 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:22:11 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:22:11 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:22:11 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:22:11 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:22:11 user nova-compute[74242]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 (non-flash)
Oct 20 02:22:11 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:22:11 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:22:11 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:22:11 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d022b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33'): ({'sde'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Removing single pathed devices sde {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8d470a-1c9b-4e16-8373-d529b7783cdf]: (4, ('path checker states:\nup                  5\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] No VIF found with MAC fa:16:3e:cd:60:bc, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef56c5bf-1300-4e03-a68d-6c65ed0d5ae4]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Flushing IO for device /dev/sde {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[81903c90-1b4b-4539-a064-e30178fe8208]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7af709-be7e-4714-8066-9dc3cf04f879]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[594da6de-4688-45c1-ab58-4c4a8bbfad06]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[83551c6f-d9ab-418d-b9ff-d56686cd04c9]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260]
Oct 20 02:22:11 user nova-compute[74242]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33, portal: 172.16.0.220,3260] successful.
Oct 20 02:22:11 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ddad15b-604d-4140-bf1b-845eaa5bda33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c269f93-e05d-4718-8a32-bf68bde0c5f0]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] <== disconnect_volume: return (758ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:22:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:22:12 user nova-compute[74242]: DEBUG nova.objects.instance [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lazy-loading 'flavor' on Instance uuid fdccf817-4784-472a-85d1-96b5cc37722c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:22:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-61660f36-761a-4999-823e-3afff3ebc70a tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "fdccf817-4784-472a-85d1-96b5cc37722c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.287s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:13 user nova-compute[74242]: DEBUG nova.compute.manager [req-778df5ea-affb-4be6-aa13-5095d433c081 req-ee02900e-b0c1-4793-8af0-37adfc5aba14 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-778df5ea-affb-4be6-aa13-5095d433c081 req-ee02900e-b0c1-4793-8af0-37adfc5aba14 service nova] Acquiring lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-778df5ea-affb-4be6-aa13-5095d433c081 req-ee02900e-b0c1-4793-8af0-37adfc5aba14 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-778df5ea-affb-4be6-aa13-5095d433c081 req-ee02900e-b0c1-4793-8af0-37adfc5aba14 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:13 user nova-compute[74242]: DEBUG nova.compute.manager [req-778df5ea-affb-4be6-aa13-5095d433c081 req-ee02900e-b0c1-4793-8af0-37adfc5aba14 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] No waiting events found dispatching network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:22:13 user nova-compute[74242]: WARNING nova.compute.manager [req-778df5ea-affb-4be6-aa13-5095d433c081 req-ee02900e-b0c1-4793-8af0-37adfc5aba14 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received unexpected event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 for instance with vm_state building and task_state spawning.
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.volume.cinder [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Update attachment failed for attachment 45f20ca3-fffc-4ff5-a566-db217227d083. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2cefc714-166c-4e22-8d86-00c039f4ca54) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2cefc714-166c-4e22-8d86-00c039f4ca54)
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Failed to attach 7c344689-08b8-4604-8db8-a2106115e978 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2cefc714-166c-4e22-8d86-00c039f4ca54)
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Traceback (most recent call last):
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     ret_val = method(obj, context, *args, **kwargs)
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     self._do_attach(context, instance, volume, volume_api,
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     self._volume_attach(context, volume, connector, instance,
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     connection_info = volume_api.attachment_update(
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     res = method(self, ctx, *args, **kwargs)
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     with excutils.save_and_reraise_exception():
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     self.force_reraise()
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     raise self.value
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     return method.func(obj, *args, **kwargs)
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     resp = self._update('/attachments/%s' % id, body)
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     return self.request(url, method, **kwargs)
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da]     raise exceptions.from_response(resp, body)
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2cefc714-166c-4e22-8d86-00c039f4ca54)
Oct 20 02:22:14 user nova-compute[74242]: ERROR nova.compute.manager [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] 
Oct 20 02:22:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 15.857s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server [None req-ec60f2ef-d9ef-4cf8-8507-815518030b3d tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2cefc714-166c-4e22-8d86-00c039f4ca54)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-2cefc714-166c-4e22-8d86-00c039f4ca54)
Oct 20 02:22:15 user nova-compute[74242]: ERROR oslo_messaging.rpc.server 
Oct 20 02:22:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-154db9fa-524e-4597-b37f-7d94528ea083 req-953a912c-842f-41d1-9c5a-b26686196a15 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-154db9fa-524e-4597-b37f-7d94528ea083 req-953a912c-842f-41d1-9c5a-b26686196a15 service nova] Acquiring lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-154db9fa-524e-4597-b37f-7d94528ea083 req-953a912c-842f-41d1-9c5a-b26686196a15 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-154db9fa-524e-4597-b37f-7d94528ea083 req-953a912c-842f-41d1-9c5a-b26686196a15 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-154db9fa-524e-4597-b37f-7d94528ea083 req-953a912c-842f-41d1-9c5a-b26686196a15 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] No waiting events found dispatching network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:22:15 user nova-compute[74242]: WARNING nova.compute.manager [req-154db9fa-524e-4597-b37f-7d94528ea083 req-953a912c-842f-41d1-9c5a-b26686196a15 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received unexpected event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 for instance with vm_state building and task_state spawning.
Oct 20 02:22:15 user nova-compute[74242]: DEBUG nova.compute.manager [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:22:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:22:15 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Instance spawned successfully.
Oct 20 02:22:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:22:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:22:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:22:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:22:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:22:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:22:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:22:15 user nova-compute[74242]: INFO nova.compute.manager [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Took 5.71 seconds to spawn the instance on the hypervisor.
Oct 20 02:22:15 user nova-compute[74242]: DEBUG nova.compute.manager [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:22:15 user nova-compute[74242]: INFO nova.compute.manager [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Took 45.39 seconds to build instance.
Oct 20 02:22:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40eb2512-916a-46c6-bfda-5878914f07bf tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.490s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG nova.objects.instance [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lazy-loading 'flavor' on Instance uuid 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:16 user nova-compute[74242]: INFO nova.compute.manager [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Attaching volume 010f709e-1642-4e87-a8f3-f7e3dd473298 to /dev/vdb
Oct 20 02:22:16 user nova-compute[74242]: DEBUG os_brick.utils [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b022aa-d615-4a15-917b-068d3d52800b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51f2c76-91a5-44ec-a8a5-972a0540e2d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2635294e-2589-45e5-b847-5e5f79e44a1c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b883b722-b229-4b33-9477-a60633f7f9a5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:22:16 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:22:16 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ded491a-4089-4696-882e-ce8d41a5ca71]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG os_brick.utils [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:22:16 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Updating existing volume attachment record: f47dae19-5001-46e7-a3c9-8136698bdd76 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:22:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-f5c6737a-b91f-49bd-8dee-2dc89d143243 req-784f5e31-5465-49b6-901f-c9168205f186 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Received event network-changed-3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-f5c6737a-b91f-49bd-8dee-2dc89d143243 req-784f5e31-5465-49b6-901f-c9168205f186 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Refreshing instance network info cache due to event network-changed-3e12123a-bc10-4890-b661-b8dbfc74e420. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:22:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f5c6737a-b91f-49bd-8dee-2dc89d143243 req-784f5e31-5465-49b6-901f-c9168205f186 service nova] Acquiring lock "refresh_cache-9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:22:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f5c6737a-b91f-49bd-8dee-2dc89d143243 req-784f5e31-5465-49b6-901f-c9168205f186 service nova] Acquired lock "refresh_cache-9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:22:26 user nova-compute[74242]: DEBUG nova.network.neutron [req-f5c6737a-b91f-49bd-8dee-2dc89d143243 req-784f5e31-5465-49b6-901f-c9168205f186 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Refreshing network info cache for port 3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:22:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:26 user nova-compute[74242]: DEBUG nova.network.neutron [req-f5c6737a-b91f-49bd-8dee-2dc89d143243 req-784f5e31-5465-49b6-901f-c9168205f186 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Updated VIF entry in instance network info cache for port 3e12123a-bc10-4890-b661-b8dbfc74e420. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:22:26 user nova-compute[74242]: DEBUG nova.network.neutron [req-f5c6737a-b91f-49bd-8dee-2dc89d143243 req-784f5e31-5465-49b6-901f-c9168205f186 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Updating instance_info_cache with network_info: [{"id": "3e12123a-bc10-4890-b661-b8dbfc74e420", "address": "fa:16:3e:5e:d6:a5", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e12123a-bc", "ovs_interfaceid": "3e12123a-bc10-4890-b661-b8dbfc74e420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:22:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f5c6737a-b91f-49bd-8dee-2dc89d143243 req-784f5e31-5465-49b6-901f-c9168205f186 service nova] Releasing lock "refresh_cache-9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:27 user nova-compute[74242]: INFO nova.compute.manager [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Terminating instance
Oct 20 02:22:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:27 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Instance destroyed successfully.
Oct 20 02:22:27 user nova-compute[74242]: DEBUG nova.objects.instance [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lazy-loading 'resources' on Instance uuid 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:19:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-772823707',display_name='tempest-TestVolumeBootPattern-server-772823707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-772823707',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYHgQrnRlQ4jBKzblQ3DfxaEfVjuxo/NC6O+ICak+0aaFoFY7UzIhNxrdgQLtBAfBOsL0Lu2xLtyVpinmCCfqmljj/P6GdvFSKRfnZG4N6/Y2tUqR86uaxeDlehlPmATw==',key_name='tempest-TestVolumeBootPattern-887907135',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:20:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-hrp6qf9v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:20:36Z,user_data=None,user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=9a457b3f-924a-4f7b-9a8b-44ea3c3c1339,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e12123a-bc10-4890-b661-b8dbfc74e420", "address": "fa:16:3e:5e:d6:a5", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e12123a-bc", "ovs_interfaceid": "3e12123a-bc10-4890-b661-b8dbfc74e420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "3e12123a-bc10-4890-b661-b8dbfc74e420", "address": "fa:16:3e:5e:d6:a5", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e12123a-bc", "ovs_interfaceid": "3e12123a-bc10-4890-b661-b8dbfc74e420", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:d6:a5,bridge_name='br-int',has_traffic_filtering=True,id=3e12123a-bc10-4890-b661-b8dbfc74e420,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e12123a-bc') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG os_vif [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:d6:a5,bridge_name='br-int',has_traffic_filtering=True,id=3e12123a-bc10-4890-b661-b8dbfc74e420,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e12123a-bc') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e12123a-bc, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a41fb187-4d29-4aef-9eba-d430e1cf483c) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:22:27 user nova-compute[74242]: INFO os_vif [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:d6:a5,bridge_name='br-int',has_traffic_filtering=True,id=3e12123a-bc10-4890-b661-b8dbfc74e420,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e12123a-bc')
Oct 20 02:22:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sAPnXGtu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:22:28 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3874bf-e697-4490-aa3d-ab29aa768801]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:22:28 user nova-compute[74242]: No targets found.
Oct 20 02:22:28 user nova-compute[74242]: iSNS:
Oct 20 02:22:28 user nova-compute[74242]: No targets found.
Oct 20 02:22:28 user nova-compute[74242]: STATIC:
Oct 20 02:22:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad
Oct 20 02:22:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5
Oct 20 02:22:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:22:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155
Oct 20 02:22:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:28 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d
Oct 20 02:22:28 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:28 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:28 user nova-compute[74242]: FIRMWARE:
Oct 20 02:22:28 user nova-compute[74242]: No targets found.
Oct 20 02:22:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:22:28 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:22:28 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b016c076-d64d-4863-a3f9-eee76f402d7f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66d89ee-6fb4-47ef-bcc8-fed1de3cb534]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:22:28 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:22:28 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:22:28 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:22:28 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:22:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:22:28 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:22:28 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:22:28 user nova-compute[74242]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad (non-flash)
Oct 20 02:22:28 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:22:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d037cdc0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad'): ({'sdg'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Removing single pathed devices sdg {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[da725ba7-d02c-4116-bfe8-754c85832ad0]: (4, ('path checker states:\nup                  4\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0896f29f-21d0-48c2-8c79-d82270ea0181]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flushing IO for device /dev/sdg {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed70e0ac-f8df-440b-a541-3e91024575a2]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Received event network-changed-3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Refreshing instance network info cache due to event network-changed-3e12123a-bc10-4890-b661-b8dbfc74e420. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] Acquiring lock "refresh_cache-9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] Acquired lock "refresh_cache-9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG nova.network.neutron [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Refreshing network info cache for port 3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.062s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff179cb6-8763-4e94-a5fd-ee9d3dbb4731]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] SCSI volumes sdg have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dfdf2f2-562f-46d5-ab07-2bf108314a57]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2c65b8-176e-4056-a362-8b186c19dd2d]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad, portal: 172.16.0.220,3260]
Oct 20 02:22:28 user nova-compute[74242]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad, portal: 172.16.0.220,3260] successful.
Oct 20 02:22:28 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:43ee55e4-2aa2-4b93-ac99-5927df75b7ad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[251444bc-a794-4376-8efa-e4f2b0c51d40]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== disconnect_volume: return (374ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:22:28 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Deleting instance files /opt/stack/data/nova/instances/9a457b3f-924a-4f7b-9a8b-44ea3c3c1339_del
Oct 20 02:22:28 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Deletion of /opt/stack/data/nova/instances/9a457b3f-924a-4f7b-9a8b-44ea3c3c1339_del complete
Oct 20 02:22:28 user nova-compute[74242]: INFO nova.compute.manager [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Took 1.27 seconds to destroy the instance on the hypervisor.
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG nova.network.neutron [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Updated VIF entry in instance network info cache for port 3e12123a-bc10-4890-b661-b8dbfc74e420. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG nova.network.neutron [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Updating instance_info_cache with network_info: [{"id": "3e12123a-bc10-4890-b661-b8dbfc74e420", "address": "fa:16:3e:5e:d6:a5", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e12123a-bc", "ovs_interfaceid": "3e12123a-bc10-4890-b661-b8dbfc74e420", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] Releasing lock "refresh_cache-9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Received event network-vif-unplugged-3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] Acquiring lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] No waiting events found dispatching network-vif-unplugged-3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Received event network-vif-unplugged-3e12123a-bc10-4890-b661-b8dbfc74e420 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Received event network-vif-plugged-3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] Acquiring lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] No waiting events found dispatching network-vif-plugged-3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:22:28 user nova-compute[74242]: WARNING nova.compute.manager [req-932e4ebd-1f43-435b-8747-484ef3fa02df req-17ec00b7-8763-4b91-b1ae-72aca13b5129 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Received unexpected event network-vif-plugged-3e12123a-bc10-4890-b661-b8dbfc74e420 for instance with vm_state active and task_state deleting.
Oct 20 02:22:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:28 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:22:28 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Took 0.53 seconds to deallocate network for instance.
Oct 20 02:22:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-55410347-158f-4949-900e-7b2ef6cb7595 req-2576c18f-05c5-4e35-a202-692a1f8af7f3 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Received event network-vif-deleted-3e12123a-bc10-4890-b661-b8dbfc74e420 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:29 user nova-compute[74242]: INFO nova.compute.manager [req-55410347-158f-4949-900e-7b2ef6cb7595 req-2576c18f-05c5-4e35-a202-692a1f8af7f3 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Neutron deleted interface 3e12123a-bc10-4890-b661-b8dbfc74e420; detaching it from the instance and deleting it from the info cache
Oct 20 02:22:29 user nova-compute[74242]: DEBUG nova.network.neutron [req-55410347-158f-4949-900e-7b2ef6cb7595 req-2576c18f-05c5-4e35-a202-692a1f8af7f3 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:22:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-55410347-158f-4949-900e-7b2ef6cb7595 req-2576c18f-05c5-4e35-a202-692a1f8af7f3 service nova] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Detach interface failed, port_id=3e12123a-bc10-4890-b661-b8dbfc74e420, reason: Instance 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:22:29 user nova-compute[74242]: INFO nova.compute.manager [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339] Took 0.86 seconds to detach 1 volumes for instance.
Oct 20 02:22:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:30 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:22:30 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:22:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.416s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:30 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Deleted allocations for instance 9a457b3f-924a-4f7b-9a8b-44ea3c3c1339
Oct 20 02:22:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-06f277c4-aae6-410c-859b-15b450804fea tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "9a457b3f-924a-4f7b-9a8b-44ea3c3c1339" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.293s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHEeAnUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:22:35 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:22:35 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:22:35 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[753033cb-e8fa-4c93-8549-3a67eaa00b2a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:22:35 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b34500-f15d-464a-be48-dfa62829116d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298] added
Oct 20 02:22:35 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d597cf9f-26c7-4fd2-a516-314a69986fa8]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[227ee9d6-2a7c-4842-980f-8fe3eb878d8e]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHEeAnUC {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GHEeAnUC" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b383ccea-b074-48f6-af5d-7ba7b2010571]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GHEeAnUC'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a88991-8c75-4878-9a6d-6bd94bacb46f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13cecf1-fa6e-42fc-8cf3-1e2b24f5c013]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:22:35 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:22:35 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:22:35 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:22:35 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:22:35 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:22:35 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:22:35 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:22:35 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe8ac6d-ffe6-4e5f-8a6f-59bd448c848f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298, portal: 172.16.0.220,3260]
Oct 20 02:22:35 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298, portal: 172.16.0.220,3260] successful.
Oct 20 02:22:35 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ea0d57-ab26-4c0b-9a5d-429df66aa81d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3722c6f-504a-4e4f-a5b6-5384218cb815]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:22:35 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:22:35 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:22:35 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:22:35 user nova-compute[74242]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 (non-flash)
Oct 20 02:22:35 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:22:35 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:22:35 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:22:35 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:22:35 user nova-compute[74242]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 (non-flash)
Oct 20 02:22:35 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.301s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] HCTL ('36', '-', '-', 0) found on session 43 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f03ad66-cb4b-445b-a3d5-522011a065b3]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:35 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:22:36 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Searching for a device in session 43 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:22:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHEeAnUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:22:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:22:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23061663432633864', 'path': '/dev/sde'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:22:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23061663432633864', 'path': '/dev/sde'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:22:36 user nova-compute[74242]: DEBUG nova.objects.instance [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lazy-loading 'flavor' on Instance uuid 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:22:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:22:36 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:22:36 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:22:36 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:22:36 user nova-compute[74242]:   <serial>010f709e-1642-4e87-a8f3-f7e3dd473298</serial>
Oct 20 02:22:36 user nova-compute[74242]: </disk>
Oct 20 02:22:36 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:22:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:22:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:22:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] No VIF found with MAC fa:16:3e:6b:ed:0a, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:22:37 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:22:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-4c4eb269-a46e-49e2-90f5-e5b6ea33c706 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.940s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "0636ce59-3cfb-4959-bb28-bce8f4c30043" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "0636ce59-3cfb-4959-bb28-bce8f4c30043-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:38 user nova-compute[74242]: INFO nova.compute.manager [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Terminating instance
Oct 20 02:22:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-f7552367-1f3e-4f70-9a2f-1bc3dbd14627 req-f6e04383-02cc-4a62-b0ab-2a50168a11f6 service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Received event network-vif-unplugged-4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f7552367-1f3e-4f70-9a2f-1bc3dbd14627 req-f6e04383-02cc-4a62-b0ab-2a50168a11f6 service nova] Acquiring lock "0636ce59-3cfb-4959-bb28-bce8f4c30043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f7552367-1f3e-4f70-9a2f-1bc3dbd14627 req-f6e04383-02cc-4a62-b0ab-2a50168a11f6 service nova] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f7552367-1f3e-4f70-9a2f-1bc3dbd14627 req-f6e04383-02cc-4a62-b0ab-2a50168a11f6 service nova] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-f7552367-1f3e-4f70-9a2f-1bc3dbd14627 req-f6e04383-02cc-4a62-b0ab-2a50168a11f6 service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] No waiting events found dispatching network-vif-unplugged-4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-f7552367-1f3e-4f70-9a2f-1bc3dbd14627 req-f6e04383-02cc-4a62-b0ab-2a50168a11f6 service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Received event network-vif-unplugged-4e64f25c-d50c-4c69-950d-1bccc487367c for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:22:38 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Instance destroyed successfully.
Oct 20 02:22:38 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lazy-loading 'resources' on Instance uuid 0636ce59-3cfb-4959-bb28-bce8f4c30043 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:02:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1417949016',display_name='tempest-ServerActionsTestOtherA-server-1417949016',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1417949016',id=4,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKB7bL+2x0x/JgolwV73wEpn90TfE93HD11kN8fWTUdskLHr/+qGh8YX2pmWaISRSrg9SBRQDQmulufko6eTLMYIA5vcJ4clYCIWnNXj2Hp2S/9mOnMK73v45XTwiydUrQ==',key_name='tempest-keypair-1706623376',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:02:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5cf9b187fe8443aba57a8c629d78978e',ramdisk_id='',reservation_id='r-mby22fes',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-2076229102',owner_user_name='tempest-ServerActionsTestOtherA-2076229102-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:02:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c1f488a444de49f5bed5351efd55dafa',uuid=0636ce59-3cfb-4959-bb28-bce8f4c30043,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converting VIF {"id": "4e64f25c-d50c-4c69-950d-1bccc487367c", "address": "fa:16:3e:36:d4:89", "network": {"id": "cdc35bb4-643d-43f8-9969-50eb97602999", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-2013478958-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5cf9b187fe8443aba57a8c629d78978e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e64f25c-d5", "ovs_interfaceid": "4e64f25c-d50c-4c69-950d-1bccc487367c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:36:d4:89,bridge_name='br-int',has_traffic_filtering=True,id=4e64f25c-d50c-4c69-950d-1bccc487367c,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e64f25c-d5') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG os_vif [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:d4:89,bridge_name='br-int',has_traffic_filtering=True,id=4e64f25c-d50c-4c69-950d-1bccc487367c,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e64f25c-d5') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e64f25c-d5, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bbdb2fe6-df09-400f-9331-914886d3b353) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:22:38 user nova-compute[74242]: INFO os_vif [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:36:d4:89,bridge_name='br-int',has_traffic_filtering=True,id=4e64f25c-d50c-4c69-950d-1bccc487367c,network=Network(cdc35bb4-643d-43f8-9969-50eb97602999),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e64f25c-d5')
Oct 20 02:22:38 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Deleting instance files /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043_del
Oct 20 02:22:38 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Deletion of /opt/stack/data/nova/instances/0636ce59-3cfb-4959-bb28-bce8f4c30043_del complete
Oct 20 02:22:38 user nova-compute[74242]: INFO nova.compute.manager [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 02:22:38 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:22:38 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:39 user nova-compute[74242]: INFO nova.compute.manager [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Terminating instance
Oct 20 02:22:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:22:39 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Took 0.58 seconds to deallocate network for instance.
Oct 20 02:22:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-20dd1ae2-727a-449f-a64b-5c60ade63bb5 req-b4348f4d-082b-451b-a619-35b5e351bf9e service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Received event network-vif-deleted-4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:39 user nova-compute[74242]: INFO nova.compute.manager [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Detaching volume 010f709e-1642-4e87-a8f3-f7e3dd473298
Oct 20 02:22:39 user nova-compute[74242]: INFO nova.virt.block_device [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Attempting to driver detach volume 010f709e-1642-4e87-a8f3-f7e3dd473298 from mountpoint /dev/vdb
Oct 20 02:22:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Attempting to detach device vdb from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:22:39 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:22:39 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:22:39 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:22:39 user nova-compute[74242]:   <serial>010f709e-1642-4e87-a8f3-f7e3dd473298</serial>
Oct 20 02:22:39 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:22:39 user nova-compute[74242]: </disk>
Oct 20 02:22:39 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:22:39 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Successfully detached device vdb from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the persistent domain config.
Oct 20 02:22:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:22:39 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:22:39 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:22:39 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:22:39 user nova-compute[74242]:   <serial>010f709e-1642-4e87-a8f3-f7e3dd473298</serial>
Oct 20 02:22:39 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:22:39 user nova-compute[74242]: </disk>
Oct 20 02:22:39 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:22:39 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updating instance_info_cache with network_info: [{"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-fdccf817-4784-472a-85d1-96b5cc37722c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.493s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:40 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Deleted allocations for instance 0636ce59-3cfb-4959-bb28-bce8f4c30043
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d00bcf3-7a42-453d-882c-7e117b986630 tempest-ServerActionsTestOtherA-2076229102 tempest-ServerActionsTestOtherA-2076229102-project-member] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.146s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:22:40 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Instance destroyed successfully.
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.objects.instance [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lazy-loading 'resources' on Instance uuid 2645af84-8ba4-4a34-beb1-9676cce3dc5f {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:13:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-346873381',display_name='tempest-ServerActionsTestOtherB-server-346873381',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-346873381',id=25,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIIglcMR+peRa0oE4XH1xEQPQIqhuBje0KSTUzv/TpZRtBBqkKyYxWmNpC0JGbnCtrC95IJdTO6AdIgwEwg+bzGJkzWbXrKT8XXGF365xukpUOAemIbyOpaYNjhmP5ri2Q==',key_name='tempest-keypair-921939156',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:20:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f72d19ab869b4bdeb6798f12ca2ef6ae',ramdisk_id='',reservation_id='r-r3xavz7r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-215383043',owner_user_name='tempest-ServerActionsTestOtherB-215383043-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:20:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7de983dabe464ac8a720fc45fc311bf5',uuid=2645af84-8ba4-4a34-beb1-9676cce3dc5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converting VIF {"id": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "address": "fa:16:3e:1f:ee:0a", "network": {"id": "8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-2124958625-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.13", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f72d19ab869b4bdeb6798f12ca2ef6ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbfec951d-2a", "ovs_interfaceid": "bfec951d-2a9f-4fec-98a8-e9683bc83787", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_vif [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbfec951d-2a, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bca511d4-2d33-4935-93ce-60fcf08f2a94) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:22:40 user nova-compute[74242]: INFO os_vif [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:ee:0a,bridge_name='br-int',has_traffic_filtering=True,id=bfec951d-2a9f-4fec-98a8-e9683bc83787,network=Network(8a700f6a-cf2b-41cc-af6e-dbfecaebb0d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbfec951d-2a')
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AedRuVJG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:22:40 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0dd5db-1856-4ac4-b5ad-015b46e4b092]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:22:40 user nova-compute[74242]: No targets found.
Oct 20 02:22:40 user nova-compute[74242]: iSNS:
Oct 20 02:22:40 user nova-compute[74242]: No targets found.
Oct 20 02:22:40 user nova-compute[74242]: STATIC:
Oct 20 02:22:40 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298
Oct 20 02:22:40 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:40 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:40 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5
Oct 20 02:22:40 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:40 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:40 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:22:40 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:40 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:40 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155
Oct 20 02:22:40 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:40 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:40 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d
Oct 20 02:22:40 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:22:40 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:22:40 user nova-compute[74242]: FIRMWARE:
Oct 20 02:22:40 user nova-compute[74242]: No targets found.
Oct 20 02:22:40 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:22:40 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:22:40 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbfd5041-7dad-48c5-a310-a1beff3113c6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a67d41-c243-408e-8557-eef3cd69746b]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:22:40 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:22:40 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:22:40 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:22:40 user nova-compute[74242]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 (non-flash)
Oct 20 02:22:40 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:22:40 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:22:40 user nova-compute[74242]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 (non-flash)
Oct 20 02:22:40 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:22:40 user nova-compute[74242]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 (non-flash)
Oct 20 02:22:40 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d0189c60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5'): ({'sdf'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Removing single pathed devices sdf {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[636b3cfc-9665-4e97-813a-ef087d63e089]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[780ef2c1-71f3-4f20-8cbb-df09a3b5cfbc]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Flushing IO for device /dev/sdf {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdff25d-0668-4a7d-b25b-deef8a22b0e9]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Received event network-vif-plugged-4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] Acquiring lock "0636ce59-3cfb-4959-bb28-bce8f4c30043-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] Lock "0636ce59-3cfb-4959-bb28-bce8f4c30043-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] No waiting events found dispatching network-vif-plugged-4e64f25c-d50c-4c69-950d-1bccc487367c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:22:40 user nova-compute[74242]: WARNING nova.compute.manager [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] [instance: 0636ce59-3cfb-4959-bb28-bce8f4c30043] Received unexpected event network-vif-plugged-4e64f25c-d50c-4c69-950d-1bccc487367c for instance with vm_state deleted and task_state None.
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-vif-unplugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] No waiting events found dispatching network-vif-unplugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-vif-unplugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] Acquiring lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] No waiting events found dispatching network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:22:40 user nova-compute[74242]: WARNING nova.compute.manager [req-d7454075-7f4a-4c1f-98e5-eaa52cf22ca9 req-139c0a35-7860-46a9-957b-ddf135fc84ea service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received unexpected event network-vif-plugged-bfec951d-2a9f-4fec-98a8-e9683bc83787 for instance with vm_state active and task_state deleting.
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.039s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f036a8f-5570-476f-892d-ac642d327e70]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] SCSI volumes sdf have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[480245ad-95ec-475b-99fb-b10452f1942a]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae287f93-e032-4c8e-b69f-7ec0bda790ef]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260]
Oct 20 02:22:40 user nova-compute[74242]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5, portal: 172.16.0.220,3260] successful.
Oct 20 02:22:40 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bb8530dc-d2f2-4f73-a60d-f7acd7be85f5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3719b706-228d-4706-9b94-d6097faa7f00]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] <== disconnect_volume: return (345ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:22:40 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Deleting instance files /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f_del
Oct 20 02:22:40 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Deletion of /opt/stack/data/nova/instances/2645af84-8ba4-4a34-beb1-9676cce3dc5f_del complete
Oct 20 02:22:40 user nova-compute[74242]: INFO nova.compute.manager [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Took 1.56 seconds to destroy the instance on the hypervisor.
Oct 20 02:22:40 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:22:40 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:22:41 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:22:41 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:22:41 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Took 0.89 seconds to deallocate network for instance.
Oct 20 02:22:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-6f0b20c4-22f3-4480-a754-551daea7ad1c req-40d66656-2770-4cd3-923a-a1955e618ad3 service nova] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Received event network-vif-deleted-bfec951d-2a9f-4fec-98a8-e9683bc83787 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:42 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:22:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:22:42 user nova-compute[74242]: INFO nova.compute.manager [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] [instance: 2645af84-8ba4-4a34-beb1-9676cce3dc5f] Took 0.85 seconds to detach 1 volumes for instance.
Oct 20 02:22:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:42 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:22:42 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:22:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.339s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:42 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Deleted allocations for instance 2645af84-8ba4-4a34-beb1-9676cce3dc5f
Oct 20 02:22:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e7d670de-ae16-4179-b1f1-a405e7fe7a75 tempest-ServerActionsTestOtherB-215383043 tempest-ServerActionsTestOtherB-215383043-project-member] Lock "2645af84-8ba4-4a34-beb1-9676cce3dc5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.838s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:43 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:22:43 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:22:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:45 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:22:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:45 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:22:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:22:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:22:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:22:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:22:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:22:48 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:22:48 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:22:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7707MB free_disk=24.90813446044922GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c98e383a-e1e5-4130-9cc6-a9823db0b88c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance fdccf817-4784-472a-85d1-96b5cc37722c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 531961c2-d07a-4edc-8714-16ff1fa1a925 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 876f8f80-9640-43ba-8ec7-0ffe06c82086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 62ca0d11-07be-4998-8404-b4d31f1e57da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 74295e5c-237c-4992-a21a-6f59fd6ff246 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 5162fb94-7344-4193-98c8-c5f165309f60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:22:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.470s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "fdccf817-4784-472a-85d1-96b5cc37722c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.004s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:50 user nova-compute[74242]: INFO nova.compute.manager [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Terminating instance
Oct 20 02:22:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:22:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-f915da7e-a295-43b2-a083-9fb8380637a0 req-49f6799b-404c-4b5c-af74-62ba0f59e419 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received event network-vif-unplugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f915da7e-a295-43b2-a083-9fb8380637a0 req-49f6799b-404c-4b5c-af74-62ba0f59e419 service nova] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f915da7e-a295-43b2-a083-9fb8380637a0 req-49f6799b-404c-4b5c-af74-62ba0f59e419 service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f915da7e-a295-43b2-a083-9fb8380637a0 req-49f6799b-404c-4b5c-af74-62ba0f59e419 service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-f915da7e-a295-43b2-a083-9fb8380637a0 req-49f6799b-404c-4b5c-af74-62ba0f59e419 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] No waiting events found dispatching network-vif-unplugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-f915da7e-a295-43b2-a083-9fb8380637a0 req-49f6799b-404c-4b5c-af74-62ba0f59e419 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received event network-vif-unplugged-006062cf-dcc6-4756-a074-1bf376c16abf for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:51 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Instance destroyed successfully.
Oct 20 02:22:51 user nova-compute[74242]: DEBUG nova.objects.instance [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lazy-loading 'resources' on Instance uuid fdccf817-4784-472a-85d1-96b5cc37722c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:16:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1250993369',display_name='tempest-TestMinimumBasicScenario-server-1250993369',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1250993369',id=29,image_ref='e5234cc4-11f6-4a2e-aabc-4d507a10c9e3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEK58nK6/P7M9XX8Wto2o2Cy7i0fJFGM0D+C6eoGBe2je56k+b9odApg/kqd46JoZFSmd1A/ZjHKFUC29opF6ojgFuWZQ/K0Qwz/+Yn0qBXWUi5tHm6qeiPFv0smmEhnRw==',key_name='tempest-TestMinimumBasicScenario-1841214259',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:16:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7331dc1aa6464021bb371a8ebcf3a42b',ramdisk_id='',reservation_id='r-0b9t5znw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='e5234cc4-11f6-4a2e-aabc-4d507a10c9e3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-504118242',owner_user_name='tempest-TestMinimumBasicScenario-504118242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:20:05Z,user_data=None,user_id='8b64ecd6426f429ba929925fca497c82',uuid=fdccf817-4784-472a-85d1-96b5cc37722c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converting VIF {"id": "006062cf-dcc6-4756-a074-1bf376c16abf", "address": "fa:16:3e:88:a9:46", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap006062cf-dc", "ovs_interfaceid": "006062cf-dcc6-4756-a074-1bf376c16abf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:88:a9:46,bridge_name='br-int',has_traffic_filtering=True,id=006062cf-dcc6-4756-a074-1bf376c16abf,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap006062cf-dc') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG os_vif [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:a9:46,bridge_name='br-int',has_traffic_filtering=True,id=006062cf-dcc6-4756-a074-1bf376c16abf,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap006062cf-dc') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap006062cf-dc, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6fa0147f-5c71-4677-baae-1ebde75fc777) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:22:51 user nova-compute[74242]: INFO os_vif [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:88:a9:46,bridge_name='br-int',has_traffic_filtering=True,id=006062cf-dcc6-4756-a074-1bf376c16abf,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap006062cf-dc')
Oct 20 02:22:51 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Deleting instance files /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c_del
Oct 20 02:22:51 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Deletion of /opt/stack/data/nova/instances/fdccf817-4784-472a-85d1-96b5cc37722c_del complete
Oct 20 02:22:51 user nova-compute[74242]: INFO nova.compute.manager [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 20 02:22:51 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:22:51 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:22:52 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:22:52 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Took 0.53 seconds to deallocate network for instance.
Oct 20 02:22:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-33983bdb-4ab0-462f-b9aa-4dc0ed9c2133 req-56dd3fcb-a31d-4932-b57a-e4b6f95e3826 service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received event network-vif-deleted-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:52 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:22:52 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:22:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:52 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Deleted allocations for instance fdccf817-4784-472a-85d1-96b5cc37722c
Oct 20 02:22:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bc8a34e2-5cd5-41a7-82c4-b5d86d9c40dd tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "fdccf817-4784-472a-85d1-96b5cc37722c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.893s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:52 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:22:53 user nova-compute[74242]: DEBUG nova.compute.manager [req-c0e9194e-8f9e-4ba8-aac8-34bfa28047a9 req-87fbc035-d49c-4c9a-9f2e-9d2680f0d32c service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received event network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:22:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c0e9194e-8f9e-4ba8-aac8-34bfa28047a9 req-87fbc035-d49c-4c9a-9f2e-9d2680f0d32c service nova] Acquiring lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:22:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c0e9194e-8f9e-4ba8-aac8-34bfa28047a9 req-87fbc035-d49c-4c9a-9f2e-9d2680f0d32c service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:22:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c0e9194e-8f9e-4ba8-aac8-34bfa28047a9 req-87fbc035-d49c-4c9a-9f2e-9d2680f0d32c service nova] Lock "fdccf817-4784-472a-85d1-96b5cc37722c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:22:53 user nova-compute[74242]: DEBUG nova.compute.manager [req-c0e9194e-8f9e-4ba8-aac8-34bfa28047a9 req-87fbc035-d49c-4c9a-9f2e-9d2680f0d32c service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] No waiting events found dispatching network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:22:53 user nova-compute[74242]: WARNING nova.compute.manager [req-c0e9194e-8f9e-4ba8-aac8-34bfa28047a9 req-87fbc035-d49c-4c9a-9f2e-9d2680f0d32c service nova] [instance: fdccf817-4784-472a-85d1-96b5cc37722c] Received unexpected event network-vif-plugged-006062cf-dcc6-4756-a074-1bf376c16abf for instance with vm_state deleted and task_state None.
Oct 20 02:22:56 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:22:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:00 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 is timed out.
Oct 20 02:23:00 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Successfully detached device vdb from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the live domain config.
Oct 20 02:23:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GHEeAnUC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:23:00 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d95a598-d744-4680-8957-25acd0a59e1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:23:00 user nova-compute[74242]: No targets found.
Oct 20 02:23:00 user nova-compute[74242]: iSNS:
Oct 20 02:23:00 user nova-compute[74242]: No targets found.
Oct 20 02:23:00 user nova-compute[74242]: STATIC:
Oct 20 02:23:00 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298
Oct 20 02:23:00 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:23:00 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:23:00 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:23:00 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:23:00 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:23:00 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155
Oct 20 02:23:00 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:23:00 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:23:00 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d
Oct 20 02:23:00 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:23:00 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:23:00 user nova-compute[74242]: FIRMWARE:
Oct 20 02:23:00 user nova-compute[74242]: No targets found.
Oct 20 02:23:00 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:23:00 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:23:00 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9047e257-24c4-488f-bf4e-fd26196f2bff]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be86490-803c-48ee-8540-6fde97b76edd]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:23:00 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:23:00 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:23:00 user nova-compute[74242]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 (non-flash)
Oct 20 02:23:00 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:23:00 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:23:00 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:23:00 user nova-compute[74242]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 (non-flash)
Oct 20 02:23:00 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8dbf55480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298'): ({'sde'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Removing single pathed devices sde {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5da4a13-4c53-4cca-a1f3-270dedb784de]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[19193b0d-e085-4f10-a373-a9b9e2504c70]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Flushing IO for device /dev/sde {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dac8e239-a18f-40e4-b6b6-e3b3e19bff22]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.057s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cadfc2-9855-4138-a1cd-bbb29ce8537e]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa0fd33-6e10-4431-96b9-912d98346997]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0925b2bc-0607-4f2f-8b36-701237d625c5]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298, portal: 172.16.0.220,3260]
Oct 20 02:23:00 user nova-compute[74242]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298, portal: 172.16.0.220,3260] successful.
Oct 20 02:23:00 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:010f709e-1642-4e87-a8f3-f7e3dd473298 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f58f72-20dc-4764-b6ad-e38949d0f627]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] <== disconnect_volume: return (317ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:23:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:23:01 user nova-compute[74242]: DEBUG nova.objects.instance [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lazy-loading 'flavor' on Instance uuid 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:23:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-08f9fd1b-8a2e-43a7-a95c-4cd4c11759c4 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.830s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:23:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:23:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:23:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:23:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:23:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:23:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:21 user nova-compute[74242]: INFO nova.compute.manager [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Rescuing
Oct 20 02:23:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "refresh_cache-74295e5c-237c-4992-a21a-6f59fd6ff246" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:23:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquired lock "refresh_cache-74295e5c-237c-4992-a21a-6f59fd6ff246" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:23:21 user nova-compute[74242]: DEBUG nova.network.neutron [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:23:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:23:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:23:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:23:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:23:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG nova.network.neutron [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Updating instance_info_cache with network_info: [{"id": "6a09ec72-a9d4-49cf-8089-04b50109b631", "address": "fa:16:3e:cd:60:bc", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a09ec72-a9", "ovs_interfaceid": "6a09ec72-a9d4-49cf-8089-04b50109b631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Releasing lock "refresh_cache-74295e5c-237c-4992-a21a-6f59fd6ff246" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG nova.compute.manager [req-00336e4b-89e8-4d7a-8752-01509c37f66b req-093a2ed3-bd09-4b03-b276-2cfa64800506 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received event network-vif-unplugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-00336e4b-89e8-4d7a-8752-01509c37f66b req-093a2ed3-bd09-4b03-b276-2cfa64800506 service nova] Acquiring lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-00336e4b-89e8-4d7a-8752-01509c37f66b req-093a2ed3-bd09-4b03-b276-2cfa64800506 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-00336e4b-89e8-4d7a-8752-01509c37f66b req-093a2ed3-bd09-4b03-b276-2cfa64800506 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG nova.compute.manager [req-00336e4b-89e8-4d7a-8752-01509c37f66b req-093a2ed3-bd09-4b03-b276-2cfa64800506 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] No waiting events found dispatching network-vif-unplugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:23:22 user nova-compute[74242]: WARNING nova.compute.manager [req-00336e4b-89e8-4d7a-8752-01509c37f66b req-093a2ed3-bd09-4b03-b276-2cfa64800506 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received unexpected event network-vif-unplugged-6a09ec72-a9d4-49cf-8089-04b50109b631 for instance with vm_state active and task_state rescuing.
Oct 20 02:23:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:22 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Instance destroyed successfully.
Oct 20 02:23:22 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Attempting a stable device rescue
Oct 20 02:23:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74242) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Instance directory exists: not creating {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 02:23:22 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Creating image(s)
Oct 20 02:23:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "/opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "/opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "/opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG nova.objects.instance [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'trusted_certs' on Instance uuid 74295e5c-237c-4992-a21a-6f59fd6ff246 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd.part --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd.part --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:24 user nova-compute[74242]: DEBUG nova.virt.images [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] 770390e3-1a1c-43ec-a4b8-76df697aee1e was qcow2, converting to raw {{(pid=74242) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 02:23:24 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:23:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd.part /opt/stack/data/nova/instances/_base/0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd.converted {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-0b0b00af-b4f2-4ed3-a11a-b821fba2241b req-60b26cba-3b83-4b28-b1ef-6ce697b12c90 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0b0b00af-b4f2-4ed3-a11a-b821fba2241b req-60b26cba-3b83-4b28-b1ef-6ce697b12c90 service nova] Acquiring lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0b0b00af-b4f2-4ed3-a11a-b821fba2241b req-60b26cba-3b83-4b28-b1ef-6ce697b12c90 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0b0b00af-b4f2-4ed3-a11a-b821fba2241b req-60b26cba-3b83-4b28-b1ef-6ce697b12c90 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-0b0b00af-b4f2-4ed3-a11a-b821fba2241b req-60b26cba-3b83-4b28-b1ef-6ce697b12c90 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] No waiting events found dispatching network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:23:24 user nova-compute[74242]: WARNING nova.compute.manager [req-0b0b00af-b4f2-4ed3-a11a-b821fba2241b req-60b26cba-3b83-4b28-b1ef-6ce697b12c90 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received unexpected event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 for instance with vm_state active and task_state rescuing.
Oct 20 02:23:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd.part /opt/stack/data/nova/instances/_base/0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd.converted" returned: 0 in 0.556s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd.converted --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.065s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd,backing_fmt=raw /opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/disk.rescue {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd,backing_fmt=raw /opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/disk.rescue" returned: 0 in 0.050s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.objects.instance [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'migration_context' on Instance uuid 74295e5c-237c-4992-a21a-6f59fd6ff246 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.objects.base [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Object Instance<74295e5c-237c-4992-a21a-6f59fd6ff246> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Start _get_guest_xml network_info=[{"id": "6a09ec72-a9d4-49cf-8089-04b50109b631", "address": "fa:16:3e:cd:60:bc", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "vif_mac": "fa:16:3e:cd:60:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a09ec72-a9", "ovs_interfaceid": "6a09ec72-a9d4-49cf-8089-04b50109b631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '770390e3-1a1c-43ec-a4b8-76df697aee1e', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '76467e6c-ebe2-46d2-ad26-f808f7e34ddf', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWdrhBnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '74295e5c-237c-4992-a21a-6f59fd6ff246', 'attached_at': '', 'detached_at': '', 'volume_id': '3cc7249d-0e6c-479b-8200-c51120c5734d', 'serial': '3cc7249d-0e6c-479b-8200-c51120c5734d'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.objects.instance [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'resources' on Instance uuid 74295e5c-237c-4992-a21a-6f59fd6ff246 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.objects.base [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Object Instance<74295e5c-237c-4992-a21a-6f59fd6ff246> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.objects.instance [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'numa_topology' on Instance uuid 74295e5c-237c-4992-a21a-6f59fd6ff246 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.objects.base [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Object Instance<74295e5c-237c-4992-a21a-6f59fd6ff246> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:23:25 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:23:25 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.objects.instance [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'vcpu_model' on Instance uuid 74295e5c-237c-4992-a21a-6f59fd6ff246 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.objects.base [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Object Instance<74295e5c-237c-4992-a21a-6f59fd6ff246> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWdrhBnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:23:25 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:23:25 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:23:25 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a49a395-b2ec-4245-8208-1a403a5a8038]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = VWdrhBnZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 02:23:25 user nova-compute[74242]: node.name = iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d
Oct 20 02:23:25 user nova-compute[74242]: node.tpgt = -1
Oct 20 02:23:25 user nova-compute[74242]: node.startup = automatic
Oct 20 02:23:25 user nova-compute[74242]: node.leading_login = No
Oct 20 02:23:25 user nova-compute[74242]: iface.iscsi_ifacename = default
Oct 20 02:23:25 user nova-compute[74242]: iface.net_ifacename = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.ipaddress = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.prefix_len = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.hwaddress = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.transport_name = tcp
Oct 20 02:23:25 user nova-compute[74242]: iface.initiatorname = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.state = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.vlan_id = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.vlan_priority = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.vlan_state = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.iface_num = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.mtu = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.port = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.bootproto = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.subnet_mask = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.gateway = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.dhcp_alt_client_id = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.dhcp_dns = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.dhcp_learn_iqn = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.dhcp_vendor_id_state = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.dhcp_vendor_id = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.dhcp_slp_da = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.fragmentation = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.gratuitous_arp = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.incoming_forwarding = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.tos_state = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.tos = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.ttl = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.delayed_ack = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.tcp_nagle = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.tcp_wsf_state = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.tcp_wsf = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.tcp_timer_scale = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.tcp_timestamp = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.redirect = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.def_task_mgmt_timeout = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.header_digest = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.data_digest = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.immediate_data = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.initial_r2t = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.data_seq_inorder = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.data_pdu_inorder = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.erl = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.max_receive_data_len = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.first_burst_len = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.max_outstanding_r2t = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.max_burst_len = 0
Oct 20 02:23:25 user nova-compute[74242]: iface.chap_auth = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.bidi_chap = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.strict_login_compliance = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.discovery_auth = <empty>
Oct 20 02:23:25 user nova-compute[74242]: iface.discovery_logout = <empty>
Oct 20 02:23:25 user nova-compute[74242]: node.discovery_address = <empty>
Oct 20 02:23:25 user nova-compute[74242]: node.discovery_port = 0
Oct 20 02:23:25 user nova-compute[74242]: node.discovery_type = static
Oct 20 02:23:25 user nova-compute[74242]: node.session.initial_cmdsn = 0
Oct 20 02:23:25 user nova-compute[74242]: node.session.initial_login_retry_max = 8
Oct 20 02:23:25 user nova-compute[74242]: node.session.xmit_thread_priority = -20
Oct 20 02:23:25 user nova-compute[74242]: node.session.cmds_max = 128
Oct 20 02:23:25 user nova-compute[74242]: node.session.queue_depth = 32
Oct 20 02:23:25 user nova-compute[74242]: node.session.nr_sessions = 1
Oct 20 02:23:25 user nova-compute[74242]: node.session.auth.authmethod = CHAP
Oct 20 02:23:25 user nova-compute[74242]: node.session.auth.username = VWdrhBnZ
Oct 20 02:23:25 user nova-compute[74242]: node.session.auth.password = ***
Oct 20 02:23:25 user nova-compute[74242]: node.session.auth.username_in = <empty>
Oct 20 02:23:25 user nova-compute[74242]: node.session.auth.password_in = <empty>
Oct 20 02:23:25 user nova-compute[74242]: node.session.auth.chap_algs = MD5
Oct 20 02:23:25 user nova-compute[74242]: node.session.timeo.replacement_timeout = 120
Oct 20 02:23:25 user nova-compute[74242]: node.session.err_timeo.abort_timeout = 15
Oct 20 02:23:25 user nova-compute[74242]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 02:23:25 user nova-compute[74242]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 02:23:25 user nova-compute[74242]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 02:23:25 user nova-compute[74242]: node.session.iscsi.FastAbort = Yes
Oct 20 02:23:25 user nova-compute[74242]: node.session.iscsi.InitialR2T = No
Oct 20 02:23:25 user nova-compute[74242]: node.session.iscsi.ImmediateData = Yes
Oct 20 02:23:25 user nova-compute[74242]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 02:23:25 user nova-compute[74242]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 02:23:25 user nova-compute[74242]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 02:23:25 user nova-compute[74242]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 02:23:25 user nova-compute[74242]: node.session.iscsi.MaxConnections = 1
Oct 20 02:23:25 user nova-compute[74242]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 02:23:25 user nova-compute[74242]: node.session.iscsi.ERL = 0
Oct 20 02:23:25 user nova-compute[74242]: node.session.scan = manual
Oct 20 02:23:25 user nova-compute[74242]: node.session.reopen_max = 0
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].address = 172.16.0.220
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].port = 3260
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].startup = manual
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].tcp.window_size = 524288
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].tcp.type_of_service = 0
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].timeo.logout_timeout = 15
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].timeo.login_timeout = 15
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].timeo.auth_timeout = 45
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].iscsi.DataDigest = None
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].iscsi.IFMarker = No
Oct 20 02:23:25 user nova-compute[74242]: node.conn[0].iscsi.OFMarker = No
Oct 20 02:23:25 user nova-compute[74242]: # END RECORD
Oct 20 02:23:25 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c476fd18-6e78-46b1-9c69-4c66b63b9554]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7655d1e1-50fa-433d-8700-d2afe92645d0]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VWdrhBnZ {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VWdrhBnZ" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[53a05013-74cf-4961-a5a4-783b4a992ac7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VWdrhBnZ'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5923cee7-88cd-410f-b039-6d58ef7a6be2]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e784223-1244-4a07-a1fe-a4cfc984d640]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:23:25 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:23:25 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:23:25 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:23:25 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:23:25 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:23:25 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.143s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] HCTL ('33', '0', '0', 0) found on session 42 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffb73b7b-0720-4970-8482-8af95090bd72]: (4, ('0 0 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Searching for a device in session 42 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWdrhBnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.168s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] <== connect_volume: return (169ms) {'type': 'block', 'scsi_wwn': '23031343038396331', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23031343038396331', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:21:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1378661490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1378661490',id=35,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:22:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112fda62d355421e80e674dc18bb5069',ramdisk_id='',reservation_id='r-sg6r9ymm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:22:16Z,user_data=None,user_id='9ac628a224fb4653932a27e33aa33c9d',uuid=74295e5c-237c-4992-a21a-6f59fd6ff246,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a09ec72-a9d4-49cf-8089-04b50109b631", "address": "fa:16:3e:cd:60:bc", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "vif_mac": "fa:16:3e:cd:60:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a09ec72-a9", "ovs_interfaceid": "6a09ec72-a9d4-49cf-8089-04b50109b631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converting VIF {"id": "6a09ec72-a9d4-49cf-8089-04b50109b631", "address": "fa:16:3e:cd:60:bc", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "vif_mac": "fa:16:3e:cd:60:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a09ec72-a9", "ovs_interfaceid": "6a09ec72-a9d4-49cf-8089-04b50109b631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:60:bc,bridge_name='br-int',has_traffic_filtering=True,id=6a09ec72-a9d4-49cf-8089-04b50109b631,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a09ec72-a9') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.objects.instance [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'pci_devices' on Instance uuid 74295e5c-237c-4992-a21a-6f59fd6ff246 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.objects.base [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Object Instance<74295e5c-237c-4992-a21a-6f59fd6ff246> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:23:25 user nova-compute[74242]:   <uuid>74295e5c-237c-4992-a21a-6f59fd6ff246</uuid>
Oct 20 02:23:25 user nova-compute[74242]:   <name>instance-00000023</name>
Oct 20 02:23:25 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:23:25 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:23:25 user nova-compute[74242]:   <metadata>
Oct 20 02:23:25 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:23:25 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:23:25 user nova-compute[74242]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1378661490</nova:name>
Oct 20 02:23:25 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:23:25</nova:creationTime>
Oct 20 02:23:25 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:23:25 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:23:25 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:23:25 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:23:25 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:23:25 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:23:25 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:23:25 user nova-compute[74242]:       <nova:owner>
Oct 20 02:23:25 user nova-compute[74242]:         <nova:user uuid="9ac628a224fb4653932a27e33aa33c9d">tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member</nova:user>
Oct 20 02:23:25 user nova-compute[74242]:         <nova:project uuid="112fda62d355421e80e674dc18bb5069">tempest-ServerBootFromVolumeStableRescueTest-1661425956</nova:project>
Oct 20 02:23:25 user nova-compute[74242]:       </nova:owner>
Oct 20 02:23:25 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:23:25 user nova-compute[74242]:       <nova:ports>
Oct 20 02:23:25 user nova-compute[74242]:         <nova:port uuid="6a09ec72-a9d4-49cf-8089-04b50109b631">
Oct 20 02:23:25 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 02:23:25 user nova-compute[74242]:         </nova:port>
Oct 20 02:23:25 user nova-compute[74242]:       </nova:ports>
Oct 20 02:23:25 user nova-compute[74242]:     </nova:instance>
Oct 20 02:23:25 user nova-compute[74242]:   </metadata>
Oct 20 02:23:25 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:23:25 user nova-compute[74242]:     <system>
Oct 20 02:23:25 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:23:25 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:23:25 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:23:25 user nova-compute[74242]:       <entry name="serial">74295e5c-237c-4992-a21a-6f59fd6ff246</entry>
Oct 20 02:23:25 user nova-compute[74242]:       <entry name="uuid">74295e5c-237c-4992-a21a-6f59fd6ff246</entry>
Oct 20 02:23:25 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:23:25 user nova-compute[74242]:     </system>
Oct 20 02:23:25 user nova-compute[74242]:   </sysinfo>
Oct 20 02:23:25 user nova-compute[74242]:   <os>
Oct 20 02:23:25 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:23:25 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:23:25 user nova-compute[74242]:   </os>
Oct 20 02:23:25 user nova-compute[74242]:   <features>
Oct 20 02:23:25 user nova-compute[74242]:     <acpi/>
Oct 20 02:23:25 user nova-compute[74242]:     <apic/>
Oct 20 02:23:25 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:23:25 user nova-compute[74242]:   </features>
Oct 20 02:23:25 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:23:25 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:23:25 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:23:25 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:23:25 user nova-compute[74242]:   </clock>
Oct 20 02:23:25 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:23:25 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:23:25 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:23:25 user nova-compute[74242]:   </cpu>
Oct 20 02:23:25 user nova-compute[74242]:   <devices>
Oct 20 02:23:25 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:23:25 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:23:25 user nova-compute[74242]:       <source dev="/dev/sdb"/>
Oct 20 02:23:25 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:23:25 user nova-compute[74242]:       <serial>3cc7249d-0e6c-479b-8200-c51120c5734d</serial>
Oct 20 02:23:25 user nova-compute[74242]:     </disk>
Oct 20 02:23:25 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:23:25 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:23:25 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/disk.rescue"/>
Oct 20 02:23:25 user nova-compute[74242]:       <target dev="vdb" bus="virtio"/>
Oct 20 02:23:25 user nova-compute[74242]:       <boot order="1"/>
Oct 20 02:23:25 user nova-compute[74242]:     </disk>
Oct 20 02:23:25 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:23:25 user nova-compute[74242]:       <mac address="fa:16:3e:cd:60:bc"/>
Oct 20 02:23:25 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:23:25 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:23:25 user nova-compute[74242]:       <target dev="tap6a09ec72-a9"/>
Oct 20 02:23:25 user nova-compute[74242]:     </interface>
Oct 20 02:23:25 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:23:25 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/console.log" append="off"/>
Oct 20 02:23:25 user nova-compute[74242]:     </serial>
Oct 20 02:23:25 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:23:25 user nova-compute[74242]:     <video>
Oct 20 02:23:25 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:23:25 user nova-compute[74242]:     </video>
Oct 20 02:23:25 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:23:25 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:23:25 user nova-compute[74242]:     </rng>
Oct 20 02:23:25 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:23:25 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:23:25 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:23:25 user nova-compute[74242]:     </memballoon>
Oct 20 02:23:25 user nova-compute[74242]:   </devices>
Oct 20 02:23:25 user nova-compute[74242]: </domain>
Oct 20 02:23:25 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:23:25 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Instance destroyed successfully.
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:23:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] No VIF found with MAC fa:16:3e:cd:60:bc, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:23:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-045069d5-15a8-4ba7-b35b-7147e6de1eb5 req-9b5c59dd-9721-4b63-be46-5bbf80fe60c9 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-045069d5-15a8-4ba7-b35b-7147e6de1eb5 req-9b5c59dd-9721-4b63-be46-5bbf80fe60c9 service nova] Acquiring lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-045069d5-15a8-4ba7-b35b-7147e6de1eb5 req-9b5c59dd-9721-4b63-be46-5bbf80fe60c9 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-045069d5-15a8-4ba7-b35b-7147e6de1eb5 req-9b5c59dd-9721-4b63-be46-5bbf80fe60c9 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-045069d5-15a8-4ba7-b35b-7147e6de1eb5 req-9b5c59dd-9721-4b63-be46-5bbf80fe60c9 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] No waiting events found dispatching network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:23:27 user nova-compute[74242]: WARNING nova.compute.manager [req-045069d5-15a8-4ba7-b35b-7147e6de1eb5 req-9b5c59dd-9721-4b63-be46-5bbf80fe60c9 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received unexpected event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 for instance with vm_state active and task_state rescuing.
Oct 20 02:23:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-218781ce-722b-4826-bc8a-423f3798113a req-11e3a838-4735-462b-9fb0-f98e12a1e8eb service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-218781ce-722b-4826-bc8a-423f3798113a req-11e3a838-4735-462b-9fb0-f98e12a1e8eb service nova] Acquiring lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-218781ce-722b-4826-bc8a-423f3798113a req-11e3a838-4735-462b-9fb0-f98e12a1e8eb service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-218781ce-722b-4826-bc8a-423f3798113a req-11e3a838-4735-462b-9fb0-f98e12a1e8eb service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-218781ce-722b-4826-bc8a-423f3798113a req-11e3a838-4735-462b-9fb0-f98e12a1e8eb service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] No waiting events found dispatching network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:23:29 user nova-compute[74242]: WARNING nova.compute.manager [req-218781ce-722b-4826-bc8a-423f3798113a req-11e3a838-4735-462b-9fb0-f98e12a1e8eb service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received unexpected event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 for instance with vm_state active and task_state rescuing.
Oct 20 02:23:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-d3bb393b-a78b-434f-8087-811464ac3779 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:23:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-27e0489b-676c-4514-b9e8-e7dc8c1436e7 req-2f417897-2197-4938-b117-d1084e4e9e60 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Received event network-changed-6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-27e0489b-676c-4514-b9e8-e7dc8c1436e7 req-2f417897-2197-4938-b117-d1084e4e9e60 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Refreshing instance network info cache due to event network-changed-6d6d2672-e110-4684-8590-a816a23e680a. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:23:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-27e0489b-676c-4514-b9e8-e7dc8c1436e7 req-2f417897-2197-4938-b117-d1084e4e9e60 service nova] Acquiring lock "refresh_cache-531961c2-d07a-4edc-8714-16ff1fa1a925" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:23:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-27e0489b-676c-4514-b9e8-e7dc8c1436e7 req-2f417897-2197-4938-b117-d1084e4e9e60 service nova] Acquired lock "refresh_cache-531961c2-d07a-4edc-8714-16ff1fa1a925" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:23:38 user nova-compute[74242]: DEBUG nova.network.neutron [req-27e0489b-676c-4514-b9e8-e7dc8c1436e7 req-2f417897-2197-4938-b117-d1084e4e9e60 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Refreshing network info cache for port 6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:23:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "531961c2-d07a-4edc-8714-16ff1fa1a925" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "531961c2-d07a-4edc-8714-16ff1fa1a925-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:38 user nova-compute[74242]: INFO nova.compute.manager [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Terminating instance
Oct 20 02:23:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:23:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.network.neutron [req-27e0489b-676c-4514-b9e8-e7dc8c1436e7 req-2f417897-2197-4938-b117-d1084e4e9e60 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Updated VIF entry in instance network info cache for port 6d6d2672-e110-4684-8590-a816a23e680a. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.network.neutron [req-27e0489b-676c-4514-b9e8-e7dc8c1436e7 req-2f417897-2197-4938-b117-d1084e4e9e60 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Updating instance_info_cache with network_info: [{"id": "6d6d2672-e110-4684-8590-a816a23e680a", "address": "fa:16:3e:4f:95:67", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d2672-e1", "ovs_interfaceid": "6d6d2672-e110-4684-8590-a816a23e680a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-a5c5602f-a9a3-42f3-bfac-d88755dd593d req-3e544699-cb4a-4f8b-8685-fef0dfbca62c service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Received event network-vif-unplugged-6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a5c5602f-a9a3-42f3-bfac-d88755dd593d req-3e544699-cb4a-4f8b-8685-fef0dfbca62c service nova] Acquiring lock "531961c2-d07a-4edc-8714-16ff1fa1a925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a5c5602f-a9a3-42f3-bfac-d88755dd593d req-3e544699-cb4a-4f8b-8685-fef0dfbca62c service nova] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a5c5602f-a9a3-42f3-bfac-d88755dd593d req-3e544699-cb4a-4f8b-8685-fef0dfbca62c service nova] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-a5c5602f-a9a3-42f3-bfac-d88755dd593d req-3e544699-cb4a-4f8b-8685-fef0dfbca62c service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] No waiting events found dispatching network-vif-unplugged-6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-a5c5602f-a9a3-42f3-bfac-d88755dd593d req-3e544699-cb4a-4f8b-8685-fef0dfbca62c service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Received event network-vif-unplugged-6d6d2672-e110-4684-8590-a816a23e680a for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:23:39 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Instance destroyed successfully.
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.objects.instance [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lazy-loading 'resources' on Instance uuid 531961c2-d07a-4edc-8714-16ff1fa1a925 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-27e0489b-676c-4514-b9e8-e7dc8c1436e7 req-2f417897-2197-4938-b117-d1084e4e9e60 service nova] Releasing lock "refresh_cache-531961c2-d07a-4edc-8714-16ff1fa1a925" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:17:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1527036357',display_name='tempest-TestVolumeBootPattern-server-1527036357',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1527036357',id=31,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMYHgQrnRlQ4jBKzblQ3DfxaEfVjuxo/NC6O+ICak+0aaFoFY7UzIhNxrdgQLtBAfBOsL0Lu2xLtyVpinmCCfqmljj/P6GdvFSKRfnZG4N6/Y2tUqR86uaxeDlehlPmATw==',key_name='tempest-TestVolumeBootPattern-887907135',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:17:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e137c75824d7429585ddd2245f86a6d0',ramdisk_id='',reservation_id='r-0caltrux',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-882774340',owner_user_name='tempest-TestVolumeBootPattern-882774340-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:17:50Z,user_data=None,user_id='00ea297f598040fbb338b9ab2e1a1d3a',uuid=531961c2-d07a-4edc-8714-16ff1fa1a925,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d6d2672-e110-4684-8590-a816a23e680a", "address": "fa:16:3e:4f:95:67", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d2672-e1", "ovs_interfaceid": "6d6d2672-e110-4684-8590-a816a23e680a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converting VIF {"id": "6d6d2672-e110-4684-8590-a816a23e680a", "address": "fa:16:3e:4f:95:67", "network": {"id": "74a0b4a3-1830-447c-a861-ebba145f2597", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1917044268-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.106", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e137c75824d7429585ddd2245f86a6d0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d6d2672-e1", "ovs_interfaceid": "6d6d2672-e110-4684-8590-a816a23e680a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:95:67,bridge_name='br-int',has_traffic_filtering=True,id=6d6d2672-e110-4684-8590-a816a23e680a,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6d2672-e1') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_vif [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:95:67,bridge_name='br-int',has_traffic_filtering=True,id=6d6d2672-e110-4684-8590-a816a23e680a,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6d2672-e1') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d6d2672-e1, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3cc508cb-bee2-4194-9ba5-9fd2842f28c4) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:39 user nova-compute[74242]: INFO os_vif [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:95:67,bridge_name='br-int',has_traffic_filtering=True,id=6d6d2672-e110-4684-8590-a816a23e680a,network=Network(74a0b4a3-1830-447c-a861-ebba145f2597),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d6d2672-e1')
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WlohPgye', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:23:39 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4643aa91-d856-48bb-a096-f053e8578b65]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:23:39 user nova-compute[74242]: No targets found.
Oct 20 02:23:39 user nova-compute[74242]: iSNS:
Oct 20 02:23:39 user nova-compute[74242]: No targets found.
Oct 20 02:23:39 user nova-compute[74242]: STATIC:
Oct 20 02:23:39 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:23:39 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:23:39 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:23:39 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155
Oct 20 02:23:39 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:23:39 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:23:39 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d
Oct 20 02:23:39 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:23:39 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:23:39 user nova-compute[74242]: FIRMWARE:
Oct 20 02:23:39 user nova-compute[74242]: No targets found.
Oct 20 02:23:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:23:39 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:23:39 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.057s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0762f7b0-92a8-48de-a3d8-2e383ad9fcd5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-5f96c71b-c391-42bd-8ac8-53ece7b302f5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-5f96c71b-c391-42bd-8ac8-53ece7b302f5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e77863-e5f2-4c94-aac8-19d22de5d71f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:23:39 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:23:39 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:23:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:23:39 user nova-compute[74242]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 (non-flash)
Oct 20 02:23:39 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:23:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8946b68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155'): ({'sdd'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Removing single pathed devices sdd {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c06a64-8c20-4b2c-bb2e-509cfe5ca81c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d74351d6-f961-4d8d-9f5d-a95453636011]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Flushing IO for device /dev/sdd {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c87202-3e14-4e95-8bba-9d601d57d313]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28f75b3-d9fb-4b10-8f08-8eb876dedd67]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8e8660-e9b7-4ec0-abf3-79afe56cc936]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c259f0-0e99-4353-a374-cc406b0aca07]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260]
Oct 20 02:23:39 user nova-compute[74242]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155, portal: 172.16.0.220,3260] successful.
Oct 20 02:23:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:81a7b30b-0424-4656-b2f1-5fd1f6617155 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bb022ab-2bdb-4e5c-ba54-b6921c693a93]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.425s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] <== disconnect_volume: return (427ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:23:39 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Deleting instance files /opt/stack/data/nova/instances/531961c2-d07a-4edc-8714-16ff1fa1a925_del
Oct 20 02:23:39 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Deletion of /opt/stack/data/nova/instances/531961c2-d07a-4edc-8714-16ff1fa1a925_del complete
Oct 20 02:23:39 user nova-compute[74242]: INFO nova.compute.manager [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Took 1.46 seconds to destroy the instance on the hypervisor.
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Updating instance_info_cache with network_info: [{"id": "29619557-d774-41f6-9094-cfce655bcd27", "address": "fa:16:3e:6b:ed:0a", "network": {"id": "694ee4ba-c5b8-4c34-a5c3-1bb34288136f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1990549718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3a254f1387b4b929f5396d1db6c4ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29619557-d7", "ovs_interfaceid": "29619557-d774-41f6-9094-cfce655bcd27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-5f96c71b-c391-42bd-8ac8-53ece7b302f5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:23:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:23:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:40 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:23:40 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Took 1.05 seconds to deallocate network for instance.
Oct 20 02:23:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-4a0df32c-428a-45c4-a168-05e402f7318e req-e6feafdf-e25d-49ce-9ba7-ea90cc068fd9 service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Received event network-vif-deleted-6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-19e31744-0f9c-4c27-8bff-0c330cd6d745 req-d498bedb-a9ca-4014-a46a-4686ff7a6e4f service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Received event network-vif-plugged-6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-19e31744-0f9c-4c27-8bff-0c330cd6d745 req-d498bedb-a9ca-4014-a46a-4686ff7a6e4f service nova] Acquiring lock "531961c2-d07a-4edc-8714-16ff1fa1a925-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-19e31744-0f9c-4c27-8bff-0c330cd6d745 req-d498bedb-a9ca-4014-a46a-4686ff7a6e4f service nova] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-19e31744-0f9c-4c27-8bff-0c330cd6d745 req-d498bedb-a9ca-4014-a46a-4686ff7a6e4f service nova] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-19e31744-0f9c-4c27-8bff-0c330cd6d745 req-d498bedb-a9ca-4014-a46a-4686ff7a6e4f service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] No waiting events found dispatching network-vif-plugged-6d6d2672-e110-4684-8590-a816a23e680a {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:23:40 user nova-compute[74242]: WARNING nova.compute.manager [req-19e31744-0f9c-4c27-8bff-0c330cd6d745 req-d498bedb-a9ca-4014-a46a-4686ff7a6e4f service nova] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Received unexpected event network-vif-plugged-6d6d2672-e110-4684-8590-a816a23e680a for instance with vm_state active and task_state deleting.
Oct 20 02:23:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:42 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:23:43 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:23:43 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:23:43 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "2bf62933-66ea-469e-a70e-92184f311110" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:23:44 user nova-compute[74242]: INFO nova.compute.claims [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Claim successful on node user
Oct 20 02:23:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.462s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG nova.network.neutron [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:44 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:23:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG nova.policy [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7a7db373740428d89dcda898a04410c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fa40dfb2c84a84b3399b643fcde4c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:23:44 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Creating image(s)
Oct 20 02:23:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "/opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "/opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:44 user nova-compute[74242]: INFO nova.compute.manager [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] [instance: 531961c2-d07a-4edc-8714-16ff1fa1a925] Took 4.17 seconds to detach 1 volumes for instance.
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:23:45 user nova-compute[74242]: INFO nova.compute.claims [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Claim successful on node user
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.246s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG nova.network.neutron [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Successfully created port: 61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk 1073741824" returned: 0 in 0.098s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.702s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.648s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG nova.objects.instance [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lazy-loading 'flavor' on Instance uuid 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG nova.network.neutron [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:23:45 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Cannot resize image /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Ensure instance console log exists: /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:23:45 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Creating image(s)
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "/opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "/opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.policy [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7a7db373740428d89dcda898a04410c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fa40dfb2c84a84b3399b643fcde4c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:46 user nova-compute[74242]: INFO nova.compute.manager [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Attaching volume 0ebe89d1-e951-40dc-bc59-79359b3a3388 to /dev/vdb
Oct 20 02:23:46 user nova-compute[74242]: DEBUG os_brick.utils [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c9ee44-f844-47c0-92f9-6d17d8d34919]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.232s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[634344bc-21fc-406d-a3ae-6a3c15c7425c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8e1af8-4ff7-458a-aec8-6c39166e8a9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a0c53b-f62e-466c-870c-769308bcd298]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "cd90bd52-3af1-4d05-89df-2fedc535333f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.670s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:23:46 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[132f86a0-7022-4bae-9be1-7a02acb4f96c]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG os_brick.utils [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] <== get_connector_properties: return (222ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Updating existing volume attachment record: 8d10eda5-491d-45ad-a67f-6326d019df60 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.network.neutron [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Successfully updated port: 61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquired lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.network.neutron [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:23:46 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Deleted allocations for instance 531961c2-d07a-4edc-8714-16ff1fa1a925
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-7a0738f1-42f8-4eb2-8af1-3ece0277a310 req-1a1f1b64-53dd-43d2-94ed-1af1db96b923 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received event network-changed-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-7a0738f1-42f8-4eb2-8af1-3ece0277a310 req-1a1f1b64-53dd-43d2-94ed-1af1db96b923 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Refreshing instance network info cache due to event network-changed-61e204b4-d498-423a-8542-af401e188691. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7a0738f1-42f8-4eb2-8af1-3ece0277a310 req-1a1f1b64-53dd-43d2-94ed-1af1db96b923 service nova] Acquiring lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.256s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk 1073741824" returned: 0 in 0.054s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.325s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.network.neutron [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ed3740b6-b2a3-4b9f-b6f2-f8a9936da520 tempest-TestVolumeBootPattern-882774340 tempest-TestVolumeBootPattern-882774340-project-member] Lock "531961c2-d07a-4edc-8714-16ff1fa1a925" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 8.378s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:23:46 user nova-compute[74242]: INFO nova.compute.claims [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Claim successful on node user
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "5162fb94-7344-4193-98c8-c5f165309f60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "5162fb94-7344-4193-98c8-c5f165309f60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "5162fb94-7344-4193-98c8-c5f165309f60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "5162fb94-7344-4193-98c8-c5f165309f60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "5162fb94-7344-4193-98c8-c5f165309f60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:46 user nova-compute[74242]: INFO nova.compute.manager [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Terminating instance
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.232s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Refreshing inventories for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Updating ProviderTree inventory for provider 07b40460-b6ac-48c1-8447-e1778d50b26e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Updating inventory in ProviderTree for provider 07b40460-b6ac-48c1-8447-e1778d50b26e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 02:23:46 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Refreshing aggregate associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, aggregates: None {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Cannot resize image /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Ensure instance console log exists: /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Refreshing trait associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Successfully created port: 3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Updating instance_info_cache with network_info: [{"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Releasing lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Instance network_info: |[{"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7a0738f1-42f8-4eb2-8af1-3ece0277a310 req-1a1f1b64-53dd-43d2-94ed-1af1db96b923 service nova] Acquired lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.network.neutron [req-7a0738f1-42f8-4eb2-8af1-3ece0277a310 req-1a1f1b64-53dd-43d2-94ed-1af1db96b923 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Refreshing network info cache for port 61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Start _get_guest_xml network_info=[{"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:47 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:23:47 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1744055314',display_name='tempest-ServerRescueNegativeTestJSON-server-1744055314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1744055314',id=37,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80fa40dfb2c84a84b3399b643fcde4c5',ramdisk_id='',reservation_id='r-vlo89q17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-630282540',owner_user_name='tempest-ServerRescueNegativeTestJSON-630282540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:23:45Z,user_data=None,user_id='c7a7db373740428d89dcda898a04410c',uuid=2bf62933-66ea-469e-a70e-92184f311110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converting VIF {"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:d5:bc,bridge_name='br-int',has_traffic_filtering=True,id=61e204b4-d498-423a-8542-af401e188691,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e204b4-d4') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.objects.instance [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bf62933-66ea-469e-a70e-92184f311110 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:23:47 user nova-compute[74242]:   <uuid>2bf62933-66ea-469e-a70e-92184f311110</uuid>
Oct 20 02:23:47 user nova-compute[74242]:   <name>instance-00000025</name>
Oct 20 02:23:47 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:23:47 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:23:47 user nova-compute[74242]:   <metadata>
Oct 20 02:23:47 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:23:47 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:23:47 user nova-compute[74242]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1744055314</nova:name>
Oct 20 02:23:47 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:23:47</nova:creationTime>
Oct 20 02:23:47 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:23:47 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:23:47 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:23:47 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:23:47 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:23:47 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:23:47 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:23:47 user nova-compute[74242]:       <nova:owner>
Oct 20 02:23:47 user nova-compute[74242]:         <nova:user uuid="c7a7db373740428d89dcda898a04410c">tempest-ServerRescueNegativeTestJSON-630282540-project-member</nova:user>
Oct 20 02:23:47 user nova-compute[74242]:         <nova:project uuid="80fa40dfb2c84a84b3399b643fcde4c5">tempest-ServerRescueNegativeTestJSON-630282540</nova:project>
Oct 20 02:23:47 user nova-compute[74242]:       </nova:owner>
Oct 20 02:23:47 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:23:47 user nova-compute[74242]:       <nova:ports>
Oct 20 02:23:47 user nova-compute[74242]:         <nova:port uuid="61e204b4-d498-423a-8542-af401e188691">
Oct 20 02:23:47 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 02:23:47 user nova-compute[74242]:         </nova:port>
Oct 20 02:23:47 user nova-compute[74242]:       </nova:ports>
Oct 20 02:23:47 user nova-compute[74242]:     </nova:instance>
Oct 20 02:23:47 user nova-compute[74242]:   </metadata>
Oct 20 02:23:47 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:23:47 user nova-compute[74242]:     <system>
Oct 20 02:23:47 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:23:47 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:23:47 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:23:47 user nova-compute[74242]:       <entry name="serial">2bf62933-66ea-469e-a70e-92184f311110</entry>
Oct 20 02:23:47 user nova-compute[74242]:       <entry name="uuid">2bf62933-66ea-469e-a70e-92184f311110</entry>
Oct 20 02:23:47 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:23:47 user nova-compute[74242]:     </system>
Oct 20 02:23:47 user nova-compute[74242]:   </sysinfo>
Oct 20 02:23:47 user nova-compute[74242]:   <os>
Oct 20 02:23:47 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:23:47 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:23:47 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:23:47 user nova-compute[74242]:   </os>
Oct 20 02:23:47 user nova-compute[74242]:   <features>
Oct 20 02:23:47 user nova-compute[74242]:     <acpi/>
Oct 20 02:23:47 user nova-compute[74242]:     <apic/>
Oct 20 02:23:47 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:23:47 user nova-compute[74242]:   </features>
Oct 20 02:23:47 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:23:47 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:23:47 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:23:47 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:23:47 user nova-compute[74242]:   </clock>
Oct 20 02:23:47 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:23:47 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:23:47 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:23:47 user nova-compute[74242]:   </cpu>
Oct 20 02:23:47 user nova-compute[74242]:   <devices>
Oct 20 02:23:47 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:23:47 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:23:47 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk"/>
Oct 20 02:23:47 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:23:47 user nova-compute[74242]:     </disk>
Oct 20 02:23:47 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:23:47 user nova-compute[74242]:       <mac address="fa:16:3e:03:d5:bc"/>
Oct 20 02:23:47 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:23:47 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:23:47 user nova-compute[74242]:       <target dev="tap61e204b4-d4"/>
Oct 20 02:23:47 user nova-compute[74242]:     </interface>
Oct 20 02:23:47 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:23:47 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/console.log" append="off"/>
Oct 20 02:23:47 user nova-compute[74242]:     </serial>
Oct 20 02:23:47 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:23:47 user nova-compute[74242]:     <video>
Oct 20 02:23:47 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:23:47 user nova-compute[74242]:     </video>
Oct 20 02:23:47 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:23:47 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:23:47 user nova-compute[74242]:     </rng>
Oct 20 02:23:47 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:23:47 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:23:47 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:23:47 user nova-compute[74242]:     </memballoon>
Oct 20 02:23:47 user nova-compute[74242]:   </devices>
Oct 20 02:23:47 user nova-compute[74242]: </domain>
Oct 20 02:23:47 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1744055314',display_name='tempest-ServerRescueNegativeTestJSON-server-1744055314',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1744055314',id=37,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80fa40dfb2c84a84b3399b643fcde4c5',ramdisk_id='',reservation_id='r-vlo89q17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-630282540',owner_user_name='tempest-ServerRescueNegativeTestJSON-630282540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:23:45Z,user_data=None,user_id='c7a7db373740428d89dcda898a04410c',uuid=2bf62933-66ea-469e-a70e-92184f311110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converting VIF {"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:03:d5:bc,bridge_name='br-int',has_traffic_filtering=True,id=61e204b4-d498-423a-8542-af401e188691,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e204b4-d4') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG os_vif [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:d5:bc,bridge_name='br-int',has_traffic_filtering=True,id=61e204b4-d498-423a-8542-af401e188691,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e204b4-d4') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b6fc03db-aa15-53cf-9ec3-bc4348f64ae5', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap61e204b4-d4, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap61e204b4-d4, col_values=(('qos', UUID('3389489e-ee0a-4130-a807-6e3caba35969')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap61e204b4-d4, col_values=(('external_ids', {'iface-id': '61e204b4-d498-423a-8542-af401e188691', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:03:d5:bc', 'vm-uuid': '2bf62933-66ea-469e-a70e-92184f311110'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:47 user nova-compute[74242]: INFO os_vif [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:03:d5:bc,bridge_name='br-int',has_traffic_filtering=True,id=61e204b4-d498-423a-8542-af401e188691,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e204b4-d4')
Oct 20 02:23:47 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Instance destroyed successfully.
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.objects.instance [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lazy-loading 'resources' on Instance uuid 5162fb94-7344-4193-98c8-c5f165309f60 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:21:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-714280863',display_name='tempest-VolumesActionsTest-instance-714280863',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-714280863',id=36,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:22:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f4b7d7e4e314e7aa95f8ceb39a0dc95',ramdisk_id='',reservation_id='r-ao8rgmu0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-537401295',owner_user_name='tempest-VolumesActionsTest-537401295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:22:02Z,user_data=None,user_id='29cd6130817e4b588ce838dd958b5fd1',uuid=5162fb94-7344-4193-98c8-c5f165309f60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "address": "fa:16:3e:c5:ef:fd", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d3c10c-23", "ovs_interfaceid": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Converting VIF {"id": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "address": "fa:16:3e:c5:ef:fd", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98d3c10c-23", "ovs_interfaceid": "98d3c10c-2360-41e7-ae7f-9b7657a7326b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:ef:fd,bridge_name='br-int',has_traffic_filtering=True,id=98d3c10c-2360-41e7-ae7f-9b7657a7326b,network=Network(d67e0969-7ca5-47d9-b6c9-68558277b293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d3c10c-23') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG os_vif [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:ef:fd,bridge_name='br-int',has_traffic_filtering=True,id=98d3c10c-2360-41e7-ae7f-9b7657a7326b,network=Network(d67e0969-7ca5-47d9-b6c9-68558277b293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d3c10c-23') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98d3c10c-23, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7d151b91-d80f-4577-80ea-c64cd94c9c41) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No VIF found with MAC fa:16:3e:03:d5:bc, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:47 user nova-compute[74242]: INFO os_vif [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:ef:fd,bridge_name='br-int',has_traffic_filtering=True,id=98d3c10c-2360-41e7-ae7f-9b7657a7326b,network=Network(d67e0969-7ca5-47d9-b6c9-68558277b293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98d3c10c-23')
Oct 20 02:23:47 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Deleting instance files /opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60_del
Oct 20 02:23:47 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Deletion of /opt/stack/data/nova/instances/5162fb94-7344-4193-98c8-c5f165309f60_del complete
Oct 20 02:23:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.024s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.350s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:23:47 user nova-compute[74242]: INFO nova.compute.manager [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Took 1.13 seconds to destroy the instance on the hypervisor.
Oct 20 02:23:47 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:23:47 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:23:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:23:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Creating image(s)
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "/opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "/opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "/opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "b1aa7131b38ea7a2d0a654bdf762566b17d13141" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "b1aa7131b38ea7a2d0a654bdf762566b17d13141" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-e5a6070e-327c-4597-89d8-a3ddca91f131 req-1a0f3914-d5e1-4de0-b32f-4267dd70d3d9 service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Received event network-vif-unplugged-98d3c10c-2360-41e7-ae7f-9b7657a7326b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e5a6070e-327c-4597-89d8-a3ddca91f131 req-1a0f3914-d5e1-4de0-b32f-4267dd70d3d9 service nova] Acquiring lock "5162fb94-7344-4193-98c8-c5f165309f60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e5a6070e-327c-4597-89d8-a3ddca91f131 req-1a0f3914-d5e1-4de0-b32f-4267dd70d3d9 service nova] Lock "5162fb94-7344-4193-98c8-c5f165309f60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e5a6070e-327c-4597-89d8-a3ddca91f131 req-1a0f3914-d5e1-4de0-b32f-4267dd70d3d9 service nova] Lock "5162fb94-7344-4193-98c8-c5f165309f60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-e5a6070e-327c-4597-89d8-a3ddca91f131 req-1a0f3914-d5e1-4de0-b32f-4267dd70d3d9 service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] No waiting events found dispatching network-vif-unplugged-98d3c10c-2360-41e7-ae7f-9b7657a7326b {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-e5a6070e-327c-4597-89d8-a3ddca91f131 req-1a0f3914-d5e1-4de0-b32f-4267dd70d3d9 service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Received event network-vif-unplugged-98d3c10c-2360-41e7-ae7f-9b7657a7326b for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.policy [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b64ecd6426f429ba929925fca497c82', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7331dc1aa6464021bb371a8ebcf3a42b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141.part --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.network.neutron [req-7a0738f1-42f8-4eb2-8af1-3ece0277a310 req-1a1f1b64-53dd-43d2-94ed-1af1db96b923 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Updated VIF entry in instance network info cache for port 61e204b4-d498-423a-8542-af401e188691. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.network.neutron [req-7a0738f1-42f8-4eb2-8af1-3ece0277a310 req-1a1f1b64-53dd-43d2-94ed-1af1db96b923 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Updating instance_info_cache with network_info: [{"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7a0738f1-42f8-4eb2-8af1-3ece0277a310 req-1a1f1b64-53dd-43d2-94ed-1af1db96b923 service nova] Releasing lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.network.neutron [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Successfully updated port: 3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141.part --force-share --output=json" returned: 0 in 0.206s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquired lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.network.neutron [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.virt.images [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] c7a2d6bc-338a-43fc-8006-1cdb0e5d01b0 was qcow2, converting to raw {{(pid=74242) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141.part /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141.converted {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-24c397c9-1709-4767-9d1f-d29563297a3f req-5569e085-1ad1-4107-8d5b-aa314a371451 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received event network-changed-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-24c397c9-1709-4767-9d1f-d29563297a3f req-5569e085-1ad1-4107-8d5b-aa314a371451 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Refreshing instance network info cache due to event network-changed-3071aff4-dceb-4a18-891e-f189d558cba7. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-24c397c9-1709-4767-9d1f-d29563297a3f req-5569e085-1ad1-4107-8d5b-aa314a371451 service nova] Acquiring lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-ad205e85-2670-4f59-86e4-7a98dbe02f4c req-cea11bb5-b048-441e-9f5e-3459918dd0c9 service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Received event network-vif-deleted-98d3c10c-2360-41e7-ae7f-9b7657a7326b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:48 user nova-compute[74242]: INFO nova.compute.manager [req-ad205e85-2670-4f59-86e4-7a98dbe02f4c req-cea11bb5-b048-441e-9f5e-3459918dd0c9 service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Neutron deleted interface 98d3c10c-2360-41e7-ae7f-9b7657a7326b; detaching it from the instance and deleting it from the info cache
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.network.neutron [req-ad205e85-2670-4f59-86e4-7a98dbe02f4c req-cea11bb5-b048-441e-9f5e-3459918dd0c9 service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:23:48 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Took 0.92 seconds to deallocate network for instance.
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-ad205e85-2670-4f59-86e4-7a98dbe02f4c req-cea11bb5-b048-441e-9f5e-3459918dd0c9 service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Detach interface failed, port_id=98d3c10c-2360-41e7-ae7f-9b7657a7326b, reason: Instance 5162fb94-7344-4193-98c8-c5f165309f60 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG nova.network.neutron [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141.part /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141.converted" returned: 0 in 0.169s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141.converted --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.network.neutron [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Successfully created port: 2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141.converted --force-share --output=json" returned: 0 in 0.229s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "b1aa7131b38ea7a2d0a654bdf762566b17d13141" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.045s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141 --force-share --output=json" returned: 0 in 0.236s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "b1aa7131b38ea7a2d0a654bdf762566b17d13141" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "b1aa7131b38ea7a2d0a654bdf762566b17d13141" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.network.neutron [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Updating instance_info_cache with network_info: [{"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Releasing lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Instance network_info: |[{"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-24c397c9-1709-4767-9d1f-d29563297a3f req-5569e085-1ad1-4107-8d5b-aa314a371451 service nova] Acquired lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.network.neutron [req-24c397c9-1709-4767-9d1f-d29563297a3f req-5569e085-1ad1-4107-8d5b-aa314a371451 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Refreshing network info cache for port 3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Start _get_guest_xml network_info=[{"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:23:49 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:23:49 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141 --force-share --output=json" returned: 0 in 0.207s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141,backing_fmt=raw /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141,backing_fmt=raw /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk 1073741824" returned: 0 in 0.076s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "b1aa7131b38ea7a2d0a654bdf762566b17d13141" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.290s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-798886193',display_name='tempest-ServerRescueNegativeTestJSON-server-798886193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-798886193',id=38,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80fa40dfb2c84a84b3399b643fcde4c5',ramdisk_id='',reservation_id='r-hl80a7sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-630282540',owner_user_name='tempest-ServerRescueNegativeTestJSON-630282540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:23:46Z,user_data=None,user_id='c7a7db373740428d89dcda898a04410c',uuid=7b6701b3-86f5-4498-9b45-24d4f53b6e78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converting VIF {"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:a3:fd,bridge_name='br-int',has_traffic_filtering=True,id=3071aff4-dceb-4a18-891e-f189d558cba7,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3071aff4-dc') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.objects.instance [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b6701b3-86f5-4498-9b45-24d4f53b6e78 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:23:49 user nova-compute[74242]:   <uuid>7b6701b3-86f5-4498-9b45-24d4f53b6e78</uuid>
Oct 20 02:23:49 user nova-compute[74242]:   <name>instance-00000026</name>
Oct 20 02:23:49 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:23:49 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:23:49 user nova-compute[74242]:   <metadata>
Oct 20 02:23:49 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:23:49 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:23:49 user nova-compute[74242]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-798886193</nova:name>
Oct 20 02:23:49 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:23:49</nova:creationTime>
Oct 20 02:23:49 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:23:49 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:23:49 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:23:49 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:23:49 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:23:49 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:23:49 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:23:49 user nova-compute[74242]:       <nova:owner>
Oct 20 02:23:49 user nova-compute[74242]:         <nova:user uuid="c7a7db373740428d89dcda898a04410c">tempest-ServerRescueNegativeTestJSON-630282540-project-member</nova:user>
Oct 20 02:23:49 user nova-compute[74242]:         <nova:project uuid="80fa40dfb2c84a84b3399b643fcde4c5">tempest-ServerRescueNegativeTestJSON-630282540</nova:project>
Oct 20 02:23:49 user nova-compute[74242]:       </nova:owner>
Oct 20 02:23:49 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:23:49 user nova-compute[74242]:       <nova:ports>
Oct 20 02:23:49 user nova-compute[74242]:         <nova:port uuid="3071aff4-dceb-4a18-891e-f189d558cba7">
Oct 20 02:23:49 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 02:23:49 user nova-compute[74242]:         </nova:port>
Oct 20 02:23:49 user nova-compute[74242]:       </nova:ports>
Oct 20 02:23:49 user nova-compute[74242]:     </nova:instance>
Oct 20 02:23:49 user nova-compute[74242]:   </metadata>
Oct 20 02:23:49 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:23:49 user nova-compute[74242]:     <system>
Oct 20 02:23:49 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:23:49 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:23:49 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:23:49 user nova-compute[74242]:       <entry name="serial">7b6701b3-86f5-4498-9b45-24d4f53b6e78</entry>
Oct 20 02:23:49 user nova-compute[74242]:       <entry name="uuid">7b6701b3-86f5-4498-9b45-24d4f53b6e78</entry>
Oct 20 02:23:49 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:23:49 user nova-compute[74242]:     </system>
Oct 20 02:23:49 user nova-compute[74242]:   </sysinfo>
Oct 20 02:23:49 user nova-compute[74242]:   <os>
Oct 20 02:23:49 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:23:49 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:23:49 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:23:49 user nova-compute[74242]:   </os>
Oct 20 02:23:49 user nova-compute[74242]:   <features>
Oct 20 02:23:49 user nova-compute[74242]:     <acpi/>
Oct 20 02:23:49 user nova-compute[74242]:     <apic/>
Oct 20 02:23:49 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:23:49 user nova-compute[74242]:   </features>
Oct 20 02:23:49 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:23:49 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:23:49 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:23:49 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:23:49 user nova-compute[74242]:   </clock>
Oct 20 02:23:49 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:23:49 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:23:49 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:23:49 user nova-compute[74242]:   </cpu>
Oct 20 02:23:49 user nova-compute[74242]:   <devices>
Oct 20 02:23:49 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:23:49 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:23:49 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk"/>
Oct 20 02:23:49 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:23:49 user nova-compute[74242]:     </disk>
Oct 20 02:23:49 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:23:49 user nova-compute[74242]:       <mac address="fa:16:3e:e4:a3:fd"/>
Oct 20 02:23:49 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:23:49 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:23:49 user nova-compute[74242]:       <target dev="tap3071aff4-dc"/>
Oct 20 02:23:49 user nova-compute[74242]:     </interface>
Oct 20 02:23:49 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:23:49 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/console.log" append="off"/>
Oct 20 02:23:49 user nova-compute[74242]:     </serial>
Oct 20 02:23:49 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:23:49 user nova-compute[74242]:     <video>
Oct 20 02:23:49 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:23:49 user nova-compute[74242]:     </video>
Oct 20 02:23:49 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:23:49 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:23:49 user nova-compute[74242]:     </rng>
Oct 20 02:23:49 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:23:49 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:23:49 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:23:49 user nova-compute[74242]:     </memballoon>
Oct 20 02:23:49 user nova-compute[74242]:   </devices>
Oct 20 02:23:49 user nova-compute[74242]: </domain>
Oct 20 02:23:49 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-798886193',display_name='tempest-ServerRescueNegativeTestJSON-server-798886193',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-798886193',id=38,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80fa40dfb2c84a84b3399b643fcde4c5',ramdisk_id='',reservation_id='r-hl80a7sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-630282540',owner_user_name='tempest-ServerRescueNegativeTestJSON-630282540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:23:46Z,user_data=None,user_id='c7a7db373740428d89dcda898a04410c',uuid=7b6701b3-86f5-4498-9b45-24d4f53b6e78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converting VIF {"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e4:a3:fd,bridge_name='br-int',has_traffic_filtering=True,id=3071aff4-dceb-4a18-891e-f189d558cba7,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3071aff4-dc') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG os_vif [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:a3:fd,bridge_name='br-int',has_traffic_filtering=True,id=3071aff4-dceb-4a18-891e-f189d558cba7,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3071aff4-dc') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4d93f68b-956c-560b-81ce-76f58a77e02f', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141 --force-share --output=json" returned: 0 in 0.192s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.959s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3071aff4-dc, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3071aff4-dc, col_values=(('qos', UUID('4ce08b1e-6e0e-4286-b12d-a98a6dbea3a6')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3071aff4-dc, col_values=(('external_ids', {'iface-id': '3071aff4-dceb-4a18-891e-f189d558cba7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e4:a3:fd', 'vm-uuid': '7b6701b3-86f5-4498-9b45-24d4f53b6e78'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:23:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:49 user nova-compute[74242]: INFO os_vif [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e4:a3:fd,bridge_name='br-int',has_traffic_filtering=True,id=3071aff4-dceb-4a18-891e-f189d558cba7,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3071aff4-dc')
Oct 20 02:23:49 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Deleted allocations for instance 5162fb94-7344-4193-98c8-c5f165309f60
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No VIF found with MAC fa:16:3e:e4:a3:fd, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json" returned: 0 in 0.239s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Cannot resize image /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Ensure instance console log exists: /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bd1cc201-cd3b-4f3c-b407-d7b20f6e980d tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "5162fb94-7344-4193-98c8-c5f165309f60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.385s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Received event network-vif-plugged-98d3c10c-2360-41e7-ae7f-9b7657a7326b {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] Acquiring lock "5162fb94-7344-4193-98c8-c5f165309f60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] Lock "5162fb94-7344-4193-98c8-c5f165309f60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] Lock "5162fb94-7344-4193-98c8-c5f165309f60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] No waiting events found dispatching network-vif-plugged-98d3c10c-2360-41e7-ae7f-9b7657a7326b {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:23:50 user nova-compute[74242]: WARNING nova.compute.manager [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] [instance: 5162fb94-7344-4193-98c8-c5f165309f60] Received unexpected event network-vif-plugged-98d3c10c-2360-41e7-ae7f-9b7657a7326b for instance with vm_state deleted and task_state None.
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] No waiting events found dispatching network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:23:50 user nova-compute[74242]: WARNING nova.compute.manager [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received unexpected event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 for instance with vm_state building and task_state spawning.
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] No waiting events found dispatching network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:23:50 user nova-compute[74242]: WARNING nova.compute.manager [req-6181ce44-8ac4-461d-9fe1-bcb519911e74 req-fe65709c-d106-4c61-b065-5a0aa3d6626d service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received unexpected event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 for instance with vm_state building and task_state spawning.
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.network.neutron [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Successfully updated port: 2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquired lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.network.neutron [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.network.neutron [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.network.neutron [req-24c397c9-1709-4767-9d1f-d29563297a3f req-5569e085-1ad1-4107-8d5b-aa314a371451 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Updated VIF entry in instance network info cache for port 3071aff4-dceb-4a18-891e-f189d558cba7. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.network.neutron [req-24c397c9-1709-4767-9d1f-d29563297a3f req-5569e085-1ad1-4107-8d5b-aa314a371451 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Updating instance_info_cache with network_info: [{"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-24c397c9-1709-4767-9d1f-d29563297a3f req-5569e085-1ad1-4107-8d5b-aa314a371451 service nova] Releasing lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-4f362611-9d06-4afb-ad73-468d9c0715ba req-c0a320b3-0551-4765-8849-229178fdbb90 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received event network-changed-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-4f362611-9d06-4afb-ad73-468d9c0715ba req-c0a320b3-0551-4765-8849-229178fdbb90 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Refreshing instance network info cache due to event network-changed-2c2d23fe-8f7f-4ed8-8d59-a9494654c051. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4f362611-9d06-4afb-ad73-468d9c0715ba req-c0a320b3-0551-4765-8849-229178fdbb90 service nova] Acquiring lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.network.neutron [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Updating instance_info_cache with network_info: [{"id": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "address": "fa:16:3e:82:c4:e7", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2d23fe-8f", "ovs_interfaceid": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Releasing lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Instance network_info: |[{"id": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "address": "fa:16:3e:82:c4:e7", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2d23fe-8f", "ovs_interfaceid": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4f362611-9d06-4afb-ad73-468d9c0715ba req-c0a320b3-0551-4765-8849-229178fdbb90 service nova] Acquired lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.network.neutron [req-4f362611-9d06-4afb-ad73-468d9c0715ba req-c0a320b3-0551-4765-8849-229178fdbb90 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Refreshing network info cache for port 2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Start _get_guest_xml network_info=[{"id": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "address": "fa:16:3e:82:c4:e7", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2d23fe-8f", "ovs_interfaceid": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T02:23:42Z,direct_url=<?>,disk_format='qcow2',id=c7a2d6bc-338a-43fc-8006-1cdb0e5d01b0,min_disk=0,min_ram=0,name='tempest-scenario-img--850424109',owner='7331dc1aa6464021bb371a8ebcf3a42b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T02:23:44Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': 'c7a2d6bc-338a-43fc-8006-1cdb0e5d01b0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:50 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:23:50 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T02:23:42Z,direct_url=<?>,disk_format='qcow2',id=c7a2d6bc-338a-43fc-8006-1cdb0e5d01b0,min_disk=0,min_ram=0,name='tempest-scenario-img--850424109',owner='7331dc1aa6464021bb371a8ebcf3a42b',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T02:23:44Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1877870132',display_name='tempest-TestMinimumBasicScenario-server-1877870132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1877870132',id=39,image_ref='c7a2d6bc-338a-43fc-8006-1cdb0e5d01b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4XGkNXhmZyVO9rRYFmTGZhnTH0VHPUelC0pff5/k6FGdngV5Y2wRw9UDtqIgw8EAahVoeOTM98kSZtmGSwWUEYXJwkIcozU4nABQ8YM/SitKXw25O+g3FxxS9hZROoPQ==',key_name='tempest-TestMinimumBasicScenario-841959097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7331dc1aa6464021bb371a8ebcf3a42b',ramdisk_id='',reservation_id='r-3mwlxt9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c7a2d6bc-338a-43fc-8006-1cdb0e5d01b0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-504118242',owner_user_name='tempest-TestMinimumBasicScenario-504118242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:23:48Z,user_data=None,user_id='8b64ecd6426f429ba929925fca497c82',uuid=cd90bd52-3af1-4d05-89df-2fedc535333f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "address": "fa:16:3e:82:c4:e7", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2d23fe-8f", "ovs_interfaceid": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converting VIF {"id": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "address": "fa:16:3e:82:c4:e7", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2d23fe-8f", "ovs_interfaceid": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:c4:e7,bridge_name='br-int',has_traffic_filtering=True,id=2c2d23fe-8f7f-4ed8-8d59-a9494654c051,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2d23fe-8f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.objects.instance [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lazy-loading 'pci_devices' on Instance uuid cd90bd52-3af1-4d05-89df-2fedc535333f {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:23:51 user nova-compute[74242]:   <uuid>cd90bd52-3af1-4d05-89df-2fedc535333f</uuid>
Oct 20 02:23:51 user nova-compute[74242]:   <name>instance-00000027</name>
Oct 20 02:23:51 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:23:51 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:23:51 user nova-compute[74242]:   <metadata>
Oct 20 02:23:51 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:23:51 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:23:51 user nova-compute[74242]:       <nova:name>tempest-TestMinimumBasicScenario-server-1877870132</nova:name>
Oct 20 02:23:51 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:23:50</nova:creationTime>
Oct 20 02:23:51 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:23:51 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:23:51 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:23:51 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:23:51 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:23:51 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:23:51 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:23:51 user nova-compute[74242]:       <nova:owner>
Oct 20 02:23:51 user nova-compute[74242]:         <nova:user uuid="8b64ecd6426f429ba929925fca497c82">tempest-TestMinimumBasicScenario-504118242-project-member</nova:user>
Oct 20 02:23:51 user nova-compute[74242]:         <nova:project uuid="7331dc1aa6464021bb371a8ebcf3a42b">tempest-TestMinimumBasicScenario-504118242</nova:project>
Oct 20 02:23:51 user nova-compute[74242]:       </nova:owner>
Oct 20 02:23:51 user nova-compute[74242]:       <nova:root type="image" uuid="c7a2d6bc-338a-43fc-8006-1cdb0e5d01b0"/>
Oct 20 02:23:51 user nova-compute[74242]:       <nova:ports>
Oct 20 02:23:51 user nova-compute[74242]:         <nova:port uuid="2c2d23fe-8f7f-4ed8-8d59-a9494654c051">
Oct 20 02:23:51 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 02:23:51 user nova-compute[74242]:         </nova:port>
Oct 20 02:23:51 user nova-compute[74242]:       </nova:ports>
Oct 20 02:23:51 user nova-compute[74242]:     </nova:instance>
Oct 20 02:23:51 user nova-compute[74242]:   </metadata>
Oct 20 02:23:51 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:23:51 user nova-compute[74242]:     <system>
Oct 20 02:23:51 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:23:51 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:23:51 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:23:51 user nova-compute[74242]:       <entry name="serial">cd90bd52-3af1-4d05-89df-2fedc535333f</entry>
Oct 20 02:23:51 user nova-compute[74242]:       <entry name="uuid">cd90bd52-3af1-4d05-89df-2fedc535333f</entry>
Oct 20 02:23:51 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:23:51 user nova-compute[74242]:     </system>
Oct 20 02:23:51 user nova-compute[74242]:   </sysinfo>
Oct 20 02:23:51 user nova-compute[74242]:   <os>
Oct 20 02:23:51 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:23:51 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:23:51 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:23:51 user nova-compute[74242]:   </os>
Oct 20 02:23:51 user nova-compute[74242]:   <features>
Oct 20 02:23:51 user nova-compute[74242]:     <acpi/>
Oct 20 02:23:51 user nova-compute[74242]:     <apic/>
Oct 20 02:23:51 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:23:51 user nova-compute[74242]:   </features>
Oct 20 02:23:51 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:23:51 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:23:51 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:23:51 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:23:51 user nova-compute[74242]:   </clock>
Oct 20 02:23:51 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:23:51 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:23:51 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:23:51 user nova-compute[74242]:   </cpu>
Oct 20 02:23:51 user nova-compute[74242]:   <devices>
Oct 20 02:23:51 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:23:51 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:23:51 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk"/>
Oct 20 02:23:51 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:23:51 user nova-compute[74242]:     </disk>
Oct 20 02:23:51 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:23:51 user nova-compute[74242]:       <mac address="fa:16:3e:82:c4:e7"/>
Oct 20 02:23:51 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:23:51 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:23:51 user nova-compute[74242]:       <target dev="tap2c2d23fe-8f"/>
Oct 20 02:23:51 user nova-compute[74242]:     </interface>
Oct 20 02:23:51 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:23:51 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/console.log" append="off"/>
Oct 20 02:23:51 user nova-compute[74242]:     </serial>
Oct 20 02:23:51 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:23:51 user nova-compute[74242]:     <video>
Oct 20 02:23:51 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:23:51 user nova-compute[74242]:     </video>
Oct 20 02:23:51 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:23:51 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:23:51 user nova-compute[74242]:     </rng>
Oct 20 02:23:51 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:23:51 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:23:51 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:23:51 user nova-compute[74242]:     </memballoon>
Oct 20 02:23:51 user nova-compute[74242]:   </devices>
Oct 20 02:23:51 user nova-compute[74242]: </domain>
Oct 20 02:23:51 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1877870132',display_name='tempest-TestMinimumBasicScenario-server-1877870132',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1877870132',id=39,image_ref='c7a2d6bc-338a-43fc-8006-1cdb0e5d01b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4XGkNXhmZyVO9rRYFmTGZhnTH0VHPUelC0pff5/k6FGdngV5Y2wRw9UDtqIgw8EAahVoeOTM98kSZtmGSwWUEYXJwkIcozU4nABQ8YM/SitKXw25O+g3FxxS9hZROoPQ==',key_name='tempest-TestMinimumBasicScenario-841959097',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7331dc1aa6464021bb371a8ebcf3a42b',ramdisk_id='',reservation_id='r-3mwlxt9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c7a2d6bc-338a-43fc-8006-1cdb0e5d01b0',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-504118242',owner_user_name='tempest-TestMinimumBasicScenario-504118242-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:23:48Z,user_data=None,user_id='8b64ecd6426f429ba929925fca497c82',uuid=cd90bd52-3af1-4d05-89df-2fedc535333f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "address": "fa:16:3e:82:c4:e7", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2d23fe-8f", "ovs_interfaceid": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converting VIF {"id": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "address": "fa:16:3e:82:c4:e7", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2d23fe-8f", "ovs_interfaceid": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:c4:e7,bridge_name='br-int',has_traffic_filtering=True,id=2c2d23fe-8f7f-4ed8-8d59-a9494654c051,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2d23fe-8f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG os_vif [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:c4:e7,bridge_name='br-int',has_traffic_filtering=True,id=2c2d23fe-8f7f-4ed8-8d59-a9494654c051,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2d23fe-8f') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5c96db6c-f2db-5973-8e1d-8f5e58da6990', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c2d23fe-8f, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c2d23fe-8f, col_values=(('qos', UUID('2d82ea03-b19b-44f7-99ec-4a2247d696b3')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c2d23fe-8f, col_values=(('external_ids', {'iface-id': '2c2d23fe-8f7f-4ed8-8d59-a9494654c051', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:c4:e7', 'vm-uuid': 'cd90bd52-3af1-4d05-89df-2fedc535333f'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:51 user nova-compute[74242]: INFO os_vif [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:c4:e7,bridge_name='br-int',has_traffic_filtering=True,id=2c2d23fe-8f7f-4ed8-8d59-a9494654c051,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2d23fe-8f')
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] No VIF found with MAC fa:16:3e:82:c4:e7, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.288s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:23:51 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Instance spawned successfully.
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.network.neutron [req-4f362611-9d06-4afb-ad73-468d9c0715ba req-c0a320b3-0551-4765-8849-229178fdbb90 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Updated VIF entry in instance network info cache for port 2c2d23fe-8f7f-4ed8-8d59-a9494654c051. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.network.neutron [req-4f362611-9d06-4afb-ad73-468d9c0715ba req-c0a320b3-0551-4765-8849-229178fdbb90 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Updating instance_info_cache with network_info: [{"id": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "address": "fa:16:3e:82:c4:e7", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2d23fe-8f", "ovs_interfaceid": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4f362611-9d06-4afb-ad73-468d9c0715ba req-c0a320b3-0551-4765-8849-229178fdbb90 service nova] Releasing lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:51 user nova-compute[74242]: INFO nova.compute.manager [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Took 7.06 seconds to spawn the instance on the hypervisor.
Oct 20 02:23:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:23:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.323s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:52 user nova-compute[74242]: INFO nova.compute.manager [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Took 7.98 seconds to build instance.
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-728f04e6-d517-406f-900a-a0d4d73093e3 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "2bf62933-66ea-469e-a70e-92184f311110" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.103s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-53eba2c8-93c5-48a4-9d85-e0937c765827 req-b87189ed-af90-4668-9c1b-2c73f391cf69 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received event network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-53eba2c8-93c5-48a4-9d85-e0937c765827 req-b87189ed-af90-4668-9c1b-2c73f391cf69 service nova] Acquiring lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-53eba2c8-93c5-48a4-9d85-e0937c765827 req-b87189ed-af90-4668-9c1b-2c73f391cf69 service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-53eba2c8-93c5-48a4-9d85-e0937c765827 req-b87189ed-af90-4668-9c1b-2c73f391cf69 service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-53eba2c8-93c5-48a4-9d85-e0937c765827 req-b87189ed-af90-4668-9c1b-2c73f391cf69 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] No waiting events found dispatching network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:23:52 user nova-compute[74242]: WARNING nova.compute.manager [req-53eba2c8-93c5-48a4-9d85-e0937c765827 req-b87189ed-af90-4668-9c1b-2c73f391cf69 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received unexpected event network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 for instance with vm_state building and task_state spawning.
Oct 20 02:23:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-53eba2c8-93c5-48a4-9d85-e0937c765827 req-b87189ed-af90-4668-9c1b-2c73f391cf69 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received event network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-53eba2c8-93c5-48a4-9d85-e0937c765827 req-b87189ed-af90-4668-9c1b-2c73f391cf69 service nova] Acquiring lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-53eba2c8-93c5-48a4-9d85-e0937c765827 req-b87189ed-af90-4668-9c1b-2c73f391cf69 service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-53eba2c8-93c5-48a4-9d85-e0937c765827 req-b87189ed-af90-4668-9c1b-2c73f391cf69 service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-53eba2c8-93c5-48a4-9d85-e0937c765827 req-b87189ed-af90-4668-9c1b-2c73f391cf69 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] No waiting events found dispatching network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:23:52 user nova-compute[74242]: WARNING nova.compute.manager [req-53eba2c8-93c5-48a4-9d85-e0937c765827 req-b87189ed-af90-4668-9c1b-2c73f391cf69 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received unexpected event network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 for instance with vm_state building and task_state spawning.
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/disk.rescue --force-share --output=json" returned: 0 in 0.213s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:23:53 user nova-compute[74242]: DEBUG nova.compute.manager [req-3c1876ab-8926-472e-a7ef-05cbbdb9d21e req-16ed080d-a760-4fd7-93cb-60863510e036 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received event network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3c1876ab-8926-472e-a7ef-05cbbdb9d21e req-16ed080d-a760-4fd7-93cb-60863510e036 service nova] Acquiring lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3c1876ab-8926-472e-a7ef-05cbbdb9d21e req-16ed080d-a760-4fd7-93cb-60863510e036 service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3c1876ab-8926-472e-a7ef-05cbbdb9d21e req-16ed080d-a760-4fd7-93cb-60863510e036 service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:53 user nova-compute[74242]: DEBUG nova.compute.manager [req-3c1876ab-8926-472e-a7ef-05cbbdb9d21e req-16ed080d-a760-4fd7-93cb-60863510e036 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] No waiting events found dispatching network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:23:53 user nova-compute[74242]: WARNING nova.compute.manager [req-3c1876ab-8926-472e-a7ef-05cbbdb9d21e req-16ed080d-a760-4fd7-93cb-60863510e036 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received unexpected event network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 for instance with vm_state building and task_state spawning.
Oct 20 02:23:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.manager [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:23:55 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Instance spawned successfully.
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:23:55 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:23:55 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8131MB free_disk=24.876026153564453GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:55 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Instance spawned successfully.
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:23:55 user nova-compute[74242]: INFO nova.compute.manager [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Took 9.82 seconds to spawn the instance on the hypervisor.
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:23:55 user nova-compute[74242]: INFO nova.compute.manager [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Took 7.81 seconds to spawn the instance on the hypervisor.
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.manager [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.manager [req-a6732ae2-8f40-4fbd-9e81-13797d09573b req-d9dcdbe4-648a-4a8a-8bf1-a2b10a16644f service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received event network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a6732ae2-8f40-4fbd-9e81-13797d09573b req-d9dcdbe4-648a-4a8a-8bf1-a2b10a16644f service nova] Acquiring lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a6732ae2-8f40-4fbd-9e81-13797d09573b req-d9dcdbe4-648a-4a8a-8bf1-a2b10a16644f service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a6732ae2-8f40-4fbd-9e81-13797d09573b req-d9dcdbe4-648a-4a8a-8bf1-a2b10a16644f service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.manager [req-a6732ae2-8f40-4fbd-9e81-13797d09573b req-d9dcdbe4-648a-4a8a-8bf1-a2b10a16644f service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] No waiting events found dispatching network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:23:55 user nova-compute[74242]: WARNING nova.compute.manager [req-a6732ae2-8f40-4fbd-9e81-13797d09573b req-d9dcdbe4-648a-4a8a-8bf1-a2b10a16644f service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received unexpected event network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 for instance with vm_state building and task_state spawning.
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c98e383a-e1e5-4130-9cc6-a9823db0b88c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 876f8f80-9640-43ba-8ec7-0ffe06c82086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 62ca0d11-07be-4998-8404-b4d31f1e57da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 74295e5c-237c-4992-a21a-6f59fd6ff246 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance cd90bd52-3af1-4d05-89df-2fedc535333f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:23:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:23:55 user nova-compute[74242]: INFO nova.compute.manager [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Took 11.06 seconds to build instance.
Oct 20 02:23:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f91c4f38-ab83-4cf0-bd0f-8e9169f44774 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.184s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:55 user nova-compute[74242]: INFO nova.compute.manager [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Took 9.49 seconds to build instance.
Oct 20 02:23:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-accee99d-2f88-4b97-a7f5-f77f669105f1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.676s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:23:56 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:23:56 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:23:56 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:23:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.682s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:56 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:23:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 02:23:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] There are 0 instances to clean {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 02:23:56 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:23:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74242) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 02:23:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "8497b901-64fb-44f3-bd07-f584ab799867" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:58 user nova-compute[74242]: DEBUG nova.compute.manager [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:23:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:58 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:23:58 user nova-compute[74242]: INFO nova.compute.claims [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Claim successful on node user
Oct 20 02:23:59 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG nova.network.neutron [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:23:59 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:23:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG nova.policy [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd8dc8fca651343beac526aee0a74023f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '362d9ed2d8ed40df9e4502c3fb9ae8ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:23:59 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Creating image(s)
Oct 20 02:23:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "/opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "/opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "/opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.199s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.267s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:23:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk 1073741824" returned: 0 in 0.082s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.374s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG nova.network.neutron [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Successfully created port: df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.197s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Cannot resize image /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Ensure instance console log exists: /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG nova.network.neutron [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Successfully updated port: df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquired lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG nova.network.neutron [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-bd114814-f0b4-4c09-990f-a3696eebbe84 req-ef686003-222a-48ad-b2e7-e1fe34152cb0 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-changed-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-bd114814-f0b4-4c09-990f-a3696eebbe84 req-ef686003-222a-48ad-b2e7-e1fe34152cb0 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Refreshing instance network info cache due to event network-changed-df5d650c-5e5c-4822-8154-7fc1213190b4. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bd114814-f0b4-4c09-990f-a3696eebbe84 req-ef686003-222a-48ad-b2e7-e1fe34152cb0 service nova] Acquiring lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:24:00 user nova-compute[74242]: DEBUG nova.network.neutron [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.network.neutron [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updating instance_info_cache with network_info: [{"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Releasing lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.compute.manager [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Instance network_info: |[{"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bd114814-f0b4-4c09-990f-a3696eebbe84 req-ef686003-222a-48ad-b2e7-e1fe34152cb0 service nova] Acquired lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.network.neutron [req-bd114814-f0b4-4c09-990f-a3696eebbe84 req-ef686003-222a-48ad-b2e7-e1fe34152cb0 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Refreshing network info cache for port df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Start _get_guest_xml network_info=[{"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:24:01 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:24:01 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2059081696',display_name='tempest-ServerStableDeviceRescueTest-server-2059081696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2059081696',id=40,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTAAcf8Y7sAmdQqd5z9q/RF6wwhR0b02FbKRBj+uRza53X4eObcjHf3dPZyS7adSfQYxggRP2hP3ekB/6YppEmRoXNmwoWWIl3XxzwKP3FiyDhp+6BlBzskARDdOcrztA==',key_name='tempest-keypair-274219542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='362d9ed2d8ed40df9e4502c3fb9ae8ae',ramdisk_id='',reservation_id='r-rie4dx62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1200020058',owner_user_name='tempest-ServerStableDeviceRescueTest-1200020058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:23:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8dc8fca651343beac526aee0a74023f',uuid=8497b901-64fb-44f3-bd07-f584ab799867,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Converting VIF {"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:17:65,bridge_name='br-int',has_traffic_filtering=True,id=df5d650c-5e5c-4822-8154-7fc1213190b4,network=Network(02e4212b-93a0-4444-a4c5-793b52071c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5d650c-5e') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.objects.instance [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lazy-loading 'pci_devices' on Instance uuid 8497b901-64fb-44f3-bd07-f584ab799867 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:24:01 user nova-compute[74242]:   <uuid>8497b901-64fb-44f3-bd07-f584ab799867</uuid>
Oct 20 02:24:01 user nova-compute[74242]:   <name>instance-00000028</name>
Oct 20 02:24:01 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:24:01 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:24:01 user nova-compute[74242]:   <metadata>
Oct 20 02:24:01 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:24:01 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:24:01 user nova-compute[74242]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2059081696</nova:name>
Oct 20 02:24:01 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:24:01</nova:creationTime>
Oct 20 02:24:01 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:24:01 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:24:01 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:24:01 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:24:01 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:24:01 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:24:01 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:24:01 user nova-compute[74242]:       <nova:owner>
Oct 20 02:24:01 user nova-compute[74242]:         <nova:user uuid="d8dc8fca651343beac526aee0a74023f">tempest-ServerStableDeviceRescueTest-1200020058-project-member</nova:user>
Oct 20 02:24:01 user nova-compute[74242]:         <nova:project uuid="362d9ed2d8ed40df9e4502c3fb9ae8ae">tempest-ServerStableDeviceRescueTest-1200020058</nova:project>
Oct 20 02:24:01 user nova-compute[74242]:       </nova:owner>
Oct 20 02:24:01 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:24:01 user nova-compute[74242]:       <nova:ports>
Oct 20 02:24:01 user nova-compute[74242]:         <nova:port uuid="df5d650c-5e5c-4822-8154-7fc1213190b4">
Oct 20 02:24:01 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 02:24:01 user nova-compute[74242]:         </nova:port>
Oct 20 02:24:01 user nova-compute[74242]:       </nova:ports>
Oct 20 02:24:01 user nova-compute[74242]:     </nova:instance>
Oct 20 02:24:01 user nova-compute[74242]:   </metadata>
Oct 20 02:24:01 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:24:01 user nova-compute[74242]:     <system>
Oct 20 02:24:01 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:24:01 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:24:01 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:24:01 user nova-compute[74242]:       <entry name="serial">8497b901-64fb-44f3-bd07-f584ab799867</entry>
Oct 20 02:24:01 user nova-compute[74242]:       <entry name="uuid">8497b901-64fb-44f3-bd07-f584ab799867</entry>
Oct 20 02:24:01 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:24:01 user nova-compute[74242]:     </system>
Oct 20 02:24:01 user nova-compute[74242]:   </sysinfo>
Oct 20 02:24:01 user nova-compute[74242]:   <os>
Oct 20 02:24:01 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:24:01 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:24:01 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:24:01 user nova-compute[74242]:   </os>
Oct 20 02:24:01 user nova-compute[74242]:   <features>
Oct 20 02:24:01 user nova-compute[74242]:     <acpi/>
Oct 20 02:24:01 user nova-compute[74242]:     <apic/>
Oct 20 02:24:01 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:24:01 user nova-compute[74242]:   </features>
Oct 20 02:24:01 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:24:01 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:24:01 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:24:01 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:24:01 user nova-compute[74242]:   </clock>
Oct 20 02:24:01 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:24:01 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:24:01 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:24:01 user nova-compute[74242]:   </cpu>
Oct 20 02:24:01 user nova-compute[74242]:   <devices>
Oct 20 02:24:01 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:24:01 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:24:01 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk"/>
Oct 20 02:24:01 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:24:01 user nova-compute[74242]:     </disk>
Oct 20 02:24:01 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:24:01 user nova-compute[74242]:       <mac address="fa:16:3e:ed:17:65"/>
Oct 20 02:24:01 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:24:01 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:24:01 user nova-compute[74242]:       <target dev="tapdf5d650c-5e"/>
Oct 20 02:24:01 user nova-compute[74242]:     </interface>
Oct 20 02:24:01 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:24:01 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/console.log" append="off"/>
Oct 20 02:24:01 user nova-compute[74242]:     </serial>
Oct 20 02:24:01 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:24:01 user nova-compute[74242]:     <video>
Oct 20 02:24:01 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:24:01 user nova-compute[74242]:     </video>
Oct 20 02:24:01 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:24:01 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:24:01 user nova-compute[74242]:     </rng>
Oct 20 02:24:01 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:24:01 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:24:01 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:24:01 user nova-compute[74242]:     </memballoon>
Oct 20 02:24:01 user nova-compute[74242]:   </devices>
Oct 20 02:24:01 user nova-compute[74242]: </domain>
Oct 20 02:24:01 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2059081696',display_name='tempest-ServerStableDeviceRescueTest-server-2059081696',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2059081696',id=40,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTAAcf8Y7sAmdQqd5z9q/RF6wwhR0b02FbKRBj+uRza53X4eObcjHf3dPZyS7adSfQYxggRP2hP3ekB/6YppEmRoXNmwoWWIl3XxzwKP3FiyDhp+6BlBzskARDdOcrztA==',key_name='tempest-keypair-274219542',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='362d9ed2d8ed40df9e4502c3fb9ae8ae',ramdisk_id='',reservation_id='r-rie4dx62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1200020058',owner_user_name='tempest-ServerStableDeviceRescueTest-1200020058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:23:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8dc8fca651343beac526aee0a74023f',uuid=8497b901-64fb-44f3-bd07-f584ab799867,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Converting VIF {"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:17:65,bridge_name='br-int',has_traffic_filtering=True,id=df5d650c-5e5c-4822-8154-7fc1213190b4,network=Network(02e4212b-93a0-4444-a4c5-793b52071c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5d650c-5e') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG os_vif [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:17:65,bridge_name='br-int',has_traffic_filtering=True,id=df5d650c-5e5c-4822-8154-7fc1213190b4,network=Network(02e4212b-93a0-4444-a4c5-793b52071c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5d650c-5e') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2862de41-38a6-5c13-a682-18d219ebf2c4', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdf5d650c-5e, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdf5d650c-5e, col_values=(('qos', UUID('b7af9ce1-6e23-46b3-a1bd-67f569245fdd')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdf5d650c-5e, col_values=(('external_ids', {'iface-id': 'df5d650c-5e5c-4822-8154-7fc1213190b4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:17:65', 'vm-uuid': '8497b901-64fb-44f3-bd07-f584ab799867'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:01 user nova-compute[74242]: INFO os_vif [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:17:65,bridge_name='br-int',has_traffic_filtering=True,id=df5d650c-5e5c-4822-8154-7fc1213190b4,network=Network(02e4212b-93a0-4444-a4c5-793b52071c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5d650c-5e')
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] No VIF found with MAC fa:16:3e:ed:17:65, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.network.neutron [req-bd114814-f0b4-4c09-990f-a3696eebbe84 req-ef686003-222a-48ad-b2e7-e1fe34152cb0 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updated VIF entry in instance network info cache for port df5d650c-5e5c-4822-8154-7fc1213190b4. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG nova.network.neutron [req-bd114814-f0b4-4c09-990f-a3696eebbe84 req-ef686003-222a-48ad-b2e7-e1fe34152cb0 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updating instance_info_cache with network_info: [{"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:24:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bd114814-f0b4-4c09-990f-a3696eebbe84 req-ef686003-222a-48ad-b2e7-e1fe34152cb0 service nova] Releasing lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:24:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:03 user nova-compute[74242]: DEBUG nova.compute.manager [req-8abc1ce6-c66e-4738-b7fd-5fe23af19e78 req-4bb5cd38-2e7d-47cb-8538-d9d876050f23 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:24:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8abc1ce6-c66e-4738-b7fd-5fe23af19e78 req-4bb5cd38-2e7d-47cb-8538-d9d876050f23 service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:24:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8abc1ce6-c66e-4738-b7fd-5fe23af19e78 req-4bb5cd38-2e7d-47cb-8538-d9d876050f23 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:24:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8abc1ce6-c66e-4738-b7fd-5fe23af19e78 req-4bb5cd38-2e7d-47cb-8538-d9d876050f23 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:03 user nova-compute[74242]: DEBUG nova.compute.manager [req-8abc1ce6-c66e-4738-b7fd-5fe23af19e78 req-4bb5cd38-2e7d-47cb-8538-d9d876050f23 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:24:03 user nova-compute[74242]: WARNING nova.compute.manager [req-8abc1ce6-c66e-4738-b7fd-5fe23af19e78 req-4bb5cd38-2e7d-47cb-8538-d9d876050f23 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received unexpected event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with vm_state building and task_state spawning.
Oct 20 02:24:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-e95d2aa6-a233-4e9b-99c3-24f7c33e0e8f req-e980fc97-7e80-4e5b-9800-f7ee670643fb service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e95d2aa6-a233-4e9b-99c3-24f7c33e0e8f req-e980fc97-7e80-4e5b-9800-f7ee670643fb service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e95d2aa6-a233-4e9b-99c3-24f7c33e0e8f req-e980fc97-7e80-4e5b-9800-f7ee670643fb service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e95d2aa6-a233-4e9b-99c3-24f7c33e0e8f req-e980fc97-7e80-4e5b-9800-f7ee670643fb service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-e95d2aa6-a233-4e9b-99c3-24f7c33e0e8f req-e980fc97-7e80-4e5b-9800-f7ee670643fb service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:24:05 user nova-compute[74242]: WARNING nova.compute.manager [req-e95d2aa6-a233-4e9b-99c3-24f7c33e0e8f req-e980fc97-7e80-4e5b-9800-f7ee670643fb service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received unexpected event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with vm_state building and task_state spawning.
Oct 20 02:24:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG nova.compute.manager [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:24:05 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Instance spawned successfully.
Oct 20 02:24:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:24:05 user nova-compute[74242]: INFO nova.compute.manager [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Took 5.89 seconds to spawn the instance on the hypervisor.
Oct 20 02:24:05 user nova-compute[74242]: DEBUG nova.compute.manager [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:24:05 user nova-compute[74242]: INFO nova.compute.manager [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Took 6.87 seconds to build instance.
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-346c2944-8b86-4128-b9c5-7d8418aea80d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "8497b901-64fb-44f3-bd07-f584ab799867" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.996s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TomMLuSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:24:05 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:24:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:24:05 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:24:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:24:05 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb66207d-44b6-4a0e-8db0-0238780e205d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:24:05 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa409f8-b833-43bc-bb18-25b837923d34]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388] added
Oct 20 02:24:05 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[203ee7e5-3dd8-405e-8e74-707f63cc9da5]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a160d0de-c3f6-41d0-8b16-c984e77f5be7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TomMLuSp {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TomMLuSp" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d14eea-a5aa-495e-bbb3-3ccc6492ca73]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TomMLuSp'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de1de0e-29bc-438d-b814-2dc925953c98]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:24:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba8694f-0b6e-4c68-8d25-36eea3d751b1]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:24:06 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:24:06 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:24:06 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:24:06 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0523368d-1d72-4c3a-b94c-9640e459db41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388, portal: 172.16.0.220,3260]
Oct 20 02:24:06 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388, portal: 172.16.0.220,3260] successful.
Oct 20 02:24:06 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce225e93-6bb6-40ca-9ee7-14506cafbbb7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dff7576-aebf-47d5-94e8-73b2e9d46895]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:24:06 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:24:06 user nova-compute[74242]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 (non-flash)
Oct 20 02:24:06 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:24:06 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:24:06 user nova-compute[74242]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 (non-flash)
Oct 20 02:24:06 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[489a1e67-372e-44ec-adfb-554f596ace58]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TomMLuSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:24:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:24:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '23130613662643533', 'path': '/dev/sdd'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:24:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23130613662643533', 'path': '/dev/sdd'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:24:07 user nova-compute[74242]: DEBUG nova.objects.instance [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lazy-loading 'flavor' on Instance uuid 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:24:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:24:07 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:24:07 user nova-compute[74242]:   <source dev="/dev/sdd"/>
Oct 20 02:24:07 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:24:07 user nova-compute[74242]:   <serial>0ebe89d1-e951-40dc-bc59-79359b3a3388</serial>
Oct 20 02:24:07 user nova-compute[74242]: </disk>
Oct 20 02:24:07 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:24:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:24:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:24:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] No VIF found with MAC fa:16:3e:6b:ed:0a, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:24:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-60587b34-71c4-4794-a3b8-ac7854f65b08 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.857s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:24:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:24:10 user nova-compute[74242]: INFO nova.compute.manager [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Detaching volume 0ebe89d1-e951-40dc-bc59-79359b3a3388
Oct 20 02:24:10 user nova-compute[74242]: INFO nova.virt.block_device [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Attempting to driver detach volume 0ebe89d1-e951-40dc-bc59-79359b3a3388 from mountpoint /dev/vdb
Oct 20 02:24:10 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Attempting to detach device vdb from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:24:10 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:24:10 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:24:10 user nova-compute[74242]:   <source dev="/dev/sdd"/>
Oct 20 02:24:10 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:24:10 user nova-compute[74242]:   <serial>0ebe89d1-e951-40dc-bc59-79359b3a3388</serial>
Oct 20 02:24:10 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:24:10 user nova-compute[74242]: </disk>
Oct 20 02:24:10 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:24:10 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Successfully detached device vdb from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the persistent domain config.
Oct 20 02:24:10 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:24:10 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:24:10 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:24:10 user nova-compute[74242]:   <source dev="/dev/sdd"/>
Oct 20 02:24:10 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:24:10 user nova-compute[74242]:   <serial>0ebe89d1-e951-40dc-bc59-79359b3a3388</serial>
Oct 20 02:24:10 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:24:10 user nova-compute[74242]: </disk>
Oct 20 02:24:10 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:24:10 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:24:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:30 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 is timed out.
Oct 20 02:24:30 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Successfully detached device vdb from instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 from the live domain config.
Oct 20 02:24:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:24:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TomMLuSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:24:30 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:24:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:24:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:24:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9534349-d30a-4e62-939c-f71aa5f282e4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:24:31 user nova-compute[74242]: No targets found.
Oct 20 02:24:31 user nova-compute[74242]: iSNS:
Oct 20 02:24:31 user nova-compute[74242]: No targets found.
Oct 20 02:24:31 user nova-compute[74242]: STATIC:
Oct 20 02:24:31 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388
Oct 20 02:24:31 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:24:31 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:24:31 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:24:31 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:24:31 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:24:31 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d
Oct 20 02:24:31 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:24:31 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:24:31 user nova-compute[74242]: FIRMWARE:
Oct 20 02:24:31 user nova-compute[74242]: No targets found.
Oct 20 02:24:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:24:31 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:24:31 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d3add8-00c9-40b1-9924-f2e93d5c6477]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0d2a33-c4fa-42ec-817d-6ca532fe55fa]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:24:31 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:24:31 user nova-compute[74242]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 (non-flash)
Oct 20 02:24:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:24:31 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:24:31 user nova-compute[74242]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 (non-flash)
Oct 20 02:24:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b82e7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388'): ({'sdd'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Removing single pathed devices sdd {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[be5bb3eb-eee5-4aa3-98b3-1cd4da7bb39c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f3cc8fb-6599-49bf-aaba-cd123cb0eaf7]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Flushing IO for device /dev/sdd {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebdff8b-1580-4834-ad66-f602bd18f5de]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.057s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e4a997-4103-41d7-b2a8-63609d5bc368]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d96272-c8aa-45f0-a984-87a27a677c4f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2da46c-4e8f-4a9e-8dcd-1e59d757f997]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388, portal: 172.16.0.220,3260]
Oct 20 02:24:31 user nova-compute[74242]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388, portal: 172.16.0.220,3260] successful.
Oct 20 02:24:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ebe89d1-e951-40dc-bc59-79359b3a3388 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[75762f6d-6e2f-459b-938f-fcfc6cbc1ea5]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] <== disconnect_volume: return (317ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:24:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:32 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lazy-loading 'flavor' on Instance uuid 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:24:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1dba3445-ef71-49ad-8f76-f227d52ec414 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.737s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "3279fb54-306d-4031-8aec-6397554b5c72" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:24:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "3279fb54-306d-4031-8aec-6397554b5c72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:24:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:24:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:24:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:24:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:24:38 user nova-compute[74242]: INFO nova.compute.claims [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Claim successful on node user
Oct 20 02:24:38 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:24:38 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:24:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.478s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:24:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:24:38 user nova-compute[74242]: DEBUG nova.network.neutron [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:24:39 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:24:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG nova.policy [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '29cd6130817e4b588ce838dd958b5fd1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f4b7d7e4e314e7aa95f8ceb39a0dc95', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:24:39 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Creating image(s)
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "/opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "/opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "/opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.197s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.198s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk 1073741824" returned: 0 in 0.049s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG nova.network.neutron [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Successfully created port: db5e8e51-91cc-48c4-bff9-127565a00f36 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:39 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Cannot resize image /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Ensure instance console log exists: /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Didn't find any instances for network info cache update. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.network.neutron [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Successfully updated port: db5e8e51-91cc-48c4-bff9-127565a00f36 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "refresh_cache-3279fb54-306d-4031-8aec-6397554b5c72" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquired lock "refresh_cache-3279fb54-306d-4031-8aec-6397554b5c72" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.network.neutron [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-124c19d4-78ea-4b83-a2db-ae822a06a062 req-b1b1af42-1a42-4eab-a5a5-6cb65272847f service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Received event network-changed-db5e8e51-91cc-48c4-bff9-127565a00f36 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-124c19d4-78ea-4b83-a2db-ae822a06a062 req-b1b1af42-1a42-4eab-a5a5-6cb65272847f service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Refreshing instance network info cache due to event network-changed-db5e8e51-91cc-48c4-bff9-127565a00f36. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-124c19d4-78ea-4b83-a2db-ae822a06a062 req-b1b1af42-1a42-4eab-a5a5-6cb65272847f service nova] Acquiring lock "refresh_cache-3279fb54-306d-4031-8aec-6397554b5c72" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.network.neutron [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.network.neutron [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Updating instance_info_cache with network_info: [{"id": "db5e8e51-91cc-48c4-bff9-127565a00f36", "address": "fa:16:3e:b5:4c:1a", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5e8e51-91", "ovs_interfaceid": "db5e8e51-91cc-48c4-bff9-127565a00f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Releasing lock "refresh_cache-3279fb54-306d-4031-8aec-6397554b5c72" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Instance network_info: |[{"id": "db5e8e51-91cc-48c4-bff9-127565a00f36", "address": "fa:16:3e:b5:4c:1a", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5e8e51-91", "ovs_interfaceid": "db5e8e51-91cc-48c4-bff9-127565a00f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-124c19d4-78ea-4b83-a2db-ae822a06a062 req-b1b1af42-1a42-4eab-a5a5-6cb65272847f service nova] Acquired lock "refresh_cache-3279fb54-306d-4031-8aec-6397554b5c72" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.network.neutron [req-124c19d4-78ea-4b83-a2db-ae822a06a062 req-b1b1af42-1a42-4eab-a5a5-6cb65272847f service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Refreshing network info cache for port db5e8e51-91cc-48c4-bff9-127565a00f36 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Start _get_guest_xml network_info=[{"id": "db5e8e51-91cc-48c4-bff9-127565a00f36", "address": "fa:16:3e:b5:4c:1a", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5e8e51-91", "ovs_interfaceid": "db5e8e51-91cc-48c4-bff9-127565a00f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:24:40 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:24:40 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1773041437',display_name='tempest-VolumesActionsTest-instance-1773041437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1773041437',id=41,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f4b7d7e4e314e7aa95f8ceb39a0dc95',ramdisk_id='',reservation_id='r-zbvv7oak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-537401295',owner_user_name='tempest-VolumesActionsTest-537401295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:24:39Z,user_data=None,user_id='29cd6130817e4b588ce838dd958b5fd1',uuid=3279fb54-306d-4031-8aec-6397554b5c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db5e8e51-91cc-48c4-bff9-127565a00f36", "address": "fa:16:3e:b5:4c:1a", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5e8e51-91", "ovs_interfaceid": "db5e8e51-91cc-48c4-bff9-127565a00f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Converting VIF {"id": "db5e8e51-91cc-48c4-bff9-127565a00f36", "address": "fa:16:3e:b5:4c:1a", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5e8e51-91", "ovs_interfaceid": "db5e8e51-91cc-48c4-bff9-127565a00f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:4c:1a,bridge_name='br-int',has_traffic_filtering=True,id=db5e8e51-91cc-48c4-bff9-127565a00f36,network=Network(d67e0969-7ca5-47d9-b6c9-68558277b293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5e8e51-91') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.objects.instance [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lazy-loading 'pci_devices' on Instance uuid 3279fb54-306d-4031-8aec-6397554b5c72 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:24:40 user nova-compute[74242]:   <uuid>3279fb54-306d-4031-8aec-6397554b5c72</uuid>
Oct 20 02:24:40 user nova-compute[74242]:   <name>instance-00000029</name>
Oct 20 02:24:40 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:24:40 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:24:40 user nova-compute[74242]:   <metadata>
Oct 20 02:24:40 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:24:40 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:24:40 user nova-compute[74242]:       <nova:name>tempest-VolumesActionsTest-instance-1773041437</nova:name>
Oct 20 02:24:40 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:24:40</nova:creationTime>
Oct 20 02:24:40 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:24:40 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:24:40 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:24:40 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:24:40 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:24:40 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:24:40 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:24:40 user nova-compute[74242]:       <nova:owner>
Oct 20 02:24:40 user nova-compute[74242]:         <nova:user uuid="29cd6130817e4b588ce838dd958b5fd1">tempest-VolumesActionsTest-537401295-project-member</nova:user>
Oct 20 02:24:40 user nova-compute[74242]:         <nova:project uuid="0f4b7d7e4e314e7aa95f8ceb39a0dc95">tempest-VolumesActionsTest-537401295</nova:project>
Oct 20 02:24:40 user nova-compute[74242]:       </nova:owner>
Oct 20 02:24:40 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:24:40 user nova-compute[74242]:       <nova:ports>
Oct 20 02:24:40 user nova-compute[74242]:         <nova:port uuid="db5e8e51-91cc-48c4-bff9-127565a00f36">
Oct 20 02:24:40 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 20 02:24:40 user nova-compute[74242]:         </nova:port>
Oct 20 02:24:40 user nova-compute[74242]:       </nova:ports>
Oct 20 02:24:40 user nova-compute[74242]:     </nova:instance>
Oct 20 02:24:40 user nova-compute[74242]:   </metadata>
Oct 20 02:24:40 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:24:40 user nova-compute[74242]:     <system>
Oct 20 02:24:40 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:24:40 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:24:40 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:24:40 user nova-compute[74242]:       <entry name="serial">3279fb54-306d-4031-8aec-6397554b5c72</entry>
Oct 20 02:24:40 user nova-compute[74242]:       <entry name="uuid">3279fb54-306d-4031-8aec-6397554b5c72</entry>
Oct 20 02:24:40 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:24:40 user nova-compute[74242]:     </system>
Oct 20 02:24:40 user nova-compute[74242]:   </sysinfo>
Oct 20 02:24:40 user nova-compute[74242]:   <os>
Oct 20 02:24:40 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:24:40 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:24:40 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:24:40 user nova-compute[74242]:   </os>
Oct 20 02:24:40 user nova-compute[74242]:   <features>
Oct 20 02:24:40 user nova-compute[74242]:     <acpi/>
Oct 20 02:24:40 user nova-compute[74242]:     <apic/>
Oct 20 02:24:40 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:24:40 user nova-compute[74242]:   </features>
Oct 20 02:24:40 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:24:40 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:24:40 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:24:40 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:24:40 user nova-compute[74242]:   </clock>
Oct 20 02:24:40 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:24:40 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:24:40 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:24:40 user nova-compute[74242]:   </cpu>
Oct 20 02:24:40 user nova-compute[74242]:   <devices>
Oct 20 02:24:40 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:24:40 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:24:40 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk"/>
Oct 20 02:24:40 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:24:40 user nova-compute[74242]:     </disk>
Oct 20 02:24:40 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:24:40 user nova-compute[74242]:       <mac address="fa:16:3e:b5:4c:1a"/>
Oct 20 02:24:40 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:24:40 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:24:40 user nova-compute[74242]:       <target dev="tapdb5e8e51-91"/>
Oct 20 02:24:40 user nova-compute[74242]:     </interface>
Oct 20 02:24:40 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:24:40 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/console.log" append="off"/>
Oct 20 02:24:40 user nova-compute[74242]:     </serial>
Oct 20 02:24:40 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:24:40 user nova-compute[74242]:     <video>
Oct 20 02:24:40 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:24:40 user nova-compute[74242]:     </video>
Oct 20 02:24:40 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:24:40 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:24:40 user nova-compute[74242]:     </rng>
Oct 20 02:24:40 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:24:40 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:24:40 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:24:40 user nova-compute[74242]:     </memballoon>
Oct 20 02:24:40 user nova-compute[74242]:   </devices>
Oct 20 02:24:40 user nova-compute[74242]: </domain>
Oct 20 02:24:40 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1773041437',display_name='tempest-VolumesActionsTest-instance-1773041437',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1773041437',id=41,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0f4b7d7e4e314e7aa95f8ceb39a0dc95',ramdisk_id='',reservation_id='r-zbvv7oak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-537401295',owner_user_name='tempest-VolumesActionsTest-537401295-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:24:39Z,user_data=None,user_id='29cd6130817e4b588ce838dd958b5fd1',uuid=3279fb54-306d-4031-8aec-6397554b5c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db5e8e51-91cc-48c4-bff9-127565a00f36", "address": "fa:16:3e:b5:4c:1a", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5e8e51-91", "ovs_interfaceid": "db5e8e51-91cc-48c4-bff9-127565a00f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Converting VIF {"id": "db5e8e51-91cc-48c4-bff9-127565a00f36", "address": "fa:16:3e:b5:4c:1a", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5e8e51-91", "ovs_interfaceid": "db5e8e51-91cc-48c4-bff9-127565a00f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:4c:1a,bridge_name='br-int',has_traffic_filtering=True,id=db5e8e51-91cc-48c4-bff9-127565a00f36,network=Network(d67e0969-7ca5-47d9-b6c9-68558277b293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5e8e51-91') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG os_vif [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:4c:1a,bridge_name='br-int',has_traffic_filtering=True,id=db5e8e51-91cc-48c4-bff9-127565a00f36,network=Network(d67e0969-7ca5-47d9-b6c9-68558277b293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5e8e51-91') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '92b2af45-d762-5836-a3f2-1eb2d4df602d', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb5e8e51-91, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb5e8e51-91, col_values=(('qos', UUID('db0f30f9-2bd4-4fef-9abe-b5bba1ead981')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb5e8e51-91, col_values=(('external_ids', {'iface-id': 'db5e8e51-91cc-48c4-bff9-127565a00f36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b5:4c:1a', 'vm-uuid': '3279fb54-306d-4031-8aec-6397554b5c72'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:24:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:40 user nova-compute[74242]: INFO os_vif [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:4c:1a,bridge_name='br-int',has_traffic_filtering=True,id=db5e8e51-91cc-48c4-bff9-127565a00f36,network=Network(d67e0969-7ca5-47d9-b6c9-68558277b293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5e8e51-91')
Oct 20 02:24:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:24:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] No VIF found with MAC fa:16:3e:b5:4c:1a, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:24:41 user nova-compute[74242]: DEBUG nova.network.neutron [req-124c19d4-78ea-4b83-a2db-ae822a06a062 req-b1b1af42-1a42-4eab-a5a5-6cb65272847f service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Updated VIF entry in instance network info cache for port db5e8e51-91cc-48c4-bff9-127565a00f36. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:24:41 user nova-compute[74242]: DEBUG nova.network.neutron [req-124c19d4-78ea-4b83-a2db-ae822a06a062 req-b1b1af42-1a42-4eab-a5a5-6cb65272847f service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Updating instance_info_cache with network_info: [{"id": "db5e8e51-91cc-48c4-bff9-127565a00f36", "address": "fa:16:3e:b5:4c:1a", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5e8e51-91", "ovs_interfaceid": "db5e8e51-91cc-48c4-bff9-127565a00f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:24:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-124c19d4-78ea-4b83-a2db-ae822a06a062 req-b1b1af42-1a42-4eab-a5a5-6cb65272847f service nova] Releasing lock "refresh_cache-3279fb54-306d-4031-8aec-6397554b5c72" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:24:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-afc42b16-4150-4e8f-8f70-d5c5490a2341 req-96fac741-c61a-48e0-89f7-247c77fa6998 service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Received event network-vif-plugged-db5e8e51-91cc-48c4-bff9-127565a00f36 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:24:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-afc42b16-4150-4e8f-8f70-d5c5490a2341 req-96fac741-c61a-48e0-89f7-247c77fa6998 service nova] Acquiring lock "3279fb54-306d-4031-8aec-6397554b5c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:24:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-afc42b16-4150-4e8f-8f70-d5c5490a2341 req-96fac741-c61a-48e0-89f7-247c77fa6998 service nova] Lock "3279fb54-306d-4031-8aec-6397554b5c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:24:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-afc42b16-4150-4e8f-8f70-d5c5490a2341 req-96fac741-c61a-48e0-89f7-247c77fa6998 service nova] Lock "3279fb54-306d-4031-8aec-6397554b5c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-afc42b16-4150-4e8f-8f70-d5c5490a2341 req-96fac741-c61a-48e0-89f7-247c77fa6998 service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] No waiting events found dispatching network-vif-plugged-db5e8e51-91cc-48c4-bff9-127565a00f36 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:24:42 user nova-compute[74242]: WARNING nova.compute.manager [req-afc42b16-4150-4e8f-8f70-d5c5490a2341 req-96fac741-c61a-48e0-89f7-247c77fa6998 service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Received unexpected event network-vif-plugged-db5e8e51-91cc-48c4-bff9-127565a00f36 for instance with vm_state building and task_state spawning.
Oct 20 02:24:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:44 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:24:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:24:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:24:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:24:44 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Instance spawned successfully.
Oct 20 02:24:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:24:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-fa1bd02a-40d3-4bda-8107-83784614cf7e req-0044759e-f013-45f9-b796-c174b14655fa service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Received event network-vif-plugged-db5e8e51-91cc-48c4-bff9-127565a00f36 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:24:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fa1bd02a-40d3-4bda-8107-83784614cf7e req-0044759e-f013-45f9-b796-c174b14655fa service nova] Acquiring lock "3279fb54-306d-4031-8aec-6397554b5c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:24:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fa1bd02a-40d3-4bda-8107-83784614cf7e req-0044759e-f013-45f9-b796-c174b14655fa service nova] Lock "3279fb54-306d-4031-8aec-6397554b5c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:24:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-fa1bd02a-40d3-4bda-8107-83784614cf7e req-0044759e-f013-45f9-b796-c174b14655fa service nova] Lock "3279fb54-306d-4031-8aec-6397554b5c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-fa1bd02a-40d3-4bda-8107-83784614cf7e req-0044759e-f013-45f9-b796-c174b14655fa service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] No waiting events found dispatching network-vif-plugged-db5e8e51-91cc-48c4-bff9-127565a00f36 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:24:44 user nova-compute[74242]: WARNING nova.compute.manager [req-fa1bd02a-40d3-4bda-8107-83784614cf7e req-0044759e-f013-45f9-b796-c174b14655fa service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Received unexpected event network-vif-plugged-db5e8e51-91cc-48c4-bff9-127565a00f36 for instance with vm_state building and task_state spawning.
Oct 20 02:24:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:24:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:24:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:24:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:24:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:24:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:24:44 user nova-compute[74242]: INFO nova.compute.manager [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Took 5.68 seconds to spawn the instance on the hypervisor.
Oct 20 02:24:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:24:44 user nova-compute[74242]: INFO nova.compute.manager [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Took 6.56 seconds to build instance.
Oct 20 02:24:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a6e01614-9d78-4c2b-bf20-d35d45452c74 tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "3279fb54-306d-4031-8aec-6397554b5c72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.689s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:45 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:24:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:47 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:24:47 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:24:47 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:24:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:24:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:24:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:47 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:24:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:24:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:24:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:24:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:24:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:24:51 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:24:51 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:24:51 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7433MB free_disk=24.708412170410156GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:24:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:24:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c98e383a-e1e5-4130-9cc6-a9823db0b88c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 876f8f80-9640-43ba-8ec7-0ffe06c82086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 62ca0d11-07be-4998-8404-b4d31f1e57da actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 74295e5c-237c-4992-a21a-6f59fd6ff246 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance cd90bd52-3af1-4d05-89df-2fedc535333f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 8497b901-64fb-44f3-bd07-f584ab799867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3279fb54-306d-4031-8aec-6397554b5c72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:24:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.502s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:24:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:24:56 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:24:56 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:25:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:12 user nova-compute[74242]: INFO nova.compute.manager [None req-be5088f5-9338-4e9c-80f0-f436f7418f50 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Unrescuing
Oct 20 02:25:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be5088f5-9338-4e9c-80f0-f436f7418f50 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "refresh_cache-74295e5c-237c-4992-a21a-6f59fd6ff246" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:25:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be5088f5-9338-4e9c-80f0-f436f7418f50 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquired lock "refresh_cache-74295e5c-237c-4992-a21a-6f59fd6ff246" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:25:12 user nova-compute[74242]: DEBUG nova.network.neutron [None req-be5088f5-9338-4e9c-80f0-f436f7418f50 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:25:12 user nova-compute[74242]: DEBUG nova.network.neutron [None req-be5088f5-9338-4e9c-80f0-f436f7418f50 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Updating instance_info_cache with network_info: [{"id": "6a09ec72-a9d4-49cf-8089-04b50109b631", "address": "fa:16:3e:cd:60:bc", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a09ec72-a9", "ovs_interfaceid": "6a09ec72-a9d4-49cf-8089-04b50109b631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:25:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be5088f5-9338-4e9c-80f0-f436f7418f50 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Releasing lock "refresh_cache-74295e5c-237c-4992-a21a-6f59fd6ff246" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:25:12 user nova-compute[74242]: DEBUG nova.objects.instance [None req-be5088f5-9338-4e9c-80f0-f436f7418f50 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'flavor' on Instance uuid 74295e5c-237c-4992-a21a-6f59fd6ff246 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:25:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:12 user nova-compute[74242]: DEBUG nova.compute.manager [req-8d921c8d-f2e5-4032-988a-a47e53eef91e req-7ff0de28-df4f-4c79-a9f4-fee2e1f3e741 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received event network-vif-unplugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:25:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8d921c8d-f2e5-4032-988a-a47e53eef91e req-7ff0de28-df4f-4c79-a9f4-fee2e1f3e741 service nova] Acquiring lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8d921c8d-f2e5-4032-988a-a47e53eef91e req-7ff0de28-df4f-4c79-a9f4-fee2e1f3e741 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-8d921c8d-f2e5-4032-988a-a47e53eef91e req-7ff0de28-df4f-4c79-a9f4-fee2e1f3e741 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:12 user nova-compute[74242]: DEBUG nova.compute.manager [req-8d921c8d-f2e5-4032-988a-a47e53eef91e req-7ff0de28-df4f-4c79-a9f4-fee2e1f3e741 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] No waiting events found dispatching network-vif-unplugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:25:12 user nova-compute[74242]: WARNING nova.compute.manager [req-8d921c8d-f2e5-4032-988a-a47e53eef91e req-7ff0de28-df4f-4c79-a9f4-fee2e1f3e741 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received unexpected event network-vif-unplugged-6a09ec72-a9d4-49cf-8089-04b50109b631 for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:25:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:13 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Instance destroyed successfully.
Oct 20 02:25:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] Acquiring lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] No waiting events found dispatching network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:25:15 user nova-compute[74242]: WARNING nova.compute.manager [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received unexpected event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:25:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] Acquiring lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] No waiting events found dispatching network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:25:15 user nova-compute[74242]: WARNING nova.compute.manager [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received unexpected event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:25:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] Acquiring lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] No waiting events found dispatching network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:25:15 user nova-compute[74242]: WARNING nova.compute.manager [req-35ee4195-e0be-4d55-930e-ff8fd1a10d91 req-1787f3a0-fd0c-4baf-a16d-6905a47a24b2 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received unexpected event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "62ca0d11-07be-4998-8404-b4d31f1e57da" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "62ca0d11-07be-4998-8404-b4d31f1e57da-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:15 user nova-compute[74242]: INFO nova.compute.manager [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Terminating instance
Oct 20 02:25:15 user nova-compute[74242]: DEBUG nova.compute.manager [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-95e912fe-be66-4c2f-b453-3b1b20eb9a07 req-57f146b0-f145-4818-b90c-aa62327e0431 service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Received event network-vif-unplugged-484c4400-d38e-4b70-9da3-156953fd5c3e {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95e912fe-be66-4c2f-b453-3b1b20eb9a07 req-57f146b0-f145-4818-b90c-aa62327e0431 service nova] Acquiring lock "62ca0d11-07be-4998-8404-b4d31f1e57da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95e912fe-be66-4c2f-b453-3b1b20eb9a07 req-57f146b0-f145-4818-b90c-aa62327e0431 service nova] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-95e912fe-be66-4c2f-b453-3b1b20eb9a07 req-57f146b0-f145-4818-b90c-aa62327e0431 service nova] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-95e912fe-be66-4c2f-b453-3b1b20eb9a07 req-57f146b0-f145-4818-b90c-aa62327e0431 service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] No waiting events found dispatching network-vif-unplugged-484c4400-d38e-4b70-9da3-156953fd5c3e {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-95e912fe-be66-4c2f-b453-3b1b20eb9a07 req-57f146b0-f145-4818-b90c-aa62327e0431 service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Received event network-vif-unplugged-484c4400-d38e-4b70-9da3-156953fd5c3e for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:25:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:16 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Instance destroyed successfully.
Oct 20 02:25:16 user nova-compute[74242]: DEBUG nova.objects.instance [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lazy-loading 'resources' on Instance uuid 62ca0d11-07be-4998-8404-b4d31f1e57da {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:20:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2065440011',display_name='tempest-AttachVolumeNegativeTest-server-2065440011',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2065440011',id=34,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA1y2DRKICypqjUCM0U668QPL0QUC1OHghnOuidc/y6poro9sGRPihGgSG/3LUwEymlLnbxL/jm0luYf93CSAu5Eh14NJvT2ViezybIgiYWP8k8wkJ58X+RdxiRVVwaK5Q==',key_name='tempest-keypair-1026500807',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:20:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e74cc27f49384dc78190bd5d9ed7fab9',ramdisk_id='',reservation_id='r-ib3y0jtu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1292543897',owner_user_name='tempest-AttachVolumeNegativeTest-1292543897-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:20:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d3069dcf63864aa08f632601c3a849c5',uuid=62ca0d11-07be-4998-8404-b4d31f1e57da,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "484c4400-d38e-4b70-9da3-156953fd5c3e", "address": "fa:16:3e:e1:37:0a", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c4400-d3", "ovs_interfaceid": "484c4400-d38e-4b70-9da3-156953fd5c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converting VIF {"id": "484c4400-d38e-4b70-9da3-156953fd5c3e", "address": "fa:16:3e:e1:37:0a", "network": {"id": "482630ea-e0ac-4bb0-9614-7d0a626de5d5", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1418771040-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e74cc27f49384dc78190bd5d9ed7fab9", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap484c4400-d3", "ovs_interfaceid": "484c4400-d38e-4b70-9da3-156953fd5c3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e1:37:0a,bridge_name='br-int',has_traffic_filtering=True,id=484c4400-d38e-4b70-9da3-156953fd5c3e,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484c4400-d3') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG os_vif [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:37:0a,bridge_name='br-int',has_traffic_filtering=True,id=484c4400-d38e-4b70-9da3-156953fd5c3e,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484c4400-d3') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap484c4400-d3, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca48ac25-0108-44e1-9ffd-b40a265156db) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:16 user nova-compute[74242]: INFO os_vif [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e1:37:0a,bridge_name='br-int',has_traffic_filtering=True,id=484c4400-d38e-4b70-9da3-156953fd5c3e,network=Network(482630ea-e0ac-4bb0-9614-7d0a626de5d5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap484c4400-d3')
Oct 20 02:25:16 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Deleting instance files /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da_del
Oct 20 02:25:16 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Deletion of /opt/stack/data/nova/instances/62ca0d11-07be-4998-8404-b4d31f1e57da_del complete
Oct 20 02:25:16 user nova-compute[74242]: INFO nova.compute.manager [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Took 0.74 seconds to destroy the instance on the hypervisor.
Oct 20 02:25:16 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:25:16 user nova-compute[74242]: DEBUG nova.compute.manager [None req-be5088f5-9338-4e9c-80f0-f436f7418f50 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:25:17 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:25:17 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Took 0.79 seconds to deallocate network for instance.
Oct 20 02:25:17 user nova-compute[74242]: DEBUG nova.compute.manager [req-852c8432-711b-4891-a322-2bd8a78494a7 req-f3636d26-0cc8-4af2-908e-757aaf4bf92a service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Received event network-vif-deleted-484c4400-d38e-4b70-9da3-156953fd5c3e {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:25:17 user nova-compute[74242]: INFO nova.compute.manager [req-852c8432-711b-4891-a322-2bd8a78494a7 req-f3636d26-0cc8-4af2-908e-757aaf4bf92a service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Neutron deleted interface 484c4400-d38e-4b70-9da3-156953fd5c3e; detaching it from the instance and deleting it from the info cache
Oct 20 02:25:17 user nova-compute[74242]: DEBUG nova.network.neutron [req-852c8432-711b-4891-a322-2bd8a78494a7 req-f3636d26-0cc8-4af2-908e-757aaf4bf92a service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:25:17 user nova-compute[74242]: DEBUG nova.compute.manager [req-852c8432-711b-4891-a322-2bd8a78494a7 req-f3636d26-0cc8-4af2-908e-757aaf4bf92a service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Detach interface failed, port_id=484c4400-d38e-4b70-9da3-156953fd5c3e, reason: Instance 62ca0d11-07be-4998-8404-b4d31f1e57da could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:25:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:17 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:25:17 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:25:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.431s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:17 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Deleted allocations for instance 62ca0d11-07be-4998-8404-b4d31f1e57da
Oct 20 02:25:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2e363c88-1277-40c3-b6e3-a4399fab2980 tempest-AttachVolumeNegativeTest-1292543897 tempest-AttachVolumeNegativeTest-1292543897-project-member] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.190s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:18 user nova-compute[74242]: DEBUG nova.compute.manager [req-ca06b0ec-0286-493f-8d06-aedc50424945 req-75bb8214-13ea-46a7-9225-15d1e0feee4d service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Received event network-vif-plugged-484c4400-d38e-4b70-9da3-156953fd5c3e {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:25:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ca06b0ec-0286-493f-8d06-aedc50424945 req-75bb8214-13ea-46a7-9225-15d1e0feee4d service nova] Acquiring lock "62ca0d11-07be-4998-8404-b4d31f1e57da-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ca06b0ec-0286-493f-8d06-aedc50424945 req-75bb8214-13ea-46a7-9225-15d1e0feee4d service nova] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ca06b0ec-0286-493f-8d06-aedc50424945 req-75bb8214-13ea-46a7-9225-15d1e0feee4d service nova] Lock "62ca0d11-07be-4998-8404-b4d31f1e57da-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:18 user nova-compute[74242]: DEBUG nova.compute.manager [req-ca06b0ec-0286-493f-8d06-aedc50424945 req-75bb8214-13ea-46a7-9225-15d1e0feee4d service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] No waiting events found dispatching network-vif-plugged-484c4400-d38e-4b70-9da3-156953fd5c3e {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:25:18 user nova-compute[74242]: WARNING nova.compute.manager [req-ca06b0ec-0286-493f-8d06-aedc50424945 req-75bb8214-13ea-46a7-9225-15d1e0feee4d service nova] [instance: 62ca0d11-07be-4998-8404-b4d31f1e57da] Received unexpected event network-vif-plugged-484c4400-d38e-4b70-9da3-156953fd5c3e for instance with vm_state deleted and task_state None.
Oct 20 02:25:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:25:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:25:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:25:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:25:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:25:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:34 user nova-compute[74242]: INFO nova.compute.manager [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Rescuing
Oct 20 02:25:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:25:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquired lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:25:34 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:25:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:35 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Updating instance_info_cache with network_info: [{"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:25:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Releasing lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:25:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-f1762bb8-66f8-4b70-9377-48e7c1867f27 req-abf73df8-54f9-4330-ab4d-50aa13213b36 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received event network-vif-unplugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:25:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f1762bb8-66f8-4b70-9377-48e7c1867f27 req-abf73df8-54f9-4330-ab4d-50aa13213b36 service nova] Acquiring lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f1762bb8-66f8-4b70-9377-48e7c1867f27 req-abf73df8-54f9-4330-ab4d-50aa13213b36 service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f1762bb8-66f8-4b70-9377-48e7c1867f27 req-abf73df8-54f9-4330-ab4d-50aa13213b36 service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-f1762bb8-66f8-4b70-9377-48e7c1867f27 req-abf73df8-54f9-4330-ab4d-50aa13213b36 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] No waiting events found dispatching network-vif-unplugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:25:35 user nova-compute[74242]: WARNING nova.compute.manager [req-f1762bb8-66f8-4b70-9377-48e7c1867f27 req-abf73df8-54f9-4330-ab4d-50aa13213b36 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received unexpected event network-vif-unplugged-3071aff4-dceb-4a18-891e-f189d558cba7 for instance with vm_state active and task_state rescuing.
Oct 20 02:25:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:36 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Instance destroyed successfully.
Oct 20 02:25:36 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Attempting rescue
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74242) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Instance directory exists: not creating {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 02:25:36 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Creating image(s)
Oct 20 02:25:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "/opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "/opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "/opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7b6701b3-86f5-4498-9b45-24d4f53b6e78 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.192s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue" returned: 0 in 0.051s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'migration_context' on Instance uuid 7b6701b3-86f5-4498-9b45-24d4f53b6e78 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.objects.base [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Object Instance<7b6701b3-86f5-4498-9b45-24d4f53b6e78> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Start _get_guest_xml network_info=[{"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "vif_mac": "fa:16:3e:e4:a3:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'resources' on Instance uuid 7b6701b3-86f5-4498-9b45-24d4f53b6e78 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.objects.base [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Object Instance<7b6701b3-86f5-4498-9b45-24d4f53b6e78> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'numa_topology' on Instance uuid 7b6701b3-86f5-4498-9b45-24d4f53b6e78 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.objects.base [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Object Instance<7b6701b3-86f5-4498-9b45-24d4f53b6e78> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:25:36 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:25:36 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7b6701b3-86f5-4498-9b45-24d4f53b6e78 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.objects.base [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Object Instance<7b6701b3-86f5-4498-9b45-24d4f53b6e78> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-798886193',display_name='tempest-ServerRescueNegativeTestJSON-server-798886193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-798886193',id=38,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:23:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80fa40dfb2c84a84b3399b643fcde4c5',ramdisk_id='',reservation_id='r-hl80a7sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-630282540',owner_user_name='tempest-ServerRescueNegativeTestJSON-630282540-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:23:56Z,user_data=None,user_id='c7a7db373740428d89dcda898a04410c',uuid=7b6701b3-86f5-4498-9b45-24d4f53b6e78,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "vif_mac": "fa:16:3e:e4:a3:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converting VIF {"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "vif_mac": "fa:16:3e:e4:a3:fd"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:a3:fd,bridge_name='br-int',has_traffic_filtering=True,id=3071aff4-dceb-4a18-891e-f189d558cba7,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3071aff4-dc') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'pci_devices' on Instance uuid 7b6701b3-86f5-4498-9b45-24d4f53b6e78 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.objects.base [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Object Instance<7b6701b3-86f5-4498-9b45-24d4f53b6e78> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:25:36 user nova-compute[74242]:   <uuid>7b6701b3-86f5-4498-9b45-24d4f53b6e78</uuid>
Oct 20 02:25:36 user nova-compute[74242]:   <name>instance-00000026</name>
Oct 20 02:25:36 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:25:36 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:25:36 user nova-compute[74242]:   <metadata>
Oct 20 02:25:36 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:25:36 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:25:36 user nova-compute[74242]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-798886193</nova:name>
Oct 20 02:25:36 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:25:36</nova:creationTime>
Oct 20 02:25:36 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:25:36 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:25:36 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:25:36 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:25:36 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:25:36 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:25:36 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:25:36 user nova-compute[74242]:       <nova:owner>
Oct 20 02:25:36 user nova-compute[74242]:         <nova:user uuid="c7a7db373740428d89dcda898a04410c">tempest-ServerRescueNegativeTestJSON-630282540-project-member</nova:user>
Oct 20 02:25:36 user nova-compute[74242]:         <nova:project uuid="80fa40dfb2c84a84b3399b643fcde4c5">tempest-ServerRescueNegativeTestJSON-630282540</nova:project>
Oct 20 02:25:36 user nova-compute[74242]:       </nova:owner>
Oct 20 02:25:36 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:25:36 user nova-compute[74242]:       <nova:ports>
Oct 20 02:25:36 user nova-compute[74242]:         <nova:port uuid="3071aff4-dceb-4a18-891e-f189d558cba7">
Oct 20 02:25:36 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 02:25:36 user nova-compute[74242]:         </nova:port>
Oct 20 02:25:36 user nova-compute[74242]:       </nova:ports>
Oct 20 02:25:36 user nova-compute[74242]:     </nova:instance>
Oct 20 02:25:36 user nova-compute[74242]:   </metadata>
Oct 20 02:25:36 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:25:36 user nova-compute[74242]:     <system>
Oct 20 02:25:36 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:25:36 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:25:36 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:25:36 user nova-compute[74242]:       <entry name="serial">7b6701b3-86f5-4498-9b45-24d4f53b6e78</entry>
Oct 20 02:25:36 user nova-compute[74242]:       <entry name="uuid">7b6701b3-86f5-4498-9b45-24d4f53b6e78</entry>
Oct 20 02:25:36 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:25:36 user nova-compute[74242]:     </system>
Oct 20 02:25:36 user nova-compute[74242]:   </sysinfo>
Oct 20 02:25:36 user nova-compute[74242]:   <os>
Oct 20 02:25:36 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:25:36 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:25:36 user nova-compute[74242]:   </os>
Oct 20 02:25:36 user nova-compute[74242]:   <features>
Oct 20 02:25:36 user nova-compute[74242]:     <acpi/>
Oct 20 02:25:36 user nova-compute[74242]:     <apic/>
Oct 20 02:25:36 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:25:36 user nova-compute[74242]:   </features>
Oct 20 02:25:36 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:25:36 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:25:36 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:25:36 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:25:36 user nova-compute[74242]:   </clock>
Oct 20 02:25:36 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:25:36 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:25:36 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:25:36 user nova-compute[74242]:   </cpu>
Oct 20 02:25:36 user nova-compute[74242]:   <devices>
Oct 20 02:25:36 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:25:36 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:25:36 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue"/>
Oct 20 02:25:36 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:25:36 user nova-compute[74242]:     </disk>
Oct 20 02:25:36 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:25:36 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:25:36 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk"/>
Oct 20 02:25:36 user nova-compute[74242]:       <target dev="vdb" bus="virtio"/>
Oct 20 02:25:36 user nova-compute[74242]:     </disk>
Oct 20 02:25:36 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:25:36 user nova-compute[74242]:       <mac address="fa:16:3e:e4:a3:fd"/>
Oct 20 02:25:36 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:25:36 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:25:36 user nova-compute[74242]:       <target dev="tap3071aff4-dc"/>
Oct 20 02:25:36 user nova-compute[74242]:     </interface>
Oct 20 02:25:36 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:25:36 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/console.log" append="off"/>
Oct 20 02:25:36 user nova-compute[74242]:     </serial>
Oct 20 02:25:36 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:25:36 user nova-compute[74242]:     <video>
Oct 20 02:25:36 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:25:36 user nova-compute[74242]:     </video>
Oct 20 02:25:36 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:25:36 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:25:36 user nova-compute[74242]:     </rng>
Oct 20 02:25:36 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:25:36 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:25:36 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:25:36 user nova-compute[74242]:     </memballoon>
Oct 20 02:25:36 user nova-compute[74242]:   </devices>
Oct 20 02:25:36 user nova-compute[74242]: </domain>
Oct 20 02:25:36 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:25:36 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Instance destroyed successfully.
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:25:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No VIF found with MAC fa:16:3e:e4:a3:fd, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:25:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-47c19be7-5dbe-4a07-8027-7310770b2d8f req-14c5789e-b178-4984-8680-650c1484f01b service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received event network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:25:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-47c19be7-5dbe-4a07-8027-7310770b2d8f req-14c5789e-b178-4984-8680-650c1484f01b service nova] Acquiring lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-47c19be7-5dbe-4a07-8027-7310770b2d8f req-14c5789e-b178-4984-8680-650c1484f01b service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-47c19be7-5dbe-4a07-8027-7310770b2d8f req-14c5789e-b178-4984-8680-650c1484f01b service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-47c19be7-5dbe-4a07-8027-7310770b2d8f req-14c5789e-b178-4984-8680-650c1484f01b service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] No waiting events found dispatching network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:25:37 user nova-compute[74242]: WARNING nova.compute.manager [req-47c19be7-5dbe-4a07-8027-7310770b2d8f req-14c5789e-b178-4984-8680-650c1484f01b service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received unexpected event network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 for instance with vm_state active and task_state rescuing.
Oct 20 02:25:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-20fd4f9e-5922-48ab-96ea-19444db5866d req-7b4fa8d5-28f8-4a3f-8e36-a1c7adec1700 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received event network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:25:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-20fd4f9e-5922-48ab-96ea-19444db5866d req-7b4fa8d5-28f8-4a3f-8e36-a1c7adec1700 service nova] Acquiring lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-20fd4f9e-5922-48ab-96ea-19444db5866d req-7b4fa8d5-28f8-4a3f-8e36-a1c7adec1700 service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-20fd4f9e-5922-48ab-96ea-19444db5866d req-7b4fa8d5-28f8-4a3f-8e36-a1c7adec1700 service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-20fd4f9e-5922-48ab-96ea-19444db5866d req-7b4fa8d5-28f8-4a3f-8e36-a1c7adec1700 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] No waiting events found dispatching network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:25:39 user nova-compute[74242]: WARNING nova.compute.manager [req-20fd4f9e-5922-48ab-96ea-19444db5866d req-7b4fa8d5-28f8-4a3f-8e36-a1c7adec1700 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received unexpected event network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 for instance with vm_state active and task_state rescuing.
Oct 20 02:25:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-20fd4f9e-5922-48ab-96ea-19444db5866d req-7b4fa8d5-28f8-4a3f-8e36-a1c7adec1700 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received event network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:25:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-20fd4f9e-5922-48ab-96ea-19444db5866d req-7b4fa8d5-28f8-4a3f-8e36-a1c7adec1700 service nova] Acquiring lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-20fd4f9e-5922-48ab-96ea-19444db5866d req-7b4fa8d5-28f8-4a3f-8e36-a1c7adec1700 service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-20fd4f9e-5922-48ab-96ea-19444db5866d req-7b4fa8d5-28f8-4a3f-8e36-a1c7adec1700 service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-20fd4f9e-5922-48ab-96ea-19444db5866d req-7b4fa8d5-28f8-4a3f-8e36-a1c7adec1700 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] No waiting events found dispatching network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:25:39 user nova-compute[74242]: WARNING nova.compute.manager [req-20fd4f9e-5922-48ab-96ea-19444db5866d req-7b4fa8d5-28f8-4a3f-8e36-a1c7adec1700 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received unexpected event network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 for instance with vm_state active and task_state rescuing.
Oct 20 02:25:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:40 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1b6919fc-d31f-422c-8b71-a25cc1ed6b64 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:25:40 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:25:41 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:25:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:42 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:25:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:25:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:25:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-39a5ba0f-e581-49c3-a179-62d6c333fa59" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:25:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-39a5ba0f-e581-49c3-a179-62d6c333fa59" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:25:42 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:25:42 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid 39a5ba0f-e581-49c3-a179-62d6c333fa59 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:25:42 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Updating instance_info_cache with network_info: [{"id": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "address": "fa:16:3e:79:1a:39", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57aa37e7-d4", "ovs_interfaceid": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:25:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-39a5ba0f-e581-49c3-a179-62d6c333fa59" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:25:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:25:44 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:25:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:25:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:45 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:25:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "cd90bd52-3af1-4d05-89df-2fedc535333f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG nova.objects.instance [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lazy-loading 'flavor' on Instance uuid cd90bd52-3af1-4d05-89df-2fedc535333f {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "cd90bd52-3af1-4d05-89df-2fedc535333f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:47 user nova-compute[74242]: INFO nova.compute.manager [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Attaching volume 178359d2-67f6-4df9-9255-1db6d1c0e7d0 to /dev/vdb
Oct 20 02:25:47 user nova-compute[74242]: DEBUG os_brick.utils [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[46afbcd3-8239-4cb4-9a5b-7b936ca191e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed128de-5f7e-4a36-a70c-6d4e11c9ed16]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1648179-cbcb-41b3-8386-23b4fbbf7829]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[522cd08f-8692-4a5a-ab54-110dd27e3abf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:25:47 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:25:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[903e9f3f-13c7-48b9-9ec1-8d8909cb7f01]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG os_brick.utils [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:25:47 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Updating existing volume attachment record: a5e83f81-3bde-40b0-b2af-91b1fec84799 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:25:48 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-0dea2aea-4691-45b1-92a9-05683e1a2346 req-ace653ab-ae55-4de9-9f83-a2273b3d7e53 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-changed-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-0dea2aea-4691-45b1-92a9-05683e1a2346 req-ace653ab-ae55-4de9-9f83-a2273b3d7e53 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Refreshing instance network info cache due to event network-changed-df5d650c-5e5c-4822-8154-7fc1213190b4. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0dea2aea-4691-45b1-92a9-05683e1a2346 req-ace653ab-ae55-4de9-9f83-a2273b3d7e53 service nova] Acquiring lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0dea2aea-4691-45b1-92a9-05683e1a2346 req-ace653ab-ae55-4de9-9f83-a2273b3d7e53 service nova] Acquired lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG nova.network.neutron [req-0dea2aea-4691-45b1-92a9-05683e1a2346 req-ace653ab-ae55-4de9-9f83-a2273b3d7e53 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Refreshing network info cache for port df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:50 user nova-compute[74242]: DEBUG nova.network.neutron [req-0dea2aea-4691-45b1-92a9-05683e1a2346 req-ace653ab-ae55-4de9-9f83-a2273b3d7e53 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updated VIF entry in instance network info cache for port df5d650c-5e5c-4822-8154-7fc1213190b4. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:25:50 user nova-compute[74242]: DEBUG nova.network.neutron [req-0dea2aea-4691-45b1-92a9-05683e1a2346 req-ace653ab-ae55-4de9-9f83-a2273b3d7e53 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updating instance_info_cache with network_info: [{"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:25:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0dea2aea-4691-45b1-92a9-05683e1a2346 req-ace653ab-ae55-4de9-9f83-a2273b3d7e53 service nova] Releasing lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:25:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:25:50 user nova-compute[74242]: INFO nova.compute.manager [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] instance snapshotting
Oct 20 02:25:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:50 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Beginning live snapshot process
Oct 20 02:25:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json -f qcow2 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json -f qcow2" returned: 0 in 0.196s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json -f qcow2 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.216s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp084zejk6/379bf1eff2c9410797630e6bf5128df5.delta 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp084zejk6/379bf1eff2c9410797630e6bf5128df5.delta 1073741824" returned: 0 in 0.089s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:51 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:25:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:25:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:25:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:25:53 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 02:25:53 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp084zejk6/379bf1eff2c9410797630e6bf5128df5.delta /opt/stack/data/nova/instances/snapshots/tmp084zejk6/379bf1eff2c9410797630e6bf5128df5 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp084zejk6/379bf1eff2c9410797630e6bf5128df5.delta /opt/stack/data/nova/instances/snapshots/tmp084zejk6/379bf1eff2c9410797630e6bf5128df5" returned: 0 in 0.656s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:25:53 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Snapshot extracted, beginning image upload
Oct 20 02:25:53 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:25:53 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:25:53 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7623MB free_disk=24.698223114013672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c98e383a-e1e5-4130-9cc6-a9823db0b88c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 876f8f80-9640-43ba-8ec7-0ffe06c82086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 74295e5c-237c-4992-a21a-6f59fd6ff246 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance cd90bd52-3af1-4d05-89df-2fedc535333f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 8497b901-64fb-44f3-bd07-f584ab799867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3279fb54-306d-4031-8aec-6397554b5c72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:25:53 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:25:54 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:25:54 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:25:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:25:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.509s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:25:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:56 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Snapshot image upload complete
Oct 20 02:25:56 user nova-compute[74242]: INFO nova.compute.manager [None req-fa64ac37-f60d-4a39-bdbf-7a113d465ba5 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Took 5.42 seconds to snapshot the instance on the hypervisor.
Oct 20 02:25:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:25:57 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:26:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:26:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "3279fb54-306d-4031-8aec-6397554b5c72" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "3279fb54-306d-4031-8aec-6397554b5c72" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "3279fb54-306d-4031-8aec-6397554b5c72-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "3279fb54-306d-4031-8aec-6397554b5c72-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "3279fb54-306d-4031-8aec-6397554b5c72-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:28 user nova-compute[74242]: INFO nova.compute.manager [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Terminating instance
Oct 20 02:26:28 user nova-compute[74242]: DEBUG nova.compute.manager [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-9ff85b23-11c0-4e4f-8bc9-2e56f49165e3 req-8d61490d-4e45-4bda-ab4e-a333aa622961 service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Received event network-vif-unplugged-db5e8e51-91cc-48c4-bff9-127565a00f36 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9ff85b23-11c0-4e4f-8bc9-2e56f49165e3 req-8d61490d-4e45-4bda-ab4e-a333aa622961 service nova] Acquiring lock "3279fb54-306d-4031-8aec-6397554b5c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9ff85b23-11c0-4e4f-8bc9-2e56f49165e3 req-8d61490d-4e45-4bda-ab4e-a333aa622961 service nova] Lock "3279fb54-306d-4031-8aec-6397554b5c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9ff85b23-11c0-4e4f-8bc9-2e56f49165e3 req-8d61490d-4e45-4bda-ab4e-a333aa622961 service nova] Lock "3279fb54-306d-4031-8aec-6397554b5c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-9ff85b23-11c0-4e4f-8bc9-2e56f49165e3 req-8d61490d-4e45-4bda-ab4e-a333aa622961 service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] No waiting events found dispatching network-vif-unplugged-db5e8e51-91cc-48c4-bff9-127565a00f36 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-9ff85b23-11c0-4e4f-8bc9-2e56f49165e3 req-8d61490d-4e45-4bda-ab4e-a333aa622961 service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Received event network-vif-unplugged-db5e8e51-91cc-48c4-bff9-127565a00f36 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:26:29 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Instance destroyed successfully.
Oct 20 02:26:29 user nova-compute[74242]: DEBUG nova.objects.instance [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lazy-loading 'resources' on Instance uuid 3279fb54-306d-4031-8aec-6397554b5c72 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:24:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1773041437',display_name='tempest-VolumesActionsTest-instance-1773041437',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1773041437',id=41,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:24:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0f4b7d7e4e314e7aa95f8ceb39a0dc95',ramdisk_id='',reservation_id='r-zbvv7oak',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-537401295',owner_user_name='tempest-VolumesActionsTest-537401295-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:24:45Z,user_data=None,user_id='29cd6130817e4b588ce838dd958b5fd1',uuid=3279fb54-306d-4031-8aec-6397554b5c72,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db5e8e51-91cc-48c4-bff9-127565a00f36", "address": "fa:16:3e:b5:4c:1a", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5e8e51-91", "ovs_interfaceid": "db5e8e51-91cc-48c4-bff9-127565a00f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Converting VIF {"id": "db5e8e51-91cc-48c4-bff9-127565a00f36", "address": "fa:16:3e:b5:4c:1a", "network": {"id": "d67e0969-7ca5-47d9-b6c9-68558277b293", "bridge": "br-int", "label": "tempest-VolumesActionsTest-842971109-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0f4b7d7e4e314e7aa95f8ceb39a0dc95", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb5e8e51-91", "ovs_interfaceid": "db5e8e51-91cc-48c4-bff9-127565a00f36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b5:4c:1a,bridge_name='br-int',has_traffic_filtering=True,id=db5e8e51-91cc-48c4-bff9-127565a00f36,network=Network(d67e0969-7ca5-47d9-b6c9-68558277b293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5e8e51-91') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG os_vif [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:4c:1a,bridge_name='br-int',has_traffic_filtering=True,id=db5e8e51-91cc-48c4-bff9-127565a00f36,network=Network(d67e0969-7ca5-47d9-b6c9-68558277b293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5e8e51-91') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb5e8e51-91, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db0f30f9-2bd4-4fef-9abe-b5bba1ead981) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:26:29 user nova-compute[74242]: INFO os_vif [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b5:4c:1a,bridge_name='br-int',has_traffic_filtering=True,id=db5e8e51-91cc-48c4-bff9-127565a00f36,network=Network(d67e0969-7ca5-47d9-b6c9-68558277b293),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb5e8e51-91')
Oct 20 02:26:29 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Deleting instance files /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72_del
Oct 20 02:26:29 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Deletion of /opt/stack/data/nova/instances/3279fb54-306d-4031-8aec-6397554b5c72_del complete
Oct 20 02:26:29 user nova-compute[74242]: INFO nova.compute.manager [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Took 0.73 seconds to destroy the instance on the hypervisor.
Oct 20 02:26:29 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:26:29 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:26:30 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Took 0.46 seconds to deallocate network for instance.
Oct 20 02:26:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-1dc19da0-e389-4572-81ac-2c8b881b1292 req-e3294b4c-a405-4975-b541-b7c8cb74d674 service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Received event network-vif-deleted-db5e8e51-91cc-48c4-bff9-127565a00f36 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:26:30 user nova-compute[74242]: INFO nova.compute.manager [req-1dc19da0-e389-4572-81ac-2c8b881b1292 req-e3294b4c-a405-4975-b541-b7c8cb74d674 service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Neutron deleted interface db5e8e51-91cc-48c4-bff9-127565a00f36; detaching it from the instance and deleting it from the info cache
Oct 20 02:26:30 user nova-compute[74242]: DEBUG nova.network.neutron [req-1dc19da0-e389-4572-81ac-2c8b881b1292 req-e3294b4c-a405-4975-b541-b7c8cb74d674 service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-1dc19da0-e389-4572-81ac-2c8b881b1292 req-e3294b4c-a405-4975-b541-b7c8cb74d674 service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Detach interface failed, port_id=db5e8e51-91cc-48c4-bff9-127565a00f36, reason: Instance 3279fb54-306d-4031-8aec-6397554b5c72 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEVnXUSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:26:30 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:26:30 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:26:30 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[439a532c-1fc1-4687-afcf-2dd65c9b1b62]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:26:30 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:30 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Deleted allocations for instance 3279fb54-306d-4031-8aec-6397554b5c72
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f8d276c-a762-4912-a249-e68cd144973c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0] added
Oct 20 02:26:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b6cce3-c58e-44cc-b615-f45a86c2535c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b76988-2e48-4f56-915f-88fbe31f136c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GEVnXUSj {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6d3f9a75-c6d1-495d-8439-335b289a3c3b tempest-VolumesActionsTest-537401295 tempest-VolumesActionsTest-537401295-project-member] Lock "3279fb54-306d-4031-8aec-6397554b5c72" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.747s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GEVnXUSj" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0ea84a-ce8e-4740-a16c-1b9431a1bf7b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GEVnXUSj'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d37e477-e03f-4d94-88af-55d2bdc9c326]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d7b4c64-ac5b-473d-9a14-2b3c23df9740]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:26:30 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:26:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:26:30 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:26:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a740ffde-b27c-4d70-8ded-d94b40a152a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0, portal: 172.16.0.220,3260]
Oct 20 02:26:30 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0, portal: 172.16.0.220,3260] successful.
Oct 20 02:26:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d4529d-c9de-4cd5-b03b-51140f7c1a0f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[43ce8ec1-05ee-46a7-9ab8-55b8975e7d47]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:26:30 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:26:30 user nova-compute[74242]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)
Oct 20 02:26:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:26:30 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:26:30 user nova-compute[74242]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)
Oct 20 02:26:30 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] HCTL ('35', '-', '-', 0) found on session 46 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6a85bc-821d-4aef-b8bb-829411dae581]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:26:30 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:26:31 user nova-compute[74242]: DEBUG nova.compute.manager [req-a050e6f0-1cb8-4f98-88ed-1ac979f28903 req-64d38695-96ef-44b7-a125-0e3c9b2e0570 service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Received event network-vif-plugged-db5e8e51-91cc-48c4-bff9-127565a00f36 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:26:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a050e6f0-1cb8-4f98-88ed-1ac979f28903 req-64d38695-96ef-44b7-a125-0e3c9b2e0570 service nova] Acquiring lock "3279fb54-306d-4031-8aec-6397554b5c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a050e6f0-1cb8-4f98-88ed-1ac979f28903 req-64d38695-96ef-44b7-a125-0e3c9b2e0570 service nova] Lock "3279fb54-306d-4031-8aec-6397554b5c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a050e6f0-1cb8-4f98-88ed-1ac979f28903 req-64d38695-96ef-44b7-a125-0e3c9b2e0570 service nova] Lock "3279fb54-306d-4031-8aec-6397554b5c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:31 user nova-compute[74242]: DEBUG nova.compute.manager [req-a050e6f0-1cb8-4f98-88ed-1ac979f28903 req-64d38695-96ef-44b7-a125-0e3c9b2e0570 service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] No waiting events found dispatching network-vif-plugged-db5e8e51-91cc-48c4-bff9-127565a00f36 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:26:31 user nova-compute[74242]: WARNING nova.compute.manager [req-a050e6f0-1cb8-4f98-88ed-1ac979f28903 req-64d38695-96ef-44b7-a125-0e3c9b2e0570 service nova] [instance: 3279fb54-306d-4031-8aec-6397554b5c72] Received unexpected event network-vif-plugged-db5e8e51-91cc-48c4-bff9-127565a00f36 for instance with vm_state deleted and task_state None.
Oct 20 02:26:31 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Searching for a device in session 46 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:26:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEVnXUSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:26:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:26:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23562623364393563', 'path': '/dev/sdd'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:26:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23562623364393563', 'path': '/dev/sdd'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:26:31 user nova-compute[74242]: DEBUG nova.objects.instance [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lazy-loading 'flavor' on Instance uuid cd90bd52-3af1-4d05-89df-2fedc535333f {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:26:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:26:31 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:26:31 user nova-compute[74242]:   <source dev="/dev/sdd"/>
Oct 20 02:26:31 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:26:31 user nova-compute[74242]:   <serial>178359d2-67f6-4df9-9255-1db6d1c0e7d0</serial>
Oct 20 02:26:31 user nova-compute[74242]: </disk>
Oct 20 02:26:31 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:26:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:26:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:26:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] No VIF found with MAC fa:16:3e:82:c4:e7, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:26:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-40078b97-7398-4083-a81e-86df1750e082 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.894s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-9dc6bf13-be52-4ff5-9943-4267d156cfb6 req-cd255122-948e-43b9-9ddc-914b3d7fb75a service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received event network-changed-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:26:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-9dc6bf13-be52-4ff5-9943-4267d156cfb6 req-cd255122-948e-43b9-9ddc-914b3d7fb75a service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Refreshing instance network info cache due to event network-changed-2c2d23fe-8f7f-4ed8-8d59-a9494654c051. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:26:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9dc6bf13-be52-4ff5-9943-4267d156cfb6 req-cd255122-948e-43b9-9ddc-914b3d7fb75a service nova] Acquiring lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:26:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9dc6bf13-be52-4ff5-9943-4267d156cfb6 req-cd255122-948e-43b9-9ddc-914b3d7fb75a service nova] Acquired lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:26:35 user nova-compute[74242]: DEBUG nova.network.neutron [req-9dc6bf13-be52-4ff5-9943-4267d156cfb6 req-cd255122-948e-43b9-9ddc-914b3d7fb75a service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Refreshing network info cache for port 2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:26:35 user nova-compute[74242]: DEBUG nova.network.neutron [req-9dc6bf13-be52-4ff5-9943-4267d156cfb6 req-cd255122-948e-43b9-9ddc-914b3d7fb75a service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Updated VIF entry in instance network info cache for port 2c2d23fe-8f7f-4ed8-8d59-a9494654c051. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:26:35 user nova-compute[74242]: DEBUG nova.network.neutron [req-9dc6bf13-be52-4ff5-9943-4267d156cfb6 req-cd255122-948e-43b9-9ddc-914b3d7fb75a service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Updating instance_info_cache with network_info: [{"id": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "address": "fa:16:3e:82:c4:e7", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2d23fe-8f", "ovs_interfaceid": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:26:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9dc6bf13-be52-4ff5-9943-4267d156cfb6 req-cd255122-948e-43b9-9ddc-914b3d7fb75a service nova] Releasing lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:26:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-c531d70f-c73f-4d8b-9fba-9ad8daa98d74 req-d5cc4ac3-e7b2-4fc1-8272-abd3087b5daa service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received event network-changed-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:26:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-c531d70f-c73f-4d8b-9fba-9ad8daa98d74 req-d5cc4ac3-e7b2-4fc1-8272-abd3087b5daa service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Refreshing instance network info cache due to event network-changed-2c2d23fe-8f7f-4ed8-8d59-a9494654c051. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:26:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c531d70f-c73f-4d8b-9fba-9ad8daa98d74 req-d5cc4ac3-e7b2-4fc1-8272-abd3087b5daa service nova] Acquiring lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:26:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c531d70f-c73f-4d8b-9fba-9ad8daa98d74 req-d5cc4ac3-e7b2-4fc1-8272-abd3087b5daa service nova] Acquired lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:26:38 user nova-compute[74242]: DEBUG nova.network.neutron [req-c531d70f-c73f-4d8b-9fba-9ad8daa98d74 req-d5cc4ac3-e7b2-4fc1-8272-abd3087b5daa service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Refreshing network info cache for port 2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:26:39 user nova-compute[74242]: DEBUG nova.network.neutron [req-c531d70f-c73f-4d8b-9fba-9ad8daa98d74 req-d5cc4ac3-e7b2-4fc1-8272-abd3087b5daa service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Updated VIF entry in instance network info cache for port 2c2d23fe-8f7f-4ed8-8d59-a9494654c051. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:26:39 user nova-compute[74242]: DEBUG nova.network.neutron [req-c531d70f-c73f-4d8b-9fba-9ad8daa98d74 req-d5cc4ac3-e7b2-4fc1-8272-abd3087b5daa service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Updating instance_info_cache with network_info: [{"id": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "address": "fa:16:3e:82:c4:e7", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2d23fe-8f", "ovs_interfaceid": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:26:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c531d70f-c73f-4d8b-9fba-9ad8daa98d74 req-d5cc4ac3-e7b2-4fc1-8272-abd3087b5daa service nova] Releasing lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:26:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9048393b-8400-49e6-9759-fc9e3b1b31d1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "cd90bd52-3af1-4d05-89df-2fedc535333f" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9048393b-8400-49e6-9759-fc9e3b1b31d1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:39 user nova-compute[74242]: INFO nova.compute.manager [None req-9048393b-8400-49e6-9759-fc9e3b1b31d1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Rebooting instance
Oct 20 02:26:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9048393b-8400-49e6-9759-fc9e3b1b31d1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:26:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9048393b-8400-49e6-9759-fc9e3b1b31d1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquired lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:26:39 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9048393b-8400-49e6-9759-fc9e3b1b31d1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:26:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:26:39 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9048393b-8400-49e6-9759-fc9e3b1b31d1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Updating instance_info_cache with network_info: [{"id": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "address": "fa:16:3e:82:c4:e7", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2d23fe-8f", "ovs_interfaceid": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:26:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9048393b-8400-49e6-9759-fc9e3b1b31d1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Releasing lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:26:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9048393b-8400-49e6-9759-fc9e3b1b31d1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:26:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:40 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:26:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:40 user nova-compute[74242]: INFO nova.compute.manager [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Terminating instance
Oct 20 02:26:40 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:26:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-7ed23662-2d26-4a38-9e76-d28fa924ecd8 req-a7a5e39d-0338-4aed-a80e-d40ecec8ca0f service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Received event network-vif-unplugged-29619557-d774-41f6-9094-cfce655bcd27 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7ed23662-2d26-4a38-9e76-d28fa924ecd8 req-a7a5e39d-0338-4aed-a80e-d40ecec8ca0f service nova] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7ed23662-2d26-4a38-9e76-d28fa924ecd8 req-a7a5e39d-0338-4aed-a80e-d40ecec8ca0f service nova] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7ed23662-2d26-4a38-9e76-d28fa924ecd8 req-a7a5e39d-0338-4aed-a80e-d40ecec8ca0f service nova] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-7ed23662-2d26-4a38-9e76-d28fa924ecd8 req-a7a5e39d-0338-4aed-a80e-d40ecec8ca0f service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] No waiting events found dispatching network-vif-unplugged-29619557-d774-41f6-9094-cfce655bcd27 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-7ed23662-2d26-4a38-9e76-d28fa924ecd8 req-a7a5e39d-0338-4aed-a80e-d40ecec8ca0f service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Received event network-vif-unplugged-29619557-d774-41f6-9094-cfce655bcd27 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:26:41 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Instance destroyed successfully.
Oct 20 02:26:41 user nova-compute[74242]: DEBUG nova.objects.instance [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lazy-loading 'resources' on Instance uuid 5f96c71b-c391-42bd-8ac8-53ece7b302f5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:16:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1329325275',display_name='tempest-SnapshotDataIntegrityTests-server-1329325275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1329325275',id=30,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIiSXYFYGfUSraVsyGtd9r3KWI7RVgsKq3cTlz/zgtArLKh6HAxpaQ8leLb8KWga2aKLA16p62OMgB4BpLBPXQjqF/pmba/PF1P3Fz96U5oFyVIEru+aLgIwgNQDKVYvqw==',key_name='tempest-keypair-76504524',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:16:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a3a254f1387b4b929f5396d1db6c4ef8',ramdisk_id='',reservation_id='r-dr0cc6kx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1374608529',owner_user_name='tempest-SnapshotDataIntegrityTests-1374608529-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:16:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c45749e114d745b3a9b15b45a9064430',uuid=5f96c71b-c391-42bd-8ac8-53ece7b302f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "29619557-d774-41f6-9094-cfce655bcd27", "address": "fa:16:3e:6b:ed:0a", "network": {"id": "694ee4ba-c5b8-4c34-a5c3-1bb34288136f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1990549718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3a254f1387b4b929f5396d1db6c4ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29619557-d7", "ovs_interfaceid": "29619557-d774-41f6-9094-cfce655bcd27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Converting VIF {"id": "29619557-d774-41f6-9094-cfce655bcd27", "address": "fa:16:3e:6b:ed:0a", "network": {"id": "694ee4ba-c5b8-4c34-a5c3-1bb34288136f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1990549718-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a3a254f1387b4b929f5396d1db6c4ef8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap29619557-d7", "ovs_interfaceid": "29619557-d774-41f6-9094-cfce655bcd27", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6b:ed:0a,bridge_name='br-int',has_traffic_filtering=True,id=29619557-d774-41f6-9094-cfce655bcd27,network=Network(694ee4ba-c5b8-4c34-a5c3-1bb34288136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29619557-d7') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG os_vif [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:ed:0a,bridge_name='br-int',has_traffic_filtering=True,id=29619557-d774-41f6-9094-cfce655bcd27,network=Network(694ee4ba-c5b8-4c34-a5c3-1bb34288136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29619557-d7') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap29619557-d7, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e4302d7-f5a9-4a94-bb12-bb1628ab7e1e) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:26:41 user nova-compute[74242]: INFO os_vif [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6b:ed:0a,bridge_name='br-int',has_traffic_filtering=True,id=29619557-d774-41f6-9094-cfce655bcd27,network=Network(694ee4ba-c5b8-4c34-a5c3-1bb34288136f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap29619557-d7')
Oct 20 02:26:41 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Deleting instance files /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5_del
Oct 20 02:26:41 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Deletion of /opt/stack/data/nova/instances/5f96c71b-c391-42bd-8ac8-53ece7b302f5_del complete
Oct 20 02:26:41 user nova-compute[74242]: INFO nova.compute.manager [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 02:26:41 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:26:41 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:26:42 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:26:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-79acf56f-e6f2-4601-9974-887739ec4f44 req-f4dc4c68-f915-4e2a-8100-84b90850f868 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received event network-vif-unplugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:26:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-79acf56f-e6f2-4601-9974-887739ec4f44 req-f4dc4c68-f915-4e2a-8100-84b90850f868 service nova] Acquiring lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-79acf56f-e6f2-4601-9974-887739ec4f44 req-f4dc4c68-f915-4e2a-8100-84b90850f868 service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-79acf56f-e6f2-4601-9974-887739ec4f44 req-f4dc4c68-f915-4e2a-8100-84b90850f868 service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-79acf56f-e6f2-4601-9974-887739ec4f44 req-f4dc4c68-f915-4e2a-8100-84b90850f868 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] No waiting events found dispatching network-vif-unplugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:26:42 user nova-compute[74242]: WARNING nova.compute.manager [req-79acf56f-e6f2-4601-9974-887739ec4f44 req-f4dc4c68-f915-4e2a-8100-84b90850f868 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received unexpected event network-vif-unplugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 for instance with vm_state active and task_state reboot_started.
Oct 20 02:26:42 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:26:42 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Took 1.16 seconds to deallocate network for instance.
Oct 20 02:26:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:42 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9048393b-8400-49e6-9759-fc9e3b1b31d1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Instance shutdown successfully.
Oct 20 02:26:43 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:26:43 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:26:43 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7e88a42-326e-4636-aac9-0a00bff8b0a4 req-e77f768c-583a-4393-b722-ca9d23ea8680 service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Received event network-vif-plugged-29619557-d774-41f6-9094-cfce655bcd27 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:26:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7e88a42-326e-4636-aac9-0a00bff8b0a4 req-e77f768c-583a-4393-b722-ca9d23ea8680 service nova] Acquiring lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7e88a42-326e-4636-aac9-0a00bff8b0a4 req-e77f768c-583a-4393-b722-ca9d23ea8680 service nova] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b7e88a42-326e-4636-aac9-0a00bff8b0a4 req-e77f768c-583a-4393-b722-ca9d23ea8680 service nova] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:43 user nova-compute[74242]: DEBUG nova.compute.manager [req-b7e88a42-326e-4636-aac9-0a00bff8b0a4 req-e77f768c-583a-4393-b722-ca9d23ea8680 service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] No waiting events found dispatching network-vif-plugged-29619557-d774-41f6-9094-cfce655bcd27 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:26:43 user nova-compute[74242]: WARNING nova.compute.manager [req-b7e88a42-326e-4636-aac9-0a00bff8b0a4 req-e77f768c-583a-4393-b722-ca9d23ea8680 service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Received unexpected event network-vif-plugged-29619557-d774-41f6-9094-cfce655bcd27 for instance with vm_state deleted and task_state None.
Oct 20 02:26:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.313s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:43 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:26:43 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:26:43 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Deleted allocations for instance 5f96c71b-c391-42bd-8ac8-53ece7b302f5
Oct 20 02:26:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:26:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:26:43 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:26:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9b68bf2d-6907-4583-aa1f-f5873742ffc2 tempest-SnapshotDataIntegrityTests-1374608529 tempest-SnapshotDataIntegrityTests-1374608529-project-member] Lock "5f96c71b-c391-42bd-8ac8-53ece7b302f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.556s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:43 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Updating instance_info_cache with network_info: [{"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:26:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-c98e383a-e1e5-4130-9cc6-a9823db0b88c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:26:43 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:26:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-27326cfa-bf40-4711-ab47-f43275a53005 req-a5c9ef79-5202-42f9-a654-08513d662be3 service nova] [instance: 5f96c71b-c391-42bd-8ac8-53ece7b302f5] Received event network-vif-deleted-29619557-d774-41f6-9094-cfce655bcd27 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:26:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-27326cfa-bf40-4711-ab47-f43275a53005 req-a5c9ef79-5202-42f9-a654-08513d662be3 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received event network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:26:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-27326cfa-bf40-4711-ab47-f43275a53005 req-a5c9ef79-5202-42f9-a654-08513d662be3 service nova] Acquiring lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-27326cfa-bf40-4711-ab47-f43275a53005 req-a5c9ef79-5202-42f9-a654-08513d662be3 service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-27326cfa-bf40-4711-ab47-f43275a53005 req-a5c9ef79-5202-42f9-a654-08513d662be3 service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-27326cfa-bf40-4711-ab47-f43275a53005 req-a5c9ef79-5202-42f9-a654-08513d662be3 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] No waiting events found dispatching network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:26:44 user nova-compute[74242]: WARNING nova.compute.manager [req-27326cfa-bf40-4711-ab47-f43275a53005 req-a5c9ef79-5202-42f9-a654-08513d662be3 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received unexpected event network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 for instance with vm_state active and task_state reboot_started.
Oct 20 02:26:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-27326cfa-bf40-4711-ab47-f43275a53005 req-a5c9ef79-5202-42f9-a654-08513d662be3 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received event network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:26:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-27326cfa-bf40-4711-ab47-f43275a53005 req-a5c9ef79-5202-42f9-a654-08513d662be3 service nova] Acquiring lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-27326cfa-bf40-4711-ab47-f43275a53005 req-a5c9ef79-5202-42f9-a654-08513d662be3 service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-27326cfa-bf40-4711-ab47-f43275a53005 req-a5c9ef79-5202-42f9-a654-08513d662be3 service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-27326cfa-bf40-4711-ab47-f43275a53005 req-a5c9ef79-5202-42f9-a654-08513d662be3 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] No waiting events found dispatching network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:26:44 user nova-compute[74242]: WARNING nova.compute.manager [req-27326cfa-bf40-4711-ab47-f43275a53005 req-a5c9ef79-5202-42f9-a654-08513d662be3 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received unexpected event network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 for instance with vm_state active and task_state reboot_started.
Oct 20 02:26:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:46 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:26:46 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:26:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:26:46 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Instance running successfully.
Oct 20 02:26:46 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9048393b-8400-49e6-9759-fc9e3b1b31d1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Instance soft rebooted successfully.
Oct 20 02:26:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9048393b-8400-49e6-9759-fc9e3b1b31d1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:26:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9048393b-8400-49e6-9759-fc9e3b1b31d1 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.386s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-d41aefd7-76ec-4cb8-89d1-d502af66b65c req-ea75191b-54b8-428e-981e-6434bdddc2ee service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received event network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:26:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d41aefd7-76ec-4cb8-89d1-d502af66b65c req-ea75191b-54b8-428e-981e-6434bdddc2ee service nova] Acquiring lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d41aefd7-76ec-4cb8-89d1-d502af66b65c req-ea75191b-54b8-428e-981e-6434bdddc2ee service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d41aefd7-76ec-4cb8-89d1-d502af66b65c req-ea75191b-54b8-428e-981e-6434bdddc2ee service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-d41aefd7-76ec-4cb8-89d1-d502af66b65c req-ea75191b-54b8-428e-981e-6434bdddc2ee service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] No waiting events found dispatching network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:26:46 user nova-compute[74242]: WARNING nova.compute.manager [req-d41aefd7-76ec-4cb8-89d1-d502af66b65c req-ea75191b-54b8-428e-981e-6434bdddc2ee service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received unexpected event network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 for instance with vm_state active and task_state None.
Oct 20 02:26:48 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:26:49 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:26:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:49 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:26:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:26:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:26:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:26:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:26:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:26:52 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:26:52 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:26:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=7937MB free_disk=24.699840545654297GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:26:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:26:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:26:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:26:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c98e383a-e1e5-4130-9cc6-a9823db0b88c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:26:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 876f8f80-9640-43ba-8ec7-0ffe06c82086 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:26:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 74295e5c-237c-4992-a21a-6f59fd6ff246 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:26:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:26:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:26:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance cd90bd52-3af1-4d05-89df-2fedc535333f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:26:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 8497b901-64fb-44f3-bd07-f584ab799867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:26:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:26:52 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:26:53 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:26:53 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:26:53 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:26:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.444s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:26:55 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:26:55 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:26:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:26:59 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:27:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "74295e5c-237c-4992-a21a-6f59fd6ff246" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:27:03 user nova-compute[74242]: INFO nova.compute.manager [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Terminating instance
Oct 20 02:27:03 user nova-compute[74242]: DEBUG nova.compute.manager [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:27:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:03 user nova-compute[74242]: DEBUG nova.compute.manager [req-14008a8a-4040-41be-8bbb-6b8fde2a5ee4 req-3e6b7afb-991d-4921-bd2d-f4b5b30763d4 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received event network-vif-unplugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:27:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-14008a8a-4040-41be-8bbb-6b8fde2a5ee4 req-3e6b7afb-991d-4921-bd2d-f4b5b30763d4 service nova] Acquiring lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-14008a8a-4040-41be-8bbb-6b8fde2a5ee4 req-3e6b7afb-991d-4921-bd2d-f4b5b30763d4 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-14008a8a-4040-41be-8bbb-6b8fde2a5ee4 req-3e6b7afb-991d-4921-bd2d-f4b5b30763d4 service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:27:03 user nova-compute[74242]: DEBUG nova.compute.manager [req-14008a8a-4040-41be-8bbb-6b8fde2a5ee4 req-3e6b7afb-991d-4921-bd2d-f4b5b30763d4 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] No waiting events found dispatching network-vif-unplugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:27:03 user nova-compute[74242]: DEBUG nova.compute.manager [req-14008a8a-4040-41be-8bbb-6b8fde2a5ee4 req-3e6b7afb-991d-4921-bd2d-f4b5b30763d4 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received event network-vif-unplugged-6a09ec72-a9d4-49cf-8089-04b50109b631 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:27:04 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Instance destroyed successfully.
Oct 20 02:27:04 user nova-compute[74242]: DEBUG nova.objects.instance [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'resources' on Instance uuid 74295e5c-237c-4992-a21a-6f59fd6ff246 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:21:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1378661490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1378661490',id=35,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:23:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112fda62d355421e80e674dc18bb5069',ramdisk_id='',reservation_id='r-sg6r9ymm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:25:17Z,user_data=None,user_id='9ac628a224fb4653932a27e33aa33c9d',uuid=74295e5c-237c-4992-a21a-6f59fd6ff246,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6a09ec72-a9d4-49cf-8089-04b50109b631", "address": "fa:16:3e:cd:60:bc", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a09ec72-a9", "ovs_interfaceid": "6a09ec72-a9d4-49cf-8089-04b50109b631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converting VIF {"id": "6a09ec72-a9d4-49cf-8089-04b50109b631", "address": "fa:16:3e:cd:60:bc", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6a09ec72-a9", "ovs_interfaceid": "6a09ec72-a9d4-49cf-8089-04b50109b631", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:60:bc,bridge_name='br-int',has_traffic_filtering=True,id=6a09ec72-a9d4-49cf-8089-04b50109b631,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a09ec72-a9') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_vif [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:60:bc,bridge_name='br-int',has_traffic_filtering=True,id=6a09ec72-a9d4-49cf-8089-04b50109b631,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a09ec72-a9') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6a09ec72-a9, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae12a2eb-a292-4b32-abf5-7d2f0f0c0ac0) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:04 user nova-compute[74242]: INFO os_vif [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:60:bc,bridge_name='br-int',has_traffic_filtering=True,id=6a09ec72-a9d4-49cf-8089-04b50109b631,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6a09ec72-a9')
Oct 20 02:27:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VWdrhBnZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:27:04 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1069343-3f51-4d2c-ad62-3a1c4cab9d0f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:27:04 user nova-compute[74242]: No targets found.
Oct 20 02:27:04 user nova-compute[74242]: iSNS:
Oct 20 02:27:04 user nova-compute[74242]: No targets found.
Oct 20 02:27:04 user nova-compute[74242]: STATIC:
Oct 20 02:27:04 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:27:04 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:27:04 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:27:04 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0
Oct 20 02:27:04 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:27:04 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:27:04 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d
Oct 20 02:27:04 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:27:04 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:27:04 user nova-compute[74242]: FIRMWARE:
Oct 20 02:27:04 user nova-compute[74242]: No targets found.
Oct 20 02:27:04 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:27:04 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:27:04 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f049865-c481-4c73-950f-4990599def2f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3b5c98-2a08-4354-9b4d-1e97809569aa]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:27:04 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:27:04 user nova-compute[74242]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)
Oct 20 02:27:04 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:27:04 user nova-compute[74242]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d (non-flash)
Oct 20 02:27:04 user nova-compute[74242]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)
Oct 20 02:27:04 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d037caf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d'): ({'sdb'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Removing single pathed devices sdb {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eb3af3-b263-449d-bf5a-3d2e74dce015]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b6d2c4-0243-40d8-bf2a-0461e48bdb8a]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Flushing IO for device /dev/sdb {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0969924f-26e6-44e1-8630-d3a4414ba81d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a930210f-2e71-4ff8-8f2d-2d0b7ed28e66]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8e1e0f70-014089c1ffe14580', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8e1e0f70', '/dev/disk/by-id/scsi-23031343038396331') {{(pid=85329) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1df679-277a-4184-8db6-626b10992dec]: (4, None) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f10b5a-21da-42d4-8e9e-8388f4fa3d81]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa60749-81b2-44e6-b21c-ef43dbc51ea5]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d, portal: 172.16.0.220,3260]
Oct 20 02:27:04 user nova-compute[74242]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d, portal: 172.16.0.220,3260] successful.
Oct 20 02:27:04 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3cc7249d-0e6c-479b-8200-c51120c5734d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f835f1-bb01-41b7-b8ec-d21f9ed8f2f1]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] <== disconnect_volume: return (312ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:27:04 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Deleting instance files /opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246_del
Oct 20 02:27:04 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Deletion of /opt/stack/data/nova/instances/74295e5c-237c-4992-a21a-6f59fd6ff246_del complete
Oct 20 02:27:04 user nova-compute[74242]: INFO nova.compute.manager [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 20 02:27:04 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:27:04 user nova-compute[74242]: DEBUG nova.compute.manager [req-96579be3-e71d-4bcb-b752-43dfb3472ce5 req-861df2af-d315-48d4-9fc3-8be2d11b50b0 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received event network-vif-deleted-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:27:04 user nova-compute[74242]: INFO nova.compute.manager [req-96579be3-e71d-4bcb-b752-43dfb3472ce5 req-861df2af-d315-48d4-9fc3-8be2d11b50b0 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Neutron deleted interface 6a09ec72-a9d4-49cf-8089-04b50109b631; detaching it from the instance and deleting it from the info cache
Oct 20 02:27:04 user nova-compute[74242]: DEBUG nova.network.neutron [req-96579be3-e71d-4bcb-b752-43dfb3472ce5 req-861df2af-d315-48d4-9fc3-8be2d11b50b0 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:27:04 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Took 0.47 seconds to deallocate network for instance.
Oct 20 02:27:04 user nova-compute[74242]: DEBUG nova.compute.manager [req-96579be3-e71d-4bcb-b752-43dfb3472ce5 req-861df2af-d315-48d4-9fc3-8be2d11b50b0 service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Detach interface failed, port_id=6a09ec72-a9d4-49cf-8089-04b50109b631, reason: Instance 74295e5c-237c-4992-a21a-6f59fd6ff246 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:27:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-c31ec5a1-4528-4444-a693-5cfd5a158022 req-58def32c-d032-40d8-975a-d879078ddd1b service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:27:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c31ec5a1-4528-4444-a693-5cfd5a158022 req-58def32c-d032-40d8-975a-d879078ddd1b service nova] Acquiring lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c31ec5a1-4528-4444-a693-5cfd5a158022 req-58def32c-d032-40d8-975a-d879078ddd1b service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c31ec5a1-4528-4444-a693-5cfd5a158022 req-58def32c-d032-40d8-975a-d879078ddd1b service nova] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:27:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-c31ec5a1-4528-4444-a693-5cfd5a158022 req-58def32c-d032-40d8-975a-d879078ddd1b service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] No waiting events found dispatching network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:27:05 user nova-compute[74242]: WARNING nova.compute.manager [req-c31ec5a1-4528-4444-a693-5cfd5a158022 req-58def32c-d032-40d8-975a-d879078ddd1b service nova] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Received unexpected event network-vif-plugged-6a09ec72-a9d4-49cf-8089-04b50109b631 for instance with vm_state active and task_state deleting.
Oct 20 02:27:05 user nova-compute[74242]: INFO nova.compute.manager [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 74295e5c-237c-4992-a21a-6f59fd6ff246] Took 0.78 seconds to detach 1 volumes for instance.
Oct 20 02:27:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:06 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:27:06 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:27:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:27:06 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Deleted allocations for instance 74295e5c-237c-4992-a21a-6f59fd6ff246
Oct 20 02:27:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-74e7787c-e82a-4106-860e-b51cfef83ad6 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "74295e5c-237c-4992-a21a-6f59fd6ff246" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.981s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:27:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:27:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:27:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:27:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:27:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:27:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:41 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "8497b901-64fb-44f3-bd07-f584ab799867" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG nova.objects.instance [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lazy-loading 'flavor' on Instance uuid 8497b901-64fb-44f3-bd07-f584ab799867 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "8497b901-64fb-44f3-bd07-f584ab799867" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "8497b901-64fb-44f3-bd07-f584ab799867" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:42 user nova-compute[74242]: INFO nova.compute.manager [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Attaching volume d222fae2-54cd-4649-9fb3-9e8fdb56f923 to /dev/vdb
Oct 20 02:27:42 user nova-compute[74242]: DEBUG os_brick.utils [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[387b3e8a-be2e-4c46-bedf-4255289c8f8a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ee2022-8b4a-428d-b143-00e637b9031f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bc9c59-3388-47b0-9c80-54d4f35c3db7]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72b237f-866d-47fb-9b00-722abebad5f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:27:42 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:27:42 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cf6364-977c-4f80-97f5-eae7f1503cc9]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG os_brick.utils [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:27:42 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updating existing volume attachment record: bf60107e-3cf9-4b77-88b5-87f765faeb36 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:27:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:27:45 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:27:45 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:27:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-876f8f80-9640-43ba-8ec7-0ffe06c82086" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:27:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-876f8f80-9640-43ba-8ec7-0ffe06c82086" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:27:45 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:27:45 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Updating instance_info_cache with network_info: [{"id": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "address": "fa:16:3e:7f:cf:92", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ad394b-aa", "ovs_interfaceid": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:27:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-876f8f80-9640-43ba-8ec7-0ffe06c82086" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:27:45 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:27:47 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:27:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:27:48 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:27:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:27:49 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:27:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:27:49 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:27:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:27:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.300s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.214s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:27:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:27:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:55 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:27:55 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:27:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8199MB free_disk=24.043487548828125GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "876f8f80-9640-43ba-8ec7-0ffe06c82086" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:27:55 user nova-compute[74242]: INFO nova.compute.manager [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Terminating instance
Oct 20 02:27:55 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c98e383a-e1e5-4130-9cc6-a9823db0b88c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 876f8f80-9640-43ba-8ec7-0ffe06c82086 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance cd90bd52-3af1-4d05-89df-2fedc535333f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 8497b901-64fb-44f3-bd07-f584ab799867 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-492af878-47ef-4a62-bdcb-09ed48f9aa19 req-50ab444e-5a87-41fe-9dd5-16774701ad23 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received event network-vif-unplugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:27:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-492af878-47ef-4a62-bdcb-09ed48f9aa19 req-50ab444e-5a87-41fe-9dd5-16774701ad23 service nova] Acquiring lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-492af878-47ef-4a62-bdcb-09ed48f9aa19 req-50ab444e-5a87-41fe-9dd5-16774701ad23 service nova] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-492af878-47ef-4a62-bdcb-09ed48f9aa19 req-50ab444e-5a87-41fe-9dd5-16774701ad23 service nova] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:27:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-492af878-47ef-4a62-bdcb-09ed48f9aa19 req-50ab444e-5a87-41fe-9dd5-16774701ad23 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] No waiting events found dispatching network-vif-unplugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:27:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-492af878-47ef-4a62-bdcb-09ed48f9aa19 req-50ab444e-5a87-41fe-9dd5-16774701ad23 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received event network-vif-unplugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:27:56 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:27:56 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.991s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:27:57 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Instance destroyed successfully.
Oct 20 02:27:57 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'resources' on Instance uuid 876f8f80-9640-43ba-8ec7-0ffe06c82086 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:18:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-630563716',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-630563716',id=32,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:18:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112fda62d355421e80e674dc18bb5069',ramdisk_id='',reservation_id='r-yeafms84',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:20:28Z,user_data=None,user_id='9ac628a224fb4653932a27e33aa33c9d',uuid=876f8f80-9640-43ba-8ec7-0ffe06c82086,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "address": "fa:16:3e:7f:cf:92", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ad394b-aa", "ovs_interfaceid": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converting VIF {"id": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "address": "fa:16:3e:7f:cf:92", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb8ad394b-aa", "ovs_interfaceid": "b8ad394b-aab1-4d61-a58e-50509bd3cb9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7f:cf:92,bridge_name='br-int',has_traffic_filtering=True,id=b8ad394b-aab1-4d61-a58e-50509bd3cb9d,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ad394b-aa') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG os_vif [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:cf:92,bridge_name='br-int',has_traffic_filtering=True,id=b8ad394b-aab1-4d61-a58e-50509bd3cb9d,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ad394b-aa') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb8ad394b-aa, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db4dafcc-1155-4093-b05a-a7c52359c7b1) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:27:57 user nova-compute[74242]: INFO os_vif [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7f:cf:92,bridge_name='br-int',has_traffic_filtering=True,id=b8ad394b-aab1-4d61-a58e-50509bd3cb9d,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb8ad394b-aa')
Oct 20 02:27:57 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Deleting instance files /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086_del
Oct 20 02:27:57 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Deletion of /opt/stack/data/nova/instances/876f8f80-9640-43ba-8ec7-0ffe06c82086_del complete
Oct 20 02:27:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:57 user nova-compute[74242]: INFO nova.compute.manager [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Took 1.94 seconds to destroy the instance on the hypervisor.
Oct 20 02:27:57 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:27:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:27:58 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Took 0.79 seconds to deallocate network for instance.
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received event network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] Acquiring lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] No waiting events found dispatching network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:27:58 user nova-compute[74242]: WARNING nova.compute.manager [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received unexpected event network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d for instance with vm_state deleted and task_state None.
Oct 20 02:27:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received event network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] Acquiring lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] No waiting events found dispatching network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:27:58 user nova-compute[74242]: WARNING nova.compute.manager [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received unexpected event network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d for instance with vm_state deleted and task_state None.
Oct 20 02:27:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received event network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] Acquiring lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] No waiting events found dispatching network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:27:58 user nova-compute[74242]: WARNING nova.compute.manager [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received unexpected event network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d for instance with vm_state deleted and task_state None.
Oct 20 02:27:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received event network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] Acquiring lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] No waiting events found dispatching network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:27:58 user nova-compute[74242]: WARNING nova.compute.manager [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received unexpected event network-vif-plugged-b8ad394b-aab1-4d61-a58e-50509bd3cb9d for instance with vm_state deleted and task_state None.
Oct 20 02:27:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-097fc809-7bb1-4815-bd64-c888786a33f5 req-a4a05467-bdb7-4d91-b398-6f001917d751 service nova] [instance: 876f8f80-9640-43ba-8ec7-0ffe06c82086] Received event network-vif-deleted-b8ad394b-aab1-4d61-a58e-50509bd3cb9d {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.269s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:27:58 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Deleted allocations for instance 876f8f80-9640-43ba-8ec7-0ffe06c82086
Oct 20 02:27:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1d7b2120-18aa-4665-95ae-b4622cd4a2a4 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "876f8f80-9640-43ba-8ec7-0ffe06c82086" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.220s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqMPlUeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:28:01 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:28:01 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:28:01 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7117fc4a-aaa7-453a-ab8e-e1554cfe63e8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:28:01 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d25764-888d-4b1e-9838-5ce834c863d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923] added
Oct 20 02:28:01 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f82c6e-aee3-4e87-81c4-267699125ca2]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[81b1935a-5168-41a4-ab8f-e5cc9457b669]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqMPlUeX {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqMPlUeX" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba406115-6b67-4533-829a-a2b1ea38ce06]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jqMPlUeX'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[619783be-d3cd-4903-a0a7-29e11dba7815]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[040e231d-4248-4290-83cd-20de2459286f]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:28:01 user nova-compute[74242]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)
Oct 20 02:28:01 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:28:01 user nova-compute[74242]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)
Oct 20 02:28:01 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[75075f04-b30e-4087-8f32-f083af375ebb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923, portal: 172.16.0.220,3260]
Oct 20 02:28:01 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923, portal: 172.16.0.220,3260] successful.
Oct 20 02:28:01 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a33cf1-73cf-4600-b9fa-f319a41a1787]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[74e43b88-5525-4a26-a8d6-73bcec6fc80c]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:28:01 user nova-compute[74242]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)
Oct 20 02:28:01 user nova-compute[74242]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 (non-flash)
Oct 20 02:28:01 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:28:01 user nova-compute[74242]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)
Oct 20 02:28:01 user nova-compute[74242]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 (non-flash)
Oct 20 02:28:01 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e713c094-23e3-41b9-9660-612f1801278e]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:28:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqMPlUeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:28:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:28:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23931633233376639', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:28:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931633233376639', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:28:02 user nova-compute[74242]: DEBUG nova.objects.instance [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lazy-loading 'flavor' on Instance uuid 8497b901-64fb-44f3-bd07-f584ab799867 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:28:02 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:28:02 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:28:02 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:28:02 user nova-compute[74242]:   <serial>d222fae2-54cd-4649-9fb3-9e8fdb56f923</serial>
Oct 20 02:28:02 user nova-compute[74242]: </disk>
Oct 20 02:28:02 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:28:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:28:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:28:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] No VIF found with MAC fa:16:3e:ed:17:65, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:28:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c299ccd6-0807-4936-ae02-2262ca7a4b50 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "8497b901-64fb-44f3-bd07-f584ab799867" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.996s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:04 user nova-compute[74242]: INFO nova.compute.manager [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Rescuing
Oct 20 02:28:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:28:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquired lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:28:04 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:28:04 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updating instance_info_cache with network_info: [{"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:28:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Releasing lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-7cd9c964-d9c4-48a3-a864-fccf6fb0ac2c req-1417b6a3-c4c6-424f-9b59-92f47e9693ba service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-unplugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7cd9c964-d9c4-48a3-a864-fccf6fb0ac2c req-1417b6a3-c4c6-424f-9b59-92f47e9693ba service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7cd9c964-d9c4-48a3-a864-fccf6fb0ac2c req-1417b6a3-c4c6-424f-9b59-92f47e9693ba service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7cd9c964-d9c4-48a3-a864-fccf6fb0ac2c req-1417b6a3-c4c6-424f-9b59-92f47e9693ba service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-7cd9c964-d9c4-48a3-a864-fccf6fb0ac2c req-1417b6a3-c4c6-424f-9b59-92f47e9693ba service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-unplugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:05 user nova-compute[74242]: WARNING nova.compute.manager [req-7cd9c964-d9c4-48a3-a864-fccf6fb0ac2c req-1417b6a3-c4c6-424f-9b59-92f47e9693ba service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received unexpected event network-vif-unplugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with vm_state active and task_state rescuing.
Oct 20 02:28:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:05 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Instance destroyed successfully.
Oct 20 02:28:05 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Attempting a stable device rescue
Oct 20 02:28:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74242) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Instance directory exists: not creating {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 02:28:05 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Creating image(s)
Oct 20 02:28:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "/opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "/opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "/opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG nova.objects.instance [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8497b901-64fb-44f3-bd07-f584ab799867 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "a4428252a947b26c61e02bb1421900a8e702260f" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "a4428252a947b26c61e02bb1421900a8e702260f" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4428252a947b26c61e02bb1421900a8e702260f.part --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4428252a947b26c61e02bb1421900a8e702260f.part --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:06 user nova-compute[74242]: DEBUG nova.virt.images [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] f5499cff-370c-4b3f-ad47-0413a47f2abe was qcow2, converting to raw {{(pid=74242) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 02:28:06 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:28:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a4428252a947b26c61e02bb1421900a8e702260f.part /opt/stack/data/nova/instances/_base/a4428252a947b26c61e02bb1421900a8e702260f.converted {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a4428252a947b26c61e02bb1421900a8e702260f.part /opt/stack/data/nova/instances/_base/a4428252a947b26c61e02bb1421900a8e702260f.converted" returned: 0 in 0.343s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4428252a947b26c61e02bb1421900a8e702260f.converted --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:07 user nova-compute[74242]: WARNING nova.compute.manager [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received unexpected event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with vm_state active and task_state rescuing.
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:07 user nova-compute[74242]: WARNING nova.compute.manager [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received unexpected event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with vm_state active and task_state rescuing.
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:07 user nova-compute[74242]: WARNING nova.compute.manager [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received unexpected event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with vm_state active and task_state rescuing.
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-unplugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-unplugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:07 user nova-compute[74242]: WARNING nova.compute.manager [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received unexpected event network-vif-unplugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with vm_state active and task_state rescuing.
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:07 user nova-compute[74242]: WARNING nova.compute.manager [req-b5ca56af-4c6e-40ab-a755-74c1f4625ea6 req-b574ac44-8901-4dea-ae28-b447db2cc7c3 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received unexpected event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with vm_state active and task_state rescuing.
Oct 20 02:28:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4428252a947b26c61e02bb1421900a8e702260f.converted --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "a4428252a947b26c61e02bb1421900a8e702260f" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.653s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "a4428252a947b26c61e02bb1421900a8e702260f" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "a4428252a947b26c61e02bb1421900a8e702260f" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4428252a947b26c61e02bb1421900a8e702260f --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a4428252a947b26c61e02bb1421900a8e702260f --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a4428252a947b26c61e02bb1421900a8e702260f,backing_fmt=raw /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.rescue {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a4428252a947b26c61e02bb1421900a8e702260f,backing_fmt=raw /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.rescue" returned: 0 in 0.050s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "a4428252a947b26c61e02bb1421900a8e702260f" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.objects.instance [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lazy-loading 'migration_context' on Instance uuid 8497b901-64fb-44f3-bd07-f584ab799867 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.objects.base [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Object Instance<8497b901-64fb-44f3-bd07-f584ab799867> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Start _get_guest_xml network_info=[{"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "vif_mac": "fa:16:3e:ed:17:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'f5499cff-370c-4b3f-ad47-0413a47f2abe', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': 'bf60107e-3cf9-4b77-88b5-87f765faeb36', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqMPlUeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '8497b901-64fb-44f3-bd07-f584ab799867', 'attached_at': '', 'detached_at': '', 'volume_id': 'd222fae2-54cd-4649-9fb3-9e8fdb56f923', 'serial': 'd222fae2-54cd-4649-9fb3-9e8fdb56f923'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.objects.instance [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lazy-loading 'resources' on Instance uuid 8497b901-64fb-44f3-bd07-f584ab799867 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.objects.base [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Object Instance<8497b901-64fb-44f3-bd07-f584ab799867> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.objects.instance [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lazy-loading 'numa_topology' on Instance uuid 8497b901-64fb-44f3-bd07-f584ab799867 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.objects.base [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Object Instance<8497b901-64fb-44f3-bd07-f584ab799867> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:28:07 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:28:07 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.objects.instance [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8497b901-64fb-44f3-bd07-f584ab799867 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.objects.base [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Object Instance<8497b901-64fb-44f3-bd07-f584ab799867> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqMPlUeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:28:07 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:28:07 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:28:07 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[100021a7-c168-4da7-a208-2cc6a0705ad3]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = jqMPlUeX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 20 02:28:07 user nova-compute[74242]: node.name = iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923
Oct 20 02:28:07 user nova-compute[74242]: node.tpgt = -1
Oct 20 02:28:07 user nova-compute[74242]: node.startup = automatic
Oct 20 02:28:07 user nova-compute[74242]: node.leading_login = No
Oct 20 02:28:07 user nova-compute[74242]: iface.iscsi_ifacename = default
Oct 20 02:28:07 user nova-compute[74242]: iface.net_ifacename = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.ipaddress = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.prefix_len = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.hwaddress = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.transport_name = tcp
Oct 20 02:28:07 user nova-compute[74242]: iface.initiatorname = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.state = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.vlan_id = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.vlan_priority = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.vlan_state = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.iface_num = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.mtu = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.port = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.bootproto = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.subnet_mask = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.gateway = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.dhcp_alt_client_id_state = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.dhcp_alt_client_id = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.dhcp_dns = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.dhcp_learn_iqn = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.dhcp_req_vendor_id_state = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.dhcp_vendor_id_state = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.dhcp_vendor_id = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.dhcp_slp_da = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.fragmentation = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.gratuitous_arp = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.incoming_forwarding = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.tos_state = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.tos = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.ttl = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.delayed_ack = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.tcp_nagle = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.tcp_wsf_state = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.tcp_wsf = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.tcp_timer_scale = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.tcp_timestamp = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.redirect = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.def_task_mgmt_timeout = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.header_digest = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.data_digest = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.immediate_data = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.initial_r2t = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.data_seq_inorder = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.data_pdu_inorder = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.erl = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.max_receive_data_len = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.first_burst_len = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.max_outstanding_r2t = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.max_burst_len = 0
Oct 20 02:28:07 user nova-compute[74242]: iface.chap_auth = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.bidi_chap = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.strict_login_compliance = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.discovery_auth = <empty>
Oct 20 02:28:07 user nova-compute[74242]: iface.discovery_logout = <empty>
Oct 20 02:28:07 user nova-compute[74242]: node.discovery_address = <empty>
Oct 20 02:28:07 user nova-compute[74242]: node.discovery_port = 0
Oct 20 02:28:07 user nova-compute[74242]: node.discovery_type = static
Oct 20 02:28:07 user nova-compute[74242]: node.session.initial_cmdsn = 0
Oct 20 02:28:07 user nova-compute[74242]: node.session.initial_login_retry_max = 8
Oct 20 02:28:07 user nova-compute[74242]: node.session.xmit_thread_priority = -20
Oct 20 02:28:07 user nova-compute[74242]: node.session.cmds_max = 128
Oct 20 02:28:07 user nova-compute[74242]: node.session.queue_depth = 32
Oct 20 02:28:07 user nova-compute[74242]: node.session.nr_sessions = 1
Oct 20 02:28:07 user nova-compute[74242]: node.session.auth.authmethod = CHAP
Oct 20 02:28:07 user nova-compute[74242]: node.session.auth.username = jqMPlUeX
Oct 20 02:28:07 user nova-compute[74242]: node.session.auth.password = ***
Oct 20 02:28:07 user nova-compute[74242]: node.session.auth.username_in = <empty>
Oct 20 02:28:07 user nova-compute[74242]: node.session.auth.password_in = <empty>
Oct 20 02:28:07 user nova-compute[74242]: node.session.auth.chap_algs = MD5
Oct 20 02:28:07 user nova-compute[74242]: node.session.timeo.replacement_timeout = 120
Oct 20 02:28:07 user nova-compute[74242]: node.session.err_timeo.abort_timeout = 15
Oct 20 02:28:07 user nova-compute[74242]: node.session.err_timeo.lu_reset_timeout = 30
Oct 20 02:28:07 user nova-compute[74242]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 20 02:28:07 user nova-compute[74242]: node.session.err_timeo.host_reset_timeout = 60
Oct 20 02:28:07 user nova-compute[74242]: node.session.iscsi.FastAbort = Yes
Oct 20 02:28:07 user nova-compute[74242]: node.session.iscsi.InitialR2T = No
Oct 20 02:28:07 user nova-compute[74242]: node.session.iscsi.ImmediateData = Yes
Oct 20 02:28:07 user nova-compute[74242]: node.session.iscsi.FirstBurstLength = 262144
Oct 20 02:28:07 user nova-compute[74242]: node.session.iscsi.MaxBurstLength = 16776192
Oct 20 02:28:07 user nova-compute[74242]: node.session.iscsi.DefaultTime2Retain = 0
Oct 20 02:28:07 user nova-compute[74242]: node.session.iscsi.DefaultTime2Wait = 2
Oct 20 02:28:07 user nova-compute[74242]: node.session.iscsi.MaxConnections = 1
Oct 20 02:28:07 user nova-compute[74242]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 20 02:28:07 user nova-compute[74242]: node.session.iscsi.ERL = 0
Oct 20 02:28:07 user nova-compute[74242]: node.session.scan = manual
Oct 20 02:28:07 user nova-compute[74242]: node.session.reopen_max = 0
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].address = 172.16.0.220
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].port = 3260
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].startup = manual
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].tcp.window_size = 524288
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].tcp.type_of_service = 0
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].timeo.logout_timeout = 15
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].timeo.login_timeout = 15
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].timeo.auth_timeout = 45
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].timeo.noop_out_interval = 5
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].timeo.noop_out_timeout = 5
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].iscsi.HeaderDigest = None
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].iscsi.DataDigest = None
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].iscsi.IFMarker = No
Oct 20 02:28:07 user nova-compute[74242]: node.conn[0].iscsi.OFMarker = No
Oct 20 02:28:07 user nova-compute[74242]: # END RECORD
Oct 20 02:28:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ca8d24-4a62-4d96-bfcb-470bd3ab8fe6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b07e12f-ee03-40c8-8326-2d168e8dafb4]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqMPlUeX {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jqMPlUeX" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcab836d-751b-408a-b7bc-d5d7febf8028]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jqMPlUeX'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[59dfb7aa-92b3-4bde-a0c7-94089b461ec2]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1637f6-966f-4579-8cdf-a792cb0500ad]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:28:07 user nova-compute[74242]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)
Oct 20 02:28:07 user nova-compute[74242]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 (non-flash)
Oct 20 02:28:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:28:07 user nova-compute[74242]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)
Oct 20 02:28:07 user nova-compute[74242]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 (non-flash)
Oct 20 02:28:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.144s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] HCTL ('33', '0', '0', 0) found on session 48 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:28:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b021e0-a0ab-4796-93dd-93cce4ceeb3b]: (4, ('0 0 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Searching for a device in session 48 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqMPlUeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.170s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] <== connect_volume: return (171ms) {'type': 'block', 'scsi_wwn': '23931633233376639', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931633233376639', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2059081696',display_name='tempest-ServerStableDeviceRescueTest-server-2059081696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2059081696',id=40,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTAAcf8Y7sAmdQqd5z9q/RF6wwhR0b02FbKRBj+uRza53X4eObcjHf3dPZyS7adSfQYxggRP2hP3ekB/6YppEmRoXNmwoWWIl3XxzwKP3FiyDhp+6BlBzskARDdOcrztA==',key_name='tempest-keypair-274219542',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:24:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='362d9ed2d8ed40df9e4502c3fb9ae8ae',ramdisk_id='',reservation_id='r-rie4dx62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1200020058',owner_user_name='tempest-ServerStableDeviceRescueTest-1200020058-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:25:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8dc8fca651343beac526aee0a74023f',uuid=8497b901-64fb-44f3-bd07-f584ab799867,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "vif_mac": "fa:16:3e:ed:17:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Converting VIF {"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "vif_mac": "fa:16:3e:ed:17:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:17:65,bridge_name='br-int',has_traffic_filtering=True,id=df5d650c-5e5c-4822-8154-7fc1213190b4,network=Network(02e4212b-93a0-4444-a4c5-793b52071c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5d650c-5e') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG nova.objects.instance [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lazy-loading 'pci_devices' on Instance uuid 8497b901-64fb-44f3-bd07-f584ab799867 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG nova.objects.base [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Object Instance<8497b901-64fb-44f3-bd07-f584ab799867> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:28:08 user nova-compute[74242]:   <uuid>8497b901-64fb-44f3-bd07-f584ab799867</uuid>
Oct 20 02:28:08 user nova-compute[74242]:   <name>instance-00000028</name>
Oct 20 02:28:08 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:28:08 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:28:08 user nova-compute[74242]:   <metadata>
Oct 20 02:28:08 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:28:08 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:28:08 user nova-compute[74242]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-2059081696</nova:name>
Oct 20 02:28:08 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:28:07</nova:creationTime>
Oct 20 02:28:08 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:28:08 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:28:08 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:28:08 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:28:08 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:28:08 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:28:08 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:28:08 user nova-compute[74242]:       <nova:owner>
Oct 20 02:28:08 user nova-compute[74242]:         <nova:user uuid="d8dc8fca651343beac526aee0a74023f">tempest-ServerStableDeviceRescueTest-1200020058-project-member</nova:user>
Oct 20 02:28:08 user nova-compute[74242]:         <nova:project uuid="362d9ed2d8ed40df9e4502c3fb9ae8ae">tempest-ServerStableDeviceRescueTest-1200020058</nova:project>
Oct 20 02:28:08 user nova-compute[74242]:       </nova:owner>
Oct 20 02:28:08 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:28:08 user nova-compute[74242]:       <nova:ports>
Oct 20 02:28:08 user nova-compute[74242]:         <nova:port uuid="df5d650c-5e5c-4822-8154-7fc1213190b4">
Oct 20 02:28:08 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 02:28:08 user nova-compute[74242]:         </nova:port>
Oct 20 02:28:08 user nova-compute[74242]:       </nova:ports>
Oct 20 02:28:08 user nova-compute[74242]:     </nova:instance>
Oct 20 02:28:08 user nova-compute[74242]:   </metadata>
Oct 20 02:28:08 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:28:08 user nova-compute[74242]:     <system>
Oct 20 02:28:08 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:28:08 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:28:08 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:28:08 user nova-compute[74242]:       <entry name="serial">8497b901-64fb-44f3-bd07-f584ab799867</entry>
Oct 20 02:28:08 user nova-compute[74242]:       <entry name="uuid">8497b901-64fb-44f3-bd07-f584ab799867</entry>
Oct 20 02:28:08 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:28:08 user nova-compute[74242]:     </system>
Oct 20 02:28:08 user nova-compute[74242]:   </sysinfo>
Oct 20 02:28:08 user nova-compute[74242]:   <os>
Oct 20 02:28:08 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:28:08 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:28:08 user nova-compute[74242]:   </os>
Oct 20 02:28:08 user nova-compute[74242]:   <features>
Oct 20 02:28:08 user nova-compute[74242]:     <acpi/>
Oct 20 02:28:08 user nova-compute[74242]:     <apic/>
Oct 20 02:28:08 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:28:08 user nova-compute[74242]:   </features>
Oct 20 02:28:08 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:28:08 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:28:08 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:28:08 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:28:08 user nova-compute[74242]:   </clock>
Oct 20 02:28:08 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:28:08 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:28:08 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:28:08 user nova-compute[74242]:   </cpu>
Oct 20 02:28:08 user nova-compute[74242]:   <devices>
Oct 20 02:28:08 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:28:08 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:28:08 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk"/>
Oct 20 02:28:08 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:28:08 user nova-compute[74242]:     </disk>
Oct 20 02:28:08 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:28:08 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:28:08 user nova-compute[74242]:       <source dev="/dev/sdb"/>
Oct 20 02:28:08 user nova-compute[74242]:       <target dev="vdb" bus="virtio"/>
Oct 20 02:28:08 user nova-compute[74242]:       <serial>d222fae2-54cd-4649-9fb3-9e8fdb56f923</serial>
Oct 20 02:28:08 user nova-compute[74242]:     </disk>
Oct 20 02:28:08 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:28:08 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:28:08 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.rescue"/>
Oct 20 02:28:08 user nova-compute[74242]:       <target dev="vdc" bus="virtio"/>
Oct 20 02:28:08 user nova-compute[74242]:       <boot order="1"/>
Oct 20 02:28:08 user nova-compute[74242]:     </disk>
Oct 20 02:28:08 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:28:08 user nova-compute[74242]:       <mac address="fa:16:3e:ed:17:65"/>
Oct 20 02:28:08 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:28:08 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:28:08 user nova-compute[74242]:       <target dev="tapdf5d650c-5e"/>
Oct 20 02:28:08 user nova-compute[74242]:     </interface>
Oct 20 02:28:08 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:28:08 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/console.log" append="off"/>
Oct 20 02:28:08 user nova-compute[74242]:     </serial>
Oct 20 02:28:08 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:28:08 user nova-compute[74242]:     <video>
Oct 20 02:28:08 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:28:08 user nova-compute[74242]:     </video>
Oct 20 02:28:08 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:28:08 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:28:08 user nova-compute[74242]:     </rng>
Oct 20 02:28:08 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:28:08 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:28:08 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:28:08 user nova-compute[74242]:     </memballoon>
Oct 20 02:28:08 user nova-compute[74242]:   </devices>
Oct 20 02:28:08 user nova-compute[74242]: </domain>
Oct 20 02:28:08 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:28:08 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Instance destroyed successfully.
Oct 20 02:28:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:28:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] No VIF found with MAC fa:16:3e:ed:17:65, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:28:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:09 user nova-compute[74242]: DEBUG nova.compute.manager [req-3c88ad1b-3585-4729-9aef-396160ed9d41 req-494558a0-69d7-44f9-91c2-8024e02d3e51 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3c88ad1b-3585-4729-9aef-396160ed9d41 req-494558a0-69d7-44f9-91c2-8024e02d3e51 service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3c88ad1b-3585-4729-9aef-396160ed9d41 req-494558a0-69d7-44f9-91c2-8024e02d3e51 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3c88ad1b-3585-4729-9aef-396160ed9d41 req-494558a0-69d7-44f9-91c2-8024e02d3e51 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:09 user nova-compute[74242]: DEBUG nova.compute.manager [req-3c88ad1b-3585-4729-9aef-396160ed9d41 req-494558a0-69d7-44f9-91c2-8024e02d3e51 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:09 user nova-compute[74242]: WARNING nova.compute.manager [req-3c88ad1b-3585-4729-9aef-396160ed9d41 req-494558a0-69d7-44f9-91c2-8024e02d3e51 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received unexpected event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with vm_state active and task_state rescuing.
Oct 20 02:28:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:11 user nova-compute[74242]: DEBUG nova.compute.manager [req-ca72de7e-2615-4c25-ae6c-3ed29a81a9b2 req-5a1d7e0d-3a11-41cb-befe-e73c41953519 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ca72de7e-2615-4c25-ae6c-3ed29a81a9b2 req-5a1d7e0d-3a11-41cb-befe-e73c41953519 service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ca72de7e-2615-4c25-ae6c-3ed29a81a9b2 req-5a1d7e0d-3a11-41cb-befe-e73c41953519 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ca72de7e-2615-4c25-ae6c-3ed29a81a9b2 req-5a1d7e0d-3a11-41cb-befe-e73c41953519 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:11 user nova-compute[74242]: DEBUG nova.compute.manager [req-ca72de7e-2615-4c25-ae6c-3ed29a81a9b2 req-5a1d7e0d-3a11-41cb-befe-e73c41953519 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:11 user nova-compute[74242]: WARNING nova.compute.manager [req-ca72de7e-2615-4c25-ae6c-3ed29a81a9b2 req-5a1d7e0d-3a11-41cb-befe-e73c41953519 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received unexpected event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with vm_state active and task_state rescuing.
Oct 20 02:28:11 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e9c7acf6-6ddd-4a7d-b260-2a6d2f3c33e3 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:28:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:30 user nova-compute[74242]: INFO nova.compute.manager [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Rescuing
Oct 20 02:28:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:28:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquired lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:28:30 user nova-compute[74242]: DEBUG nova.network.neutron [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:28:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Updating instance_info_cache with network_info: [{"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:28:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Releasing lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:28:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:32 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Instance destroyed successfully.
Oct 20 02:28:32 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Attempting rescue
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74242) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Instance directory exists: not creating {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 02:28:32 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Creating image(s)
Oct 20 02:28:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "/opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "/opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.objects.instance [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2bf62933-66ea-469e-a70e-92184f311110 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-940517c5-b5ae-4342-9373-4578fc27a05d req-5d8a9c55-d5c6-46b7-9c29-bf0e6471cd5b service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received event network-changed-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-940517c5-b5ae-4342-9373-4578fc27a05d req-5d8a9c55-d5c6-46b7-9c29-bf0e6471cd5b service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Refreshing instance network info cache due to event network-changed-2c2d23fe-8f7f-4ed8-8d59-a9494654c051. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-940517c5-b5ae-4342-9373-4578fc27a05d req-5d8a9c55-d5c6-46b7-9c29-bf0e6471cd5b service nova] Acquiring lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-940517c5-b5ae-4342-9373-4578fc27a05d req-5d8a9c55-d5c6-46b7-9c29-bf0e6471cd5b service nova] Acquired lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-940517c5-b5ae-4342-9373-4578fc27a05d req-5d8a9c55-d5c6-46b7-9c29-bf0e6471cd5b service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Refreshing network info cache for port 2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.rescue {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.rescue" returned: 0 in 0.055s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.objects.instance [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'migration_context' on Instance uuid 2bf62933-66ea-469e-a70e-92184f311110 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.objects.base [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Object Instance<2bf62933-66ea-469e-a70e-92184f311110> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Start _get_guest_xml network_info=[{"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "vif_mac": "fa:16:3e:03:d5:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.objects.instance [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'resources' on Instance uuid 2bf62933-66ea-469e-a70e-92184f311110 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.objects.base [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Object Instance<2bf62933-66ea-469e-a70e-92184f311110> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.objects.instance [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'numa_topology' on Instance uuid 2bf62933-66ea-469e-a70e-92184f311110 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.objects.base [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Object Instance<2bf62933-66ea-469e-a70e-92184f311110> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:28:32 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:28:32 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.objects.instance [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2bf62933-66ea-469e-a70e-92184f311110 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.objects.base [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Object Instance<2bf62933-66ea-469e-a70e-92184f311110> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1744055314',display_name='tempest-ServerRescueNegativeTestJSON-server-1744055314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1744055314',id=37,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:23:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80fa40dfb2c84a84b3399b643fcde4c5',ramdisk_id='',reservation_id='r-vlo89q17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-630282540',owner_user_name='tempest-ServerRescueNegativeTestJSON-630282540-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:23:52Z,user_data=None,user_id='c7a7db373740428d89dcda898a04410c',uuid=2bf62933-66ea-469e-a70e-92184f311110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "vif_mac": "fa:16:3e:03:d5:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converting VIF {"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "vif_mac": "fa:16:3e:03:d5:bc"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:d5:bc,bridge_name='br-int',has_traffic_filtering=True,id=61e204b4-d498-423a-8542-af401e188691,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e204b4-d4') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.objects.instance [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bf62933-66ea-469e-a70e-92184f311110 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.objects.base [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Object Instance<2bf62933-66ea-469e-a70e-92184f311110> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:28:32 user nova-compute[74242]:   <uuid>2bf62933-66ea-469e-a70e-92184f311110</uuid>
Oct 20 02:28:32 user nova-compute[74242]:   <name>instance-00000025</name>
Oct 20 02:28:32 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:28:32 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:28:32 user nova-compute[74242]:   <metadata>
Oct 20 02:28:32 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:28:32 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:28:32 user nova-compute[74242]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1744055314</nova:name>
Oct 20 02:28:32 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:28:32</nova:creationTime>
Oct 20 02:28:32 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:28:32 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:28:32 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:28:32 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:28:32 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:28:32 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:28:32 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:28:32 user nova-compute[74242]:       <nova:owner>
Oct 20 02:28:32 user nova-compute[74242]:         <nova:user uuid="c7a7db373740428d89dcda898a04410c">tempest-ServerRescueNegativeTestJSON-630282540-project-member</nova:user>
Oct 20 02:28:32 user nova-compute[74242]:         <nova:project uuid="80fa40dfb2c84a84b3399b643fcde4c5">tempest-ServerRescueNegativeTestJSON-630282540</nova:project>
Oct 20 02:28:32 user nova-compute[74242]:       </nova:owner>
Oct 20 02:28:32 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:28:32 user nova-compute[74242]:       <nova:ports>
Oct 20 02:28:32 user nova-compute[74242]:         <nova:port uuid="61e204b4-d498-423a-8542-af401e188691">
Oct 20 02:28:32 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 20 02:28:32 user nova-compute[74242]:         </nova:port>
Oct 20 02:28:32 user nova-compute[74242]:       </nova:ports>
Oct 20 02:28:32 user nova-compute[74242]:     </nova:instance>
Oct 20 02:28:32 user nova-compute[74242]:   </metadata>
Oct 20 02:28:32 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:28:32 user nova-compute[74242]:     <system>
Oct 20 02:28:32 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:28:32 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:28:32 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:28:32 user nova-compute[74242]:       <entry name="serial">2bf62933-66ea-469e-a70e-92184f311110</entry>
Oct 20 02:28:32 user nova-compute[74242]:       <entry name="uuid">2bf62933-66ea-469e-a70e-92184f311110</entry>
Oct 20 02:28:32 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:28:32 user nova-compute[74242]:     </system>
Oct 20 02:28:32 user nova-compute[74242]:   </sysinfo>
Oct 20 02:28:32 user nova-compute[74242]:   <os>
Oct 20 02:28:32 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:28:32 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:28:32 user nova-compute[74242]:   </os>
Oct 20 02:28:32 user nova-compute[74242]:   <features>
Oct 20 02:28:32 user nova-compute[74242]:     <acpi/>
Oct 20 02:28:32 user nova-compute[74242]:     <apic/>
Oct 20 02:28:32 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:28:32 user nova-compute[74242]:   </features>
Oct 20 02:28:32 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:28:32 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:28:32 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:28:32 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:28:32 user nova-compute[74242]:   </clock>
Oct 20 02:28:32 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:28:32 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:28:32 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:28:32 user nova-compute[74242]:   </cpu>
Oct 20 02:28:32 user nova-compute[74242]:   <devices>
Oct 20 02:28:32 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:28:32 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:28:32 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.rescue"/>
Oct 20 02:28:32 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:28:32 user nova-compute[74242]:     </disk>
Oct 20 02:28:32 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:28:32 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:28:32 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk"/>
Oct 20 02:28:32 user nova-compute[74242]:       <target dev="vdb" bus="virtio"/>
Oct 20 02:28:32 user nova-compute[74242]:     </disk>
Oct 20 02:28:32 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:28:32 user nova-compute[74242]:       <mac address="fa:16:3e:03:d5:bc"/>
Oct 20 02:28:32 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:28:32 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:28:32 user nova-compute[74242]:       <target dev="tap61e204b4-d4"/>
Oct 20 02:28:32 user nova-compute[74242]:     </interface>
Oct 20 02:28:32 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:28:32 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/console.log" append="off"/>
Oct 20 02:28:32 user nova-compute[74242]:     </serial>
Oct 20 02:28:32 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:28:32 user nova-compute[74242]:     <video>
Oct 20 02:28:32 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:28:32 user nova-compute[74242]:     </video>
Oct 20 02:28:32 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:28:32 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:28:32 user nova-compute[74242]:     </rng>
Oct 20 02:28:32 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:28:32 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:28:32 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:28:32 user nova-compute[74242]:     </memballoon>
Oct 20 02:28:32 user nova-compute[74242]:   </devices>
Oct 20 02:28:32 user nova-compute[74242]: </domain>
Oct 20 02:28:32 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:28:32 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Instance destroyed successfully.
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No VIF found with MAC fa:16:3e:03:d5:bc, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-940517c5-b5ae-4342-9373-4578fc27a05d req-5d8a9c55-d5c6-46b7-9c29-bf0e6471cd5b service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Updated VIF entry in instance network info cache for port 2c2d23fe-8f7f-4ed8-8d59-a9494654c051. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-940517c5-b5ae-4342-9373-4578fc27a05d req-5d8a9c55-d5c6-46b7-9c29-bf0e6471cd5b service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Updating instance_info_cache with network_info: [{"id": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "address": "fa:16:3e:82:c4:e7", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.79", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2d23fe-8f", "ovs_interfaceid": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:28:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-940517c5-b5ae-4342-9373-4578fc27a05d req-5d8a9c55-d5c6-46b7-9c29-bf0e6471cd5b service nova] Releasing lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:28:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "cd90bd52-3af1-4d05-89df-2fedc535333f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:33 user nova-compute[74242]: INFO nova.compute.manager [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Detaching volume 178359d2-67f6-4df9-9255-1db6d1c0e7d0
Oct 20 02:28:33 user nova-compute[74242]: INFO nova.virt.block_device [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Attempting to driver detach volume 178359d2-67f6-4df9-9255-1db6d1c0e7d0 from mountpoint /dev/vdb
Oct 20 02:28:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Attempting to detach device vdb from instance cd90bd52-3af1-4d05-89df-2fedc535333f from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:28:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:28:33 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:28:33 user nova-compute[74242]:   <source dev="/dev/sdd"/>
Oct 20 02:28:33 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:28:33 user nova-compute[74242]:   <serial>178359d2-67f6-4df9-9255-1db6d1c0e7d0</serial>
Oct 20 02:28:33 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:28:33 user nova-compute[74242]: </disk>
Oct 20 02:28:33 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:28:33 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Successfully detached device vdb from instance cd90bd52-3af1-4d05-89df-2fedc535333f from the persistent domain config.
Oct 20 02:28:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance cd90bd52-3af1-4d05-89df-2fedc535333f from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:28:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:28:33 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:28:33 user nova-compute[74242]:   <source dev="/dev/sdd"/>
Oct 20 02:28:33 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:28:33 user nova-compute[74242]:   <serial>178359d2-67f6-4df9-9255-1db6d1c0e7d0</serial>
Oct 20 02:28:33 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:28:33 user nova-compute[74242]: </disk>
Oct 20 02:28:33 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:28:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-7f032018-c97c-4a10-8126-0e62427f9d94 req-f1fb1fab-946d-4a9d-a6cf-6631b37e635a service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received event network-changed-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-7f032018-c97c-4a10-8126-0e62427f9d94 req-f1fb1fab-946d-4a9d-a6cf-6631b37e635a service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Refreshing instance network info cache due to event network-changed-2c2d23fe-8f7f-4ed8-8d59-a9494654c051. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7f032018-c97c-4a10-8126-0e62427f9d94 req-f1fb1fab-946d-4a9d-a6cf-6631b37e635a service nova] Acquiring lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7f032018-c97c-4a10-8126-0e62427f9d94 req-f1fb1fab-946d-4a9d-a6cf-6631b37e635a service nova] Acquired lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG nova.network.neutron [req-7f032018-c97c-4a10-8126-0e62427f9d94 req-f1fb1fab-946d-4a9d-a6cf-6631b37e635a service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Refreshing network info cache for port 2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:28:34 user nova-compute[74242]: INFO nova.compute.claims [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Claim successful on node user
Oct 20 02:28:34 user nova-compute[74242]: DEBUG nova.network.neutron [req-7f032018-c97c-4a10-8126-0e62427f9d94 req-f1fb1fab-946d-4a9d-a6cf-6631b37e635a service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Updated VIF entry in instance network info cache for port 2c2d23fe-8f7f-4ed8-8d59-a9494654c051. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG nova.network.neutron [req-7f032018-c97c-4a10-8126-0e62427f9d94 req-f1fb1fab-946d-4a9d-a6cf-6631b37e635a service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Updating instance_info_cache with network_info: [{"id": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "address": "fa:16:3e:82:c4:e7", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2d23fe-8f", "ovs_interfaceid": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7f032018-c97c-4a10-8126-0e62427f9d94 req-f1fb1fab-946d-4a9d-a6cf-6631b37e635a service nova] Releasing lock "refresh_cache-cd90bd52-3af1-4d05-89df-2fedc535333f" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance cd90bd52-3af1-4d05-89df-2fedc535333f {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.360s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:28:34 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:28:34 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:28:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG nova.policy [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8efe11f71aba46d8bf834150b6284612', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e3092afce2f481282ed71b01dba0675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:28:35 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Creating image(s)
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "/opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "/opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "/opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.188s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.188s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk 1073741824" returned: 0 in 0.066s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-e3e5e2ba-b37f-44da-8194-ef764898492e req-232f713f-8413-42f1-8e01-70747fe699cb service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received event network-vif-unplugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e3e5e2ba-b37f-44da-8194-ef764898492e req-232f713f-8413-42f1-8e01-70747fe699cb service nova] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e3e5e2ba-b37f-44da-8194-ef764898492e req-232f713f-8413-42f1-8e01-70747fe699cb service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e3e5e2ba-b37f-44da-8194-ef764898492e req-232f713f-8413-42f1-8e01-70747fe699cb service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG nova.compute.manager [req-e3e5e2ba-b37f-44da-8194-ef764898492e req-232f713f-8413-42f1-8e01-70747fe699cb service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] No waiting events found dispatching network-vif-unplugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:35 user nova-compute[74242]: WARNING nova.compute.manager [req-e3e5e2ba-b37f-44da-8194-ef764898492e req-232f713f-8413-42f1-8e01-70747fe699cb service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received unexpected event network-vif-unplugged-61e204b4-d498-423a-8542-af401e188691 for instance with vm_state active and task_state rescuing.
Oct 20 02:28:35 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Successfully created port: e615d9b4-3b1b-4350-9174-c9bb7d0feba1 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.223s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:28:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Cannot resize image /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Ensure instance console log exists: /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0428ca56-f332-4600-8adf-a1a6be4012f6 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Successfully updated port: e615d9b4-3b1b-4350-9174-c9bb7d0feba1 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "refresh_cache-3bbdf97b-2499-4c4e-b531-8297ad2e7a38" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquired lock "refresh_cache-3bbdf97b-2499-4c4e-b531-8297ad2e7a38" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.compute.manager [req-baf480d8-f6fa-4346-a851-e92fe8fd1acc req-b29bbad3-1047-41aa-ac5f-2867b37deeca service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Received event network-changed-e615d9b4-3b1b-4350-9174-c9bb7d0feba1 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.compute.manager [req-baf480d8-f6fa-4346-a851-e92fe8fd1acc req-b29bbad3-1047-41aa-ac5f-2867b37deeca service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Refreshing instance network info cache due to event network-changed-e615d9b4-3b1b-4350-9174-c9bb7d0feba1. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-baf480d8-f6fa-4346-a851-e92fe8fd1acc req-b29bbad3-1047-41aa-ac5f-2867b37deeca service nova] Acquiring lock "refresh_cache-3bbdf97b-2499-4c4e-b531-8297ad2e7a38" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Updating instance_info_cache with network_info: [{"id": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "address": "fa:16:3e:5d:02:57", "network": {"id": "f2d4b88b-6573-44ea-a8b0-b597f04b986c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1466603443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e3092afce2f481282ed71b01dba0675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape615d9b4-3b", "ovs_interfaceid": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Releasing lock "refresh_cache-3bbdf97b-2499-4c4e-b531-8297ad2e7a38" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Instance network_info: |[{"id": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "address": "fa:16:3e:5d:02:57", "network": {"id": "f2d4b88b-6573-44ea-a8b0-b597f04b986c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1466603443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e3092afce2f481282ed71b01dba0675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape615d9b4-3b", "ovs_interfaceid": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-baf480d8-f6fa-4346-a851-e92fe8fd1acc req-b29bbad3-1047-41aa-ac5f-2867b37deeca service nova] Acquired lock "refresh_cache-3bbdf97b-2499-4c4e-b531-8297ad2e7a38" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.network.neutron [req-baf480d8-f6fa-4346-a851-e92fe8fd1acc req-b29bbad3-1047-41aa-ac5f-2867b37deeca service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Refreshing network info cache for port e615d9b4-3b1b-4350-9174-c9bb7d0feba1 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Start _get_guest_xml network_info=[{"id": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "address": "fa:16:3e:5d:02:57", "network": {"id": "f2d4b88b-6573-44ea-a8b0-b597f04b986c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1466603443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e3092afce2f481282ed71b01dba0675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape615d9b4-3b", "ovs_interfaceid": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:28:36 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:28:36 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:28:36 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:28:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-349934967',display_name='tempest-TestServerVolumeAttachmentScenario-server-349934967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-349934967',id=42,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaaSJzyY7lF+jrNYnQ3BoU/8TWhEMxZ0TB3AoSQeYn5OBB/rwz4adHZtg1H6bdz4gXQ0gKSh291/+MhGmhNwry5vRwPn9AyECfsxSb+g6YkMPeHAC9k76mZ1wsJiOlG+A==',key_name='tempest-keypair-1863196751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e3092afce2f481282ed71b01dba0675',ramdisk_id='',reservation_id='r-j3znw7lb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1001240990',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1001240990-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:28:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8efe11f71aba46d8bf834150b6284612',uuid=3bbdf97b-2499-4c4e-b531-8297ad2e7a38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "address": "fa:16:3e:5d:02:57", "network": {"id": "f2d4b88b-6573-44ea-a8b0-b597f04b986c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1466603443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e3092afce2f481282ed71b01dba0675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape615d9b4-3b", "ovs_interfaceid": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Converting VIF {"id": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "address": "fa:16:3e:5d:02:57", "network": {"id": "f2d4b88b-6573-44ea-a8b0-b597f04b986c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1466603443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e3092afce2f481282ed71b01dba0675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape615d9b4-3b", "ovs_interfaceid": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:02:57,bridge_name='br-int',has_traffic_filtering=True,id=e615d9b4-3b1b-4350-9174-c9bb7d0feba1,network=Network(f2d4b88b-6573-44ea-a8b0-b597f04b986c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape615d9b4-3b') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.objects.instance [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lazy-loading 'pci_devices' on Instance uuid 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:28:37 user nova-compute[74242]:   <uuid>3bbdf97b-2499-4c4e-b531-8297ad2e7a38</uuid>
Oct 20 02:28:37 user nova-compute[74242]:   <name>instance-0000002a</name>
Oct 20 02:28:37 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:28:37 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:28:37 user nova-compute[74242]:   <metadata>
Oct 20 02:28:37 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:28:37 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:28:37 user nova-compute[74242]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-349934967</nova:name>
Oct 20 02:28:37 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:28:36</nova:creationTime>
Oct 20 02:28:37 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:28:37 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:28:37 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:28:37 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:28:37 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:28:37 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:28:37 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:28:37 user nova-compute[74242]:       <nova:owner>
Oct 20 02:28:37 user nova-compute[74242]:         <nova:user uuid="8efe11f71aba46d8bf834150b6284612">tempest-TestServerVolumeAttachmentScenario-1001240990-project-member</nova:user>
Oct 20 02:28:37 user nova-compute[74242]:         <nova:project uuid="6e3092afce2f481282ed71b01dba0675">tempest-TestServerVolumeAttachmentScenario-1001240990</nova:project>
Oct 20 02:28:37 user nova-compute[74242]:       </nova:owner>
Oct 20 02:28:37 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:28:37 user nova-compute[74242]:       <nova:ports>
Oct 20 02:28:37 user nova-compute[74242]:         <nova:port uuid="e615d9b4-3b1b-4350-9174-c9bb7d0feba1">
Oct 20 02:28:37 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 20 02:28:37 user nova-compute[74242]:         </nova:port>
Oct 20 02:28:37 user nova-compute[74242]:       </nova:ports>
Oct 20 02:28:37 user nova-compute[74242]:     </nova:instance>
Oct 20 02:28:37 user nova-compute[74242]:   </metadata>
Oct 20 02:28:37 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:28:37 user nova-compute[74242]:     <system>
Oct 20 02:28:37 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:28:37 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:28:37 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:28:37 user nova-compute[74242]:       <entry name="serial">3bbdf97b-2499-4c4e-b531-8297ad2e7a38</entry>
Oct 20 02:28:37 user nova-compute[74242]:       <entry name="uuid">3bbdf97b-2499-4c4e-b531-8297ad2e7a38</entry>
Oct 20 02:28:37 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:28:37 user nova-compute[74242]:     </system>
Oct 20 02:28:37 user nova-compute[74242]:   </sysinfo>
Oct 20 02:28:37 user nova-compute[74242]:   <os>
Oct 20 02:28:37 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:28:37 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:28:37 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:28:37 user nova-compute[74242]:   </os>
Oct 20 02:28:37 user nova-compute[74242]:   <features>
Oct 20 02:28:37 user nova-compute[74242]:     <acpi/>
Oct 20 02:28:37 user nova-compute[74242]:     <apic/>
Oct 20 02:28:37 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:28:37 user nova-compute[74242]:   </features>
Oct 20 02:28:37 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:28:37 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:28:37 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:28:37 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:28:37 user nova-compute[74242]:   </clock>
Oct 20 02:28:37 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:28:37 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:28:37 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:28:37 user nova-compute[74242]:   </cpu>
Oct 20 02:28:37 user nova-compute[74242]:   <devices>
Oct 20 02:28:37 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:28:37 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:28:37 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk"/>
Oct 20 02:28:37 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:28:37 user nova-compute[74242]:     </disk>
Oct 20 02:28:37 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:28:37 user nova-compute[74242]:       <mac address="fa:16:3e:5d:02:57"/>
Oct 20 02:28:37 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:28:37 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:28:37 user nova-compute[74242]:       <target dev="tape615d9b4-3b"/>
Oct 20 02:28:37 user nova-compute[74242]:     </interface>
Oct 20 02:28:37 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:28:37 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/console.log" append="off"/>
Oct 20 02:28:37 user nova-compute[74242]:     </serial>
Oct 20 02:28:37 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:28:37 user nova-compute[74242]:     <video>
Oct 20 02:28:37 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:28:37 user nova-compute[74242]:     </video>
Oct 20 02:28:37 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:28:37 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:28:37 user nova-compute[74242]:     </rng>
Oct 20 02:28:37 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:28:37 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:28:37 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:28:37 user nova-compute[74242]:     </memballoon>
Oct 20 02:28:37 user nova-compute[74242]:   </devices>
Oct 20 02:28:37 user nova-compute[74242]: </domain>
Oct 20 02:28:37 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:28:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-349934967',display_name='tempest-TestServerVolumeAttachmentScenario-server-349934967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-349934967',id=42,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaaSJzyY7lF+jrNYnQ3BoU/8TWhEMxZ0TB3AoSQeYn5OBB/rwz4adHZtg1H6bdz4gXQ0gKSh291/+MhGmhNwry5vRwPn9AyECfsxSb+g6YkMPeHAC9k76mZ1wsJiOlG+A==',key_name='tempest-keypair-1863196751',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e3092afce2f481282ed71b01dba0675',ramdisk_id='',reservation_id='r-j3znw7lb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1001240990',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1001240990-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:28:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8efe11f71aba46d8bf834150b6284612',uuid=3bbdf97b-2499-4c4e-b531-8297ad2e7a38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "address": "fa:16:3e:5d:02:57", "network": {"id": "f2d4b88b-6573-44ea-a8b0-b597f04b986c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1466603443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e3092afce2f481282ed71b01dba0675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape615d9b4-3b", "ovs_interfaceid": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Converting VIF {"id": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "address": "fa:16:3e:5d:02:57", "network": {"id": "f2d4b88b-6573-44ea-a8b0-b597f04b986c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1466603443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e3092afce2f481282ed71b01dba0675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape615d9b4-3b", "ovs_interfaceid": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:02:57,bridge_name='br-int',has_traffic_filtering=True,id=e615d9b4-3b1b-4350-9174-c9bb7d0feba1,network=Network(f2d4b88b-6573-44ea-a8b0-b597f04b986c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape615d9b4-3b') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG os_vif [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:02:57,bridge_name='br-int',has_traffic_filtering=True,id=e615d9b4-3b1b-4350-9174-c9bb7d0feba1,network=Network(f2d4b88b-6573-44ea-a8b0-b597f04b986c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape615d9b4-3b') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f4f7d139-eb09-53e3-89ed-405bc0a3e27e', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape615d9b4-3b, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape615d9b4-3b, col_values=(('qos', UUID('44d20112-9098-41a9-a1fc-b06ac3acfdcd')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape615d9b4-3b, col_values=(('external_ids', {'iface-id': 'e615d9b4-3b1b-4350-9174-c9bb7d0feba1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5d:02:57', 'vm-uuid': '3bbdf97b-2499-4c4e-b531-8297ad2e7a38'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:37 user nova-compute[74242]: INFO os_vif [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:02:57,bridge_name='br-int',has_traffic_filtering=True,id=e615d9b4-3b1b-4350-9174-c9bb7d0feba1,network=Network(f2d4b88b-6573-44ea-a8b0-b597f04b986c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape615d9b4-3b')
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] No VIF found with MAC fa:16:3e:5d:02:57, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.network.neutron [req-baf480d8-f6fa-4346-a851-e92fe8fd1acc req-b29bbad3-1047-41aa-ac5f-2867b37deeca service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Updated VIF entry in instance network info cache for port e615d9b4-3b1b-4350-9174-c9bb7d0feba1. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.network.neutron [req-baf480d8-f6fa-4346-a851-e92fe8fd1acc req-b29bbad3-1047-41aa-ac5f-2867b37deeca service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Updating instance_info_cache with network_info: [{"id": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "address": "fa:16:3e:5d:02:57", "network": {"id": "f2d4b88b-6573-44ea-a8b0-b597f04b986c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1466603443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e3092afce2f481282ed71b01dba0675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape615d9b4-3b", "ovs_interfaceid": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-baf480d8-f6fa-4346-a851-e92fe8fd1acc req-b29bbad3-1047-41aa-ac5f-2867b37deeca service nova] Releasing lock "refresh_cache-3bbdf97b-2499-4c4e-b531-8297ad2e7a38" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] No waiting events found dispatching network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:37 user nova-compute[74242]: WARNING nova.compute.manager [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received unexpected event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 for instance with vm_state rescued and task_state None.
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] No waiting events found dispatching network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:37 user nova-compute[74242]: WARNING nova.compute.manager [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received unexpected event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 for instance with vm_state rescued and task_state None.
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] No waiting events found dispatching network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:37 user nova-compute[74242]: WARNING nova.compute.manager [req-6acbb238-a289-458c-a01a-5a64e98f4e11 req-fd91b59c-7dbd-426e-8391-0d492de2470b service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received unexpected event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 for instance with vm_state rescued and task_state None.
Oct 20 02:28:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-1614190d-9202-44f7-989f-4ff371c302b9 req-30929167-efb2-4bf9-8f30-e2ca2f1354ee service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Received event network-vif-plugged-e615d9b4-3b1b-4350-9174-c9bb7d0feba1 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1614190d-9202-44f7-989f-4ff371c302b9 req-30929167-efb2-4bf9-8f30-e2ca2f1354ee service nova] Acquiring lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1614190d-9202-44f7-989f-4ff371c302b9 req-30929167-efb2-4bf9-8f30-e2ca2f1354ee service nova] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1614190d-9202-44f7-989f-4ff371c302b9 req-30929167-efb2-4bf9-8f30-e2ca2f1354ee service nova] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-1614190d-9202-44f7-989f-4ff371c302b9 req-30929167-efb2-4bf9-8f30-e2ca2f1354ee service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] No waiting events found dispatching network-vif-plugged-e615d9b4-3b1b-4350-9174-c9bb7d0feba1 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:38 user nova-compute[74242]: WARNING nova.compute.manager [req-1614190d-9202-44f7-989f-4ff371c302b9 req-30929167-efb2-4bf9-8f30-e2ca2f1354ee service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Received unexpected event network-vif-plugged-e615d9b4-3b1b-4350-9174-c9bb7d0feba1 for instance with vm_state building and task_state spawning.
Oct 20 02:28:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:40 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:28:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:28:40 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Instance spawned successfully.
Oct 20 02:28:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:28:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:28:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:28:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:28:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:28:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:28:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:28:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-ca1ec497-42c0-44ae-a1b3-b232c1e81d35 req-85993f3a-84d7-4380-a8ac-444535cee86e service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Received event network-vif-plugged-e615d9b4-3b1b-4350-9174-c9bb7d0feba1 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ca1ec497-42c0-44ae-a1b3-b232c1e81d35 req-85993f3a-84d7-4380-a8ac-444535cee86e service nova] Acquiring lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ca1ec497-42c0-44ae-a1b3-b232c1e81d35 req-85993f3a-84d7-4380-a8ac-444535cee86e service nova] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ca1ec497-42c0-44ae-a1b3-b232c1e81d35 req-85993f3a-84d7-4380-a8ac-444535cee86e service nova] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-ca1ec497-42c0-44ae-a1b3-b232c1e81d35 req-85993f3a-84d7-4380-a8ac-444535cee86e service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] No waiting events found dispatching network-vif-plugged-e615d9b4-3b1b-4350-9174-c9bb7d0feba1 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:40 user nova-compute[74242]: WARNING nova.compute.manager [req-ca1ec497-42c0-44ae-a1b3-b232c1e81d35 req-85993f3a-84d7-4380-a8ac-444535cee86e service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Received unexpected event network-vif-plugged-e615d9b4-3b1b-4350-9174-c9bb7d0feba1 for instance with vm_state building and task_state spawning.
Oct 20 02:28:40 user nova-compute[74242]: INFO nova.compute.manager [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Took 5.80 seconds to spawn the instance on the hypervisor.
Oct 20 02:28:40 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:28:41 user nova-compute[74242]: INFO nova.compute.manager [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Took 6.48 seconds to build instance.
Oct 20 02:28:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9ce0f417-d71d-41a3-92b6-6e35b7f424ff tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.584s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:42 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:28:43 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:28:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:46 user nova-compute[74242]: INFO nova.compute.manager [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Terminating instance
Oct 20 02:28:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:28:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-dde8eadf-41be-4610-8272-eb26a526843d req-130ee577-c51c-40b5-a3c6-ca2bbe4f67f5 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received event network-vif-unplugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dde8eadf-41be-4610-8272-eb26a526843d req-130ee577-c51c-40b5-a3c6-ca2bbe4f67f5 service nova] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dde8eadf-41be-4610-8272-eb26a526843d req-130ee577-c51c-40b5-a3c6-ca2bbe4f67f5 service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dde8eadf-41be-4610-8272-eb26a526843d req-130ee577-c51c-40b5-a3c6-ca2bbe4f67f5 service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-dde8eadf-41be-4610-8272-eb26a526843d req-130ee577-c51c-40b5-a3c6-ca2bbe4f67f5 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] No waiting events found dispatching network-vif-unplugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-dde8eadf-41be-4610-8272-eb26a526843d req-130ee577-c51c-40b5-a3c6-ca2bbe4f67f5 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received event network-vif-unplugged-989425d9-6ff3-4460-9b24-aede590c961c for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:28:47 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Instance destroyed successfully.
Oct 20 02:28:47 user nova-compute[74242]: DEBUG nova.objects.instance [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'resources' on Instance uuid c98e383a-e1e5-4130-9cc6-a9823db0b88c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:12:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1676419618',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1676419618',id=24,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:14:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112fda62d355421e80e674dc18bb5069',ramdisk_id='',reservation_id='r-zquvak2x',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:16:45Z,user_data=None,user_id='9ac628a224fb4653932a27e33aa33c9d',uuid=c98e383a-e1e5-4130-9cc6-a9823db0b88c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converting VIF {"id": "989425d9-6ff3-4460-9b24-aede590c961c", "address": "fa:16:3e:b6:6c:1f", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap989425d9-6f", "ovs_interfaceid": "989425d9-6ff3-4460-9b24-aede590c961c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b6:6c:1f,bridge_name='br-int',has_traffic_filtering=True,id=989425d9-6ff3-4460-9b24-aede590c961c,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989425d9-6f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_vif [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:6c:1f,bridge_name='br-int',has_traffic_filtering=True,id=989425d9-6ff3-4460-9b24-aede590c961c,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989425d9-6f') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap989425d9-6f, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d260291-291d-4b12-9c99-8ca8da2d0e34) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:28:47 user nova-compute[74242]: INFO os_vif [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b6:6c:1f,bridge_name='br-int',has_traffic_filtering=True,id=989425d9-6ff3-4460-9b24-aede590c961c,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap989425d9-6f')
Oct 20 02:28:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'klugFvEU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:28:47 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa2e37ca-1bb0-41ea-b9aa-a898d3c46ba7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:28:47 user nova-compute[74242]: No targets found.
Oct 20 02:28:47 user nova-compute[74242]: iSNS:
Oct 20 02:28:47 user nova-compute[74242]: No targets found.
Oct 20 02:28:47 user nova-compute[74242]: STATIC:
Oct 20 02:28:47 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923
Oct 20 02:28:47 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:28:47 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:28:47 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26
Oct 20 02:28:47 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:28:47 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:28:47 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0
Oct 20 02:28:47 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:28:47 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:28:47 user nova-compute[74242]: FIRMWARE:
Oct 20 02:28:47 user nova-compute[74242]: No targets found.
Oct 20 02:28:47 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:28:47 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:28:47 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8423aae9-d572-4496-8ac9-5a09fb72d68e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[602dd748-3e3d-400f-b09d-d62b879c39c6]: (4, ('tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:28:47 user nova-compute[74242]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)
Oct 20 02:28:47 user nova-compute[74242]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 (non-flash)
Oct 20 02:28:47 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsi session list stdout=tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 (non-flash)
Oct 20 02:28:47 user nova-compute[74242]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)
Oct 20 02:28:47 user nova-compute[74242]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 (non-flash)
Oct 20 02:28:47 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d029a440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26'): ({'sdc'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Removing single pathed devices sdc {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[244ab47b-47dd-4a0c-82ae-4e966529b0ed]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9facf641-b97a-4963-90cb-243cdeeba32d]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Flushing IO for device /dev/sdc {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66a28ab-9a74-4f46-8446-8df106a8bf0e]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Updating instance_info_cache with network_info: [{"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[510a8b34-bead-4dbd-bfa6-d5948ad1d8af]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef59d150-2a19-42be-8d62-8ecf09d07be8]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:47 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6e694b-1573-426e-aff3-4c7b8baccd3f]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26, portal: 172.16.0.220,3260]
Oct 20 02:28:48 user nova-compute[74242]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26, portal: 172.16.0.220,3260] successful.
Oct 20 02:28:48 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:48 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8236db11-4fd2-495a-b6ca-e0801bc01d26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:48 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[683f41ba-4db6-4f60-bfe2-26368aaa3964]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:28:48 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] <== disconnect_volume: return (368ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:28:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:28:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Deleting instance files /opt/stack/data/nova/instances/c98e383a-e1e5-4130-9cc6-a9823db0b88c_del
Oct 20 02:28:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Deletion of /opt/stack/data/nova/instances/c98e383a-e1e5-4130-9cc6-a9823db0b88c_del complete
Oct 20 02:28:48 user nova-compute[74242]: INFO nova.compute.manager [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Took 1.38 seconds to destroy the instance on the hypervisor.
Oct 20 02:28:48 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:28:48 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:28:48 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:28:48 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:28:48 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Took 0.57 seconds to deallocate network for instance.
Oct 20 02:28:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-5c5c4a81-c0f4-42d2-8e0d-fabd1b95b474 req-f14807dc-c492-42d7-8335-a27258a17cdb service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received event network-vif-deleted-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-697039b6-d130-4e58-a736-b2fd5df3d170 req-b3b231f0-c028-4a3c-a44a-5f4c136b6394 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:28:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-697039b6-d130-4e58-a736-b2fd5df3d170 req-b3b231f0-c028-4a3c-a44a-5f4c136b6394 service nova] Acquiring lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-697039b6-d130-4e58-a736-b2fd5df3d170 req-b3b231f0-c028-4a3c-a44a-5f4c136b6394 service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-697039b6-d130-4e58-a736-b2fd5df3d170 req-b3b231f0-c028-4a3c-a44a-5f4c136b6394 service nova] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-697039b6-d130-4e58-a736-b2fd5df3d170 req-b3b231f0-c028-4a3c-a44a-5f4c136b6394 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] No waiting events found dispatching network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:28:49 user nova-compute[74242]: WARNING nova.compute.manager [req-697039b6-d130-4e58-a736-b2fd5df3d170 req-b3b231f0-c028-4a3c-a44a-5f4c136b6394 service nova] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Received unexpected event network-vif-plugged-989425d9-6ff3-4460-9b24-aede590c961c for instance with vm_state active and task_state deleting.
Oct 20 02:28:49 user nova-compute[74242]: INFO nova.compute.manager [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: c98e383a-e1e5-4130-9cc6-a9823db0b88c] Took 0.81 seconds to detach 1 volumes for instance.
Oct 20 02:28:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:49 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Refreshing inventories for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 02:28:49 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Updating ProviderTree inventory for provider 07b40460-b6ac-48c1-8447-e1778d50b26e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 02:28:49 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Updating inventory in ProviderTree for provider 07b40460-b6ac-48c1-8447-e1778d50b26e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 02:28:49 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Refreshing aggregate associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, aggregates: None {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 02:28:49 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Refreshing trait associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 02:28:50 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:28:50 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:28:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.632s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:50 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:28:50 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:28:50 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:28:50 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Deleted allocations for instance c98e383a-e1e5-4130-9cc6-a9823db0b88c
Oct 20 02:28:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:50 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:28:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-51161538-1358-4b80-9dd2-e8d0203285cd tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "c98e383a-e1e5-4130-9cc6-a9823db0b88c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.603s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:28:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.rescue --force-share --output=json" returned: 0 in 0.195s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:54 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:28:54 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:28:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8070MB free_disk=24.695850372314453GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance cd90bd52-3af1-4d05-89df-2fedc535333f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 8497b901-64fb-44f3-bd07-f584ab799867 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:28:54 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance cd90bd52-3af1-4d05-89df-2fedc535333f is timed out.
Oct 20 02:28:54 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Successfully detached device vdb from instance cd90bd52-3af1-4d05-89df-2fedc535333f from the live domain config.
Oct 20 02:28:54 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GEVnXUSj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:28:54 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4dbacd3-ecdb-4bff-a33f-29d0f540c940]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:28:54 user nova-compute[74242]: No targets found.
Oct 20 02:28:54 user nova-compute[74242]: iSNS:
Oct 20 02:28:54 user nova-compute[74242]: No targets found.
Oct 20 02:28:54 user nova-compute[74242]: STATIC:
Oct 20 02:28:54 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923
Oct 20 02:28:54 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:28:54 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:28:54 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0
Oct 20 02:28:54 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:28:54 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:28:54 user nova-compute[74242]: FIRMWARE:
Oct 20 02:28:54 user nova-compute[74242]: No targets found.
Oct 20 02:28:54 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:28:54 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:28:54 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c35c297f-1e38-48fd-8dcf-250b7e60c1b2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0abe13-dac3-4485-b633-6dd52b7d149d]: (4, ('tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)
Oct 20 02:28:54 user nova-compute[74242]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 (non-flash)
Oct 20 02:28:54 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsi session list stdout=tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 (non-flash)
Oct 20 02:28:54 user nova-compute[74242]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 (non-flash)
Oct 20 02:28:54 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b82e5990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0'): ({'sdd'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Removing single pathed devices sdd {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[28169401-9f1c-4259-8a76-76a6cf4eebac]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.402s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce03a34-1328-42e3-bc59-e83277946692]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Flushing IO for device /dev/sdd {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f26502f7-9982-48a7-80e2-c514ba4068a4]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d1469b-16e5-4ece-bafa-8a5f63f0156b]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f1acad-c131-433b-8871-bedc25b983fe]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[259db4c9-e4c8-47c7-b2c3-7814f6915176]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0, portal: 172.16.0.220,3260]
Oct 20 02:28:54 user nova-compute[74242]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0, portal: 172.16.0.220,3260] successful.
Oct 20 02:28:54 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:28:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:178359d2-67f6-4df9-9255-1db6d1c0e7d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:28:55 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58586f1-7943-49eb-a93a-761e39256ce3]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:28:55 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:28:55 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:28:55 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] <== disconnect_volume: return (337ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:28:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:28:55 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:28:55 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:28:55 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:28:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:55 user nova-compute[74242]: DEBUG nova.objects.instance [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lazy-loading 'flavor' on Instance uuid cd90bd52-3af1-4d05-89df-2fedc535333f {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:28:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cd74bcc8-fd79-4a16-a777-5a35a6d2f671 tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.184s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:28:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:28:59 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:28:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 02:28:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] There are 0 instances to clean {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 02:29:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:02 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:29:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:04 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:29:04 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74242) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 02:29:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:29:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:29:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "cd90bd52-3af1-4d05-89df-2fedc535333f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:29:32 user nova-compute[74242]: INFO nova.compute.manager [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Terminating instance
Oct 20 02:29:32 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-56ed9fc3-d67b-4ba8-bce2-758f9cce5133 req-8dde39c9-e174-4bf9-af80-67d435cbef31 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received event network-vif-unplugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-56ed9fc3-d67b-4ba8-bce2-758f9cce5133 req-8dde39c9-e174-4bf9-af80-67d435cbef31 service nova] Acquiring lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-56ed9fc3-d67b-4ba8-bce2-758f9cce5133 req-8dde39c9-e174-4bf9-af80-67d435cbef31 service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-56ed9fc3-d67b-4ba8-bce2-758f9cce5133 req-8dde39c9-e174-4bf9-af80-67d435cbef31 service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-56ed9fc3-d67b-4ba8-bce2-758f9cce5133 req-8dde39c9-e174-4bf9-af80-67d435cbef31 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] No waiting events found dispatching network-vif-unplugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:29:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-56ed9fc3-d67b-4ba8-bce2-758f9cce5133 req-8dde39c9-e174-4bf9-af80-67d435cbef31 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received event network-vif-unplugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:33 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Instance destroyed successfully.
Oct 20 02:29:33 user nova-compute[74242]: DEBUG nova.objects.instance [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lazy-loading 'resources' on Instance uuid cd90bd52-3af1-4d05-89df-2fedc535333f {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:23:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1877870132',display_name='tempest-TestMinimumBasicScenario-server-1877870132',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1877870132',id=39,image_ref='c7a2d6bc-338a-43fc-8006-1cdb0e5d01b0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4XGkNXhmZyVO9rRYFmTGZhnTH0VHPUelC0pff5/k6FGdngV5Y2wRw9UDtqIgw8EAahVoeOTM98kSZtmGSwWUEYXJwkIcozU4nABQ8YM/SitKXw25O+g3FxxS9hZROoPQ==',key_name='tempest-TestMinimumBasicScenario-841959097',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:23:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7331dc1aa6464021bb371a8ebcf3a42b',ramdisk_id='',reservation_id='r-3mwlxt9g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c7a2d6bc-338a-43fc-8006-1cdb0e5d01b0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-504118242',owner_user_name='tempest-TestMinimumBasicScenario-504118242-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:26:47Z,user_data=None,user_id='8b64ecd6426f429ba929925fca497c82',uuid=cd90bd52-3af1-4d05-89df-2fedc535333f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "address": "fa:16:3e:82:c4:e7", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2d23fe-8f", "ovs_interfaceid": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converting VIF {"id": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "address": "fa:16:3e:82:c4:e7", "network": {"id": "ada27404-09cc-434f-84db-60071e4e362f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1396480253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7331dc1aa6464021bb371a8ebcf3a42b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c2d23fe-8f", "ovs_interfaceid": "2c2d23fe-8f7f-4ed8-8d59-a9494654c051", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:82:c4:e7,bridge_name='br-int',has_traffic_filtering=True,id=2c2d23fe-8f7f-4ed8-8d59-a9494654c051,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2d23fe-8f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG os_vif [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:c4:e7,bridge_name='br-int',has_traffic_filtering=True,id=2c2d23fe-8f7f-4ed8-8d59-a9494654c051,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2d23fe-8f') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c2d23fe-8f, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2d82ea03-b19b-44f7-99ec-4a2247d696b3) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:33 user nova-compute[74242]: INFO os_vif [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:82:c4:e7,bridge_name='br-int',has_traffic_filtering=True,id=2c2d23fe-8f7f-4ed8-8d59-a9494654c051,network=Network(ada27404-09cc-434f-84db-60071e4e362f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c2d23fe-8f')
Oct 20 02:29:33 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Deleting instance files /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f_del
Oct 20 02:29:33 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Deletion of /opt/stack/data/nova/instances/cd90bd52-3af1-4d05-89df-2fedc535333f_del complete
Oct 20 02:29:33 user nova-compute[74242]: INFO nova.compute.manager [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 20 02:29:33 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:29:33 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:29:34 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:29:34 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Took 0.50 seconds to deallocate network for instance.
Oct 20 02:29:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:29:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:29:34 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:29:34 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:29:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.248s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:29:34 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Deleted allocations for instance cd90bd52-3af1-4d05-89df-2fedc535333f
Oct 20 02:29:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0ac2d0ef-d5fa-4353-983c-6e68a069342d tempest-TestMinimumBasicScenario-504118242 tempest-TestMinimumBasicScenario-504118242-project-member] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.822s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:29:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-e4d62f23-aef5-4fef-8de0-1b3e683b186d req-6c3cff76-8d1f-4a8e-b276-bbc521db3729 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received event network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:29:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e4d62f23-aef5-4fef-8de0-1b3e683b186d req-6c3cff76-8d1f-4a8e-b276-bbc521db3729 service nova] Acquiring lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:29:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e4d62f23-aef5-4fef-8de0-1b3e683b186d req-6c3cff76-8d1f-4a8e-b276-bbc521db3729 service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:29:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e4d62f23-aef5-4fef-8de0-1b3e683b186d req-6c3cff76-8d1f-4a8e-b276-bbc521db3729 service nova] Lock "cd90bd52-3af1-4d05-89df-2fedc535333f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:29:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-e4d62f23-aef5-4fef-8de0-1b3e683b186d req-6c3cff76-8d1f-4a8e-b276-bbc521db3729 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] No waiting events found dispatching network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:29:34 user nova-compute[74242]: WARNING nova.compute.manager [req-e4d62f23-aef5-4fef-8de0-1b3e683b186d req-6c3cff76-8d1f-4a8e-b276-bbc521db3729 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received unexpected event network-vif-plugged-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 for instance with vm_state deleted and task_state None.
Oct 20 02:29:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-e4d62f23-aef5-4fef-8de0-1b3e683b186d req-6c3cff76-8d1f-4a8e-b276-bbc521db3729 service nova] [instance: cd90bd52-3af1-4d05-89df-2fedc535333f] Received event network-vif-deleted-2c2d23fe-8f7f-4ed8-8d59-a9494654c051 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:29:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "39a5ba0f-e581-49c3-a179-62d6c333fa59" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:29:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:29:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "39a5ba0f-e581-49c3-a179-62d6c333fa59-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:29:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:29:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:29:37 user nova-compute[74242]: INFO nova.compute.manager [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Terminating instance
Oct 20 02:29:37 user nova-compute[74242]: DEBUG nova.compute.manager [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:29:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-6ea8a56b-be0d-4e34-9507-ae4d6f8ad5f9 req-52ef1db4-2ef2-40d3-a461-85a29d50d4bc service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Received event network-vif-unplugged-57aa37e7-d468-477c-ae9f-0a1ccebdf445 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6ea8a56b-be0d-4e34-9507-ae4d6f8ad5f9 req-52ef1db4-2ef2-40d3-a461-85a29d50d4bc service nova] Acquiring lock "39a5ba0f-e581-49c3-a179-62d6c333fa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6ea8a56b-be0d-4e34-9507-ae4d6f8ad5f9 req-52ef1db4-2ef2-40d3-a461-85a29d50d4bc service nova] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6ea8a56b-be0d-4e34-9507-ae4d6f8ad5f9 req-52ef1db4-2ef2-40d3-a461-85a29d50d4bc service nova] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-6ea8a56b-be0d-4e34-9507-ae4d6f8ad5f9 req-52ef1db4-2ef2-40d3-a461-85a29d50d4bc service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] No waiting events found dispatching network-vif-unplugged-57aa37e7-d468-477c-ae9f-0a1ccebdf445 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-6ea8a56b-be0d-4e34-9507-ae4d6f8ad5f9 req-52ef1db4-2ef2-40d3-a461-85a29d50d4bc service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Received event network-vif-unplugged-57aa37e7-d468-477c-ae9f-0a1ccebdf445 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:29:38 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Instance destroyed successfully.
Oct 20 02:29:38 user nova-compute[74242]: DEBUG nova.objects.instance [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lazy-loading 'resources' on Instance uuid 39a5ba0f-e581-49c3-a179-62d6c333fa59 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:09:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-25051770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-25051770',id=19,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:10:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='112fda62d355421e80e674dc18bb5069',ramdisk_id='',reservation_id='r-o9jgeo22',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:11:54Z,user_data=None,user_id='9ac628a224fb4653932a27e33aa33c9d',uuid=39a5ba0f-e581-49c3-a179-62d6c333fa59,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "address": "fa:16:3e:79:1a:39", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57aa37e7-d4", "ovs_interfaceid": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converting VIF {"id": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "address": "fa:16:3e:79:1a:39", "network": {"id": "1703af92-8964-46b3-92d0-af41d67a91bf", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-1717370214-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "112fda62d355421e80e674dc18bb5069", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57aa37e7-d4", "ovs_interfaceid": "57aa37e7-d468-477c-ae9f-0a1ccebdf445", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:79:1a:39,bridge_name='br-int',has_traffic_filtering=True,id=57aa37e7-d468-477c-ae9f-0a1ccebdf445,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57aa37e7-d4') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG os_vif [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:1a:39,bridge_name='br-int',has_traffic_filtering=True,id=57aa37e7-d468-477c-ae9f-0a1ccebdf445,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57aa37e7-d4') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57aa37e7-d4, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3758fa9a-aa10-4e3a-b169-884a3ea4a811) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:29:38 user nova-compute[74242]: INFO os_vif [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:79:1a:39,bridge_name='br-int',has_traffic_filtering=True,id=57aa37e7-d468-477c-ae9f-0a1ccebdf445,network=Network(1703af92-8964-46b3-92d0-af41d67a91bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57aa37e7-d4')
Oct 20 02:29:38 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Deleting instance files /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59_del
Oct 20 02:29:38 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Deletion of /opt/stack/data/nova/instances/39a5ba0f-e581-49c3-a179-62d6c333fa59_del complete
Oct 20 02:29:38 user nova-compute[74242]: INFO nova.compute.manager [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Took 0.66 seconds to destroy the instance on the hypervisor.
Oct 20 02:29:38 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:29:38 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Took 0.40 seconds to deallocate network for instance.
Oct 20 02:29:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-5b47b30d-ece1-4d34-afe9-d39d11ff560a req-f8664b46-73a3-4418-9803-607d5b2f41d3 service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Received event network-vif-deleted-57aa37e7-d468-477c-ae9f-0a1ccebdf445 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:29:38 user nova-compute[74242]: INFO nova.compute.manager [req-5b47b30d-ece1-4d34-afe9-d39d11ff560a req-f8664b46-73a3-4418-9803-607d5b2f41d3 service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Neutron deleted interface 57aa37e7-d468-477c-ae9f-0a1ccebdf445; detaching it from the instance and deleting it from the info cache
Oct 20 02:29:38 user nova-compute[74242]: DEBUG nova.network.neutron [req-5b47b30d-ece1-4d34-afe9-d39d11ff560a req-f8664b46-73a3-4418-9803-607d5b2f41d3 service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-5b47b30d-ece1-4d34-afe9-d39d11ff560a req-f8664b46-73a3-4418-9803-607d5b2f41d3 service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Detach interface failed, port_id=57aa37e7-d468-477c-ae9f-0a1ccebdf445, reason: Instance 39a5ba0f-e581-49c3-a179-62d6c333fa59 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:29:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.213s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:29:39 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Deleted allocations for instance 39a5ba0f-e581-49c3-a179-62d6c333fa59
Oct 20 02:29:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-25351d83-c2ae-4344-abad-a37eb34bcd74 tempest-ServerBootFromVolumeStableRescueTest-1661425956 tempest-ServerBootFromVolumeStableRescueTest-1661425956-project-member] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.451s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:29:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-ca254265-7844-4853-b786-b26073ce0f33 req-024f65b4-78c2-4288-ba8c-fc6952892584 service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Received event network-vif-plugged-57aa37e7-d468-477c-ae9f-0a1ccebdf445 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:29:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ca254265-7844-4853-b786-b26073ce0f33 req-024f65b4-78c2-4288-ba8c-fc6952892584 service nova] Acquiring lock "39a5ba0f-e581-49c3-a179-62d6c333fa59-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:29:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ca254265-7844-4853-b786-b26073ce0f33 req-024f65b4-78c2-4288-ba8c-fc6952892584 service nova] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:29:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ca254265-7844-4853-b786-b26073ce0f33 req-024f65b4-78c2-4288-ba8c-fc6952892584 service nova] Lock "39a5ba0f-e581-49c3-a179-62d6c333fa59-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:29:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-ca254265-7844-4853-b786-b26073ce0f33 req-024f65b4-78c2-4288-ba8c-fc6952892584 service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] No waiting events found dispatching network-vif-plugged-57aa37e7-d468-477c-ae9f-0a1ccebdf445 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:29:40 user nova-compute[74242]: WARNING nova.compute.manager [req-ca254265-7844-4853-b786-b26073ce0f33 req-024f65b4-78c2-4288-ba8c-fc6952892584 service nova] [instance: 39a5ba0f-e581-49c3-a179-62d6c333fa59] Received unexpected event network-vif-plugged-57aa37e7-d468-477c-ae9f-0a1ccebdf445 for instance with vm_state deleted and task_state None.
Oct 20 02:29:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:43 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:29:45 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:29:47 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:29:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:29:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:29:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:29:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:29:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Updating instance_info_cache with network_info: [{"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:29:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:29:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:29:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:48 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:29:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:29:51 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:29:51 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:29:51 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:29:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:29:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:29:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:29:51 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:29:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:29:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:29:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:29:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:29:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:29:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:29:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:29:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:29:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:29:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:29:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:29:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:29:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:29:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:29:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:29:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:29:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:29:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:29:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:29:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:29:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:29:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:29:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:29:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:29:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:29:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:29:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:29:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:29:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:29:54 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:29:54 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:29:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8375MB free_disk=24.810993194580078GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:29:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:29:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:29:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:29:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:29:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 8497b901-64fb-44f3-bd07-f584ab799867 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:29:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:29:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:29:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:29:54 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:29:54 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:29:54 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:29:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:29:55 user nova-compute[74242]: INFO nova.compute.manager [None req-2d9f37af-7939-474b-8318-7ad990bb4a12 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Unrescuing
Oct 20 02:29:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2d9f37af-7939-474b-8318-7ad990bb4a12 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:29:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2d9f37af-7939-474b-8318-7ad990bb4a12 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquired lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:29:55 user nova-compute[74242]: DEBUG nova.network.neutron [None req-2d9f37af-7939-474b-8318-7ad990bb4a12 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:29:55 user nova-compute[74242]: DEBUG nova.network.neutron [None req-2d9f37af-7939-474b-8318-7ad990bb4a12 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updating instance_info_cache with network_info: [{"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:29:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2d9f37af-7939-474b-8318-7ad990bb4a12 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Releasing lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:29:55 user nova-compute[74242]: DEBUG nova.objects.instance [None req-2d9f37af-7939-474b-8318-7ad990bb4a12 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lazy-loading 'flavor' on Instance uuid 8497b901-64fb-44f3-bd07-f584ab799867 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:29:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-cb158b70-82a4-4fd2-ad4e-318910a7d532 req-8751f48a-6acf-4e57-8477-45404cb07ee6 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-unplugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:29:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cb158b70-82a4-4fd2-ad4e-318910a7d532 req-8751f48a-6acf-4e57-8477-45404cb07ee6 service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:29:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cb158b70-82a4-4fd2-ad4e-318910a7d532 req-8751f48a-6acf-4e57-8477-45404cb07ee6 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:29:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-cb158b70-82a4-4fd2-ad4e-318910a7d532 req-8751f48a-6acf-4e57-8477-45404cb07ee6 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:29:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-cb158b70-82a4-4fd2-ad4e-318910a7d532 req-8751f48a-6acf-4e57-8477-45404cb07ee6 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-unplugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:29:56 user nova-compute[74242]: WARNING nova.compute.manager [req-cb158b70-82a4-4fd2-ad4e-318910a7d532 req-8751f48a-6acf-4e57-8477-45404cb07ee6 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received unexpected event network-vif-unplugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:29:56 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Instance destroyed successfully.
Oct 20 02:29:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-0f114f16-2fdf-4527-ac97-231053b12379 req-0f278163-ce9d-4fb9-902d-93bc36eb7390 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-changed-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:29:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-0f114f16-2fdf-4527-ac97-231053b12379 req-0f278163-ce9d-4fb9-902d-93bc36eb7390 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Refreshing instance network info cache due to event network-changed-df5d650c-5e5c-4822-8154-7fc1213190b4. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:29:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0f114f16-2fdf-4527-ac97-231053b12379 req-0f278163-ce9d-4fb9-902d-93bc36eb7390 service nova] Acquiring lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:29:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0f114f16-2fdf-4527-ac97-231053b12379 req-0f278163-ce9d-4fb9-902d-93bc36eb7390 service nova] Acquired lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:29:56 user nova-compute[74242]: DEBUG nova.network.neutron [req-0f114f16-2fdf-4527-ac97-231053b12379 req-0f278163-ce9d-4fb9-902d-93bc36eb7390 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Refreshing network info cache for port df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:29:57 user nova-compute[74242]: DEBUG nova.network.neutron [req-0f114f16-2fdf-4527-ac97-231053b12379 req-0f278163-ce9d-4fb9-902d-93bc36eb7390 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updated VIF entry in instance network info cache for port df5d650c-5e5c-4822-8154-7fc1213190b4. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:29:57 user nova-compute[74242]: DEBUG nova.network.neutron [req-0f114f16-2fdf-4527-ac97-231053b12379 req-0f278163-ce9d-4fb9-902d-93bc36eb7390 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updating instance_info_cache with network_info: [{"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:29:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-0f114f16-2fdf-4527-ac97-231053b12379 req-0f278163-ce9d-4fb9-902d-93bc36eb7390 service nova] Releasing lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:29:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-23ec4c48-4d20-43c4-9e37-ae1b2a8868c9 req-59f03a0c-d992-4e5c-b80f-ea1dca5e4130 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-23ec4c48-4d20-43c4-9e37-ae1b2a8868c9 req-59f03a0c-d992-4e5c-b80f-ea1dca5e4130 service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-23ec4c48-4d20-43c4-9e37-ae1b2a8868c9 req-59f03a0c-d992-4e5c-b80f-ea1dca5e4130 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-23ec4c48-4d20-43c4-9e37-ae1b2a8868c9 req-59f03a0c-d992-4e5c-b80f-ea1dca5e4130 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-23ec4c48-4d20-43c4-9e37-ae1b2a8868c9 req-59f03a0c-d992-4e5c-b80f-ea1dca5e4130 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:29:58 user nova-compute[74242]: WARNING nova.compute.manager [req-23ec4c48-4d20-43c4-9e37-ae1b2a8868c9 req-59f03a0c-d992-4e5c-b80f-ea1dca5e4130 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received unexpected event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:29:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-23ec4c48-4d20-43c4-9e37-ae1b2a8868c9 req-59f03a0c-d992-4e5c-b80f-ea1dca5e4130 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-23ec4c48-4d20-43c4-9e37-ae1b2a8868c9 req-59f03a0c-d992-4e5c-b80f-ea1dca5e4130 service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-23ec4c48-4d20-43c4-9e37-ae1b2a8868c9 req-59f03a0c-d992-4e5c-b80f-ea1dca5e4130 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-23ec4c48-4d20-43c4-9e37-ae1b2a8868c9 req-59f03a0c-d992-4e5c-b80f-ea1dca5e4130 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-23ec4c48-4d20-43c4-9e37-ae1b2a8868c9 req-59f03a0c-d992-4e5c-b80f-ea1dca5e4130 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:29:58 user nova-compute[74242]: WARNING nova.compute.manager [req-23ec4c48-4d20-43c4-9e37-ae1b2a8868c9 req-59f03a0c-d992-4e5c-b80f-ea1dca5e4130 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received unexpected event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:29:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-a01877b9-55ce-40b3-aa47-98749236d48c req-e659f570-93e3-485c-875c-3af6e3efdbeb service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-changed-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-a01877b9-55ce-40b3-aa47-98749236d48c req-e659f570-93e3-485c-875c-3af6e3efdbeb service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Refreshing instance network info cache due to event network-changed-df5d650c-5e5c-4822-8154-7fc1213190b4. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a01877b9-55ce-40b3-aa47-98749236d48c req-e659f570-93e3-485c-875c-3af6e3efdbeb service nova] Acquiring lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a01877b9-55ce-40b3-aa47-98749236d48c req-e659f570-93e3-485c-875c-3af6e3efdbeb service nova] Acquired lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:29:58 user nova-compute[74242]: DEBUG nova.network.neutron [req-a01877b9-55ce-40b3-aa47-98749236d48c req-e659f570-93e3-485c-875c-3af6e3efdbeb service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Refreshing network info cache for port df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:29:59 user nova-compute[74242]: DEBUG nova.network.neutron [req-a01877b9-55ce-40b3-aa47-98749236d48c req-e659f570-93e3-485c-875c-3af6e3efdbeb service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updated VIF entry in instance network info cache for port df5d650c-5e5c-4822-8154-7fc1213190b4. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:29:59 user nova-compute[74242]: DEBUG nova.network.neutron [req-a01877b9-55ce-40b3-aa47-98749236d48c req-e659f570-93e3-485c-875c-3af6e3efdbeb service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updating instance_info_cache with network_info: [{"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:29:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a01877b9-55ce-40b3-aa47-98749236d48c req-e659f570-93e3-485c-875c-3af6e3efdbeb service nova] Releasing lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:30:00 user nova-compute[74242]: DEBUG nova.compute.manager [None req-2d9f37af-7939-474b-8318-7ad990bb4a12 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:30:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-72e235b1-757d-494f-af7a-2d41c352fc9e req-9fa6620a-a687-46d0-90c7-d41ae31deced service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:30:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-72e235b1-757d-494f-af7a-2d41c352fc9e req-9fa6620a-a687-46d0-90c7-d41ae31deced service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-72e235b1-757d-494f-af7a-2d41c352fc9e req-9fa6620a-a687-46d0-90c7-d41ae31deced service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-72e235b1-757d-494f-af7a-2d41c352fc9e req-9fa6620a-a687-46d0-90c7-d41ae31deced service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-72e235b1-757d-494f-af7a-2d41c352fc9e req-9fa6620a-a687-46d0-90c7-d41ae31deced service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:30:00 user nova-compute[74242]: WARNING nova.compute.manager [req-72e235b1-757d-494f-af7a-2d41c352fc9e req-9fa6620a-a687-46d0-90c7-d41ae31deced service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received unexpected event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with vm_state active and task_state None.
Oct 20 02:30:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 2bf62933-66ea-469e-a70e-92184f311110 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 7b6701b3-86f5-4498-9b45-24d4f53b6e78 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 8497b901-64fb-44f3-bd07-f584ab799867 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "2bf62933-66ea-469e-a70e-92184f311110" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "8497b901-64fb-44f3-bd07-f584ab799867" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "2bf62933-66ea-469e-a70e-92184f311110" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "8497b901-64fb-44f3-bd07-f584ab799867" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.043s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.041s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:30:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:30:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:30:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:30:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:21 user nova-compute[74242]: INFO nova.compute.manager [None req-cd0ba85b-8951-41a7-98fd-82784609eae5 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Unrescuing
Oct 20 02:30:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cd0ba85b-8951-41a7-98fd-82784609eae5 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:30:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cd0ba85b-8951-41a7-98fd-82784609eae5 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquired lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:30:21 user nova-compute[74242]: DEBUG nova.network.neutron [None req-cd0ba85b-8951-41a7-98fd-82784609eae5 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:30:22 user nova-compute[74242]: DEBUG nova.network.neutron [None req-cd0ba85b-8951-41a7-98fd-82784609eae5 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Updating instance_info_cache with network_info: [{"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:30:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cd0ba85b-8951-41a7-98fd-82784609eae5 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Releasing lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:30:22 user nova-compute[74242]: DEBUG nova.objects.instance [None req-cd0ba85b-8951-41a7-98fd-82784609eae5 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'flavor' on Instance uuid 2bf62933-66ea-469e-a70e-92184f311110 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:30:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:22 user nova-compute[74242]: DEBUG nova.compute.manager [req-1c914a3c-bb9d-45e2-ad71-086d4eb00a4d req-cf13a1db-53af-4eb5-b9d8-ca44293491db service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received event network-vif-unplugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:30:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1c914a3c-bb9d-45e2-ad71-086d4eb00a4d req-cf13a1db-53af-4eb5-b9d8-ca44293491db service nova] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1c914a3c-bb9d-45e2-ad71-086d4eb00a4d req-cf13a1db-53af-4eb5-b9d8-ca44293491db service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1c914a3c-bb9d-45e2-ad71-086d4eb00a4d req-cf13a1db-53af-4eb5-b9d8-ca44293491db service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:22 user nova-compute[74242]: DEBUG nova.compute.manager [req-1c914a3c-bb9d-45e2-ad71-086d4eb00a4d req-cf13a1db-53af-4eb5-b9d8-ca44293491db service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] No waiting events found dispatching network-vif-unplugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:30:22 user nova-compute[74242]: WARNING nova.compute.manager [req-1c914a3c-bb9d-45e2-ad71-086d4eb00a4d req-cf13a1db-53af-4eb5-b9d8-ca44293491db service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received unexpected event network-vif-unplugged-61e204b4-d498-423a-8542-af401e188691 for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:30:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:23 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Instance destroyed successfully.
Oct 20 02:30:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-40f4f7c7-d4e2-4530-8fc3-c36bc53d9d2a req-0b453ff3-7433-4b0f-adf2-c3027d04114b service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:30:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-40f4f7c7-d4e2-4530-8fc3-c36bc53d9d2a req-0b453ff3-7433-4b0f-adf2-c3027d04114b service nova] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-40f4f7c7-d4e2-4530-8fc3-c36bc53d9d2a req-0b453ff3-7433-4b0f-adf2-c3027d04114b service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-40f4f7c7-d4e2-4530-8fc3-c36bc53d9d2a req-0b453ff3-7433-4b0f-adf2-c3027d04114b service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-40f4f7c7-d4e2-4530-8fc3-c36bc53d9d2a req-0b453ff3-7433-4b0f-adf2-c3027d04114b service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] No waiting events found dispatching network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:30:24 user nova-compute[74242]: WARNING nova.compute.manager [req-40f4f7c7-d4e2-4530-8fc3-c36bc53d9d2a req-0b453ff3-7433-4b0f-adf2-c3027d04114b service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received unexpected event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:30:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:25 user nova-compute[74242]: DEBUG nova.compute.manager [req-275ecca7-c0a3-473d-8477-b1e657454e5c req-97642ecd-c279-4c0d-adad-b8769c86b256 service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Received event network-changed-e615d9b4-3b1b-4350-9174-c9bb7d0feba1 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:30:25 user nova-compute[74242]: DEBUG nova.compute.manager [req-275ecca7-c0a3-473d-8477-b1e657454e5c req-97642ecd-c279-4c0d-adad-b8769c86b256 service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Refreshing instance network info cache due to event network-changed-e615d9b4-3b1b-4350-9174-c9bb7d0feba1. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:30:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-275ecca7-c0a3-473d-8477-b1e657454e5c req-97642ecd-c279-4c0d-adad-b8769c86b256 service nova] Acquiring lock "refresh_cache-3bbdf97b-2499-4c4e-b531-8297ad2e7a38" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:30:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-275ecca7-c0a3-473d-8477-b1e657454e5c req-97642ecd-c279-4c0d-adad-b8769c86b256 service nova] Acquired lock "refresh_cache-3bbdf97b-2499-4c4e-b531-8297ad2e7a38" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:30:25 user nova-compute[74242]: DEBUG nova.network.neutron [req-275ecca7-c0a3-473d-8477-b1e657454e5c req-97642ecd-c279-4c0d-adad-b8769c86b256 service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Refreshing network info cache for port e615d9b4-3b1b-4350-9174-c9bb7d0feba1 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:30:25 user nova-compute[74242]: DEBUG nova.network.neutron [req-275ecca7-c0a3-473d-8477-b1e657454e5c req-97642ecd-c279-4c0d-adad-b8769c86b256 service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Updated VIF entry in instance network info cache for port e615d9b4-3b1b-4350-9174-c9bb7d0feba1. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:30:25 user nova-compute[74242]: DEBUG nova.network.neutron [req-275ecca7-c0a3-473d-8477-b1e657454e5c req-97642ecd-c279-4c0d-adad-b8769c86b256 service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Updating instance_info_cache with network_info: [{"id": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "address": "fa:16:3e:5d:02:57", "network": {"id": "f2d4b88b-6573-44ea-a8b0-b597f04b986c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1466603443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e3092afce2f481282ed71b01dba0675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape615d9b4-3b", "ovs_interfaceid": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:30:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-275ecca7-c0a3-473d-8477-b1e657454e5c req-97642ecd-c279-4c0d-adad-b8769c86b256 service nova] Releasing lock "refresh_cache-3bbdf97b-2499-4c4e-b531-8297ad2e7a38" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG nova.objects.instance [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lazy-loading 'flavor' on Instance uuid 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG nova.compute.manager [None req-cd0ba85b-8951-41a7-98fd-82784609eae5 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:26 user nova-compute[74242]: INFO nova.compute.manager [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Attaching volume d4b9532e-9234-40c8-9237-ff6f4f3cddad to /dev/vdb
Oct 20 02:30:26 user nova-compute[74242]: DEBUG os_brick.utils [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[38629104-4035-47e6-af2a-fe86567c16c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[94277297-6a7a-4afc-9ddb-101ba2e307d4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-c3bce01c-1f16-4de6-a91f-872b7eab8cfa req-e96b9a7d-a925-42b8-bded-93078d161119 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c3bce01c-1f16-4de6-a91f-872b7eab8cfa req-e96b9a7d-a925-42b8-bded-93078d161119 service nova] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c3bce01c-1f16-4de6-a91f-872b7eab8cfa req-e96b9a7d-a925-42b8-bded-93078d161119 service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c3bce01c-1f16-4de6-a91f-872b7eab8cfa req-e96b9a7d-a925-42b8-bded-93078d161119 service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-c3bce01c-1f16-4de6-a91f-872b7eab8cfa req-e96b9a7d-a925-42b8-bded-93078d161119 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] No waiting events found dispatching network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:30:26 user nova-compute[74242]: WARNING nova.compute.manager [req-c3bce01c-1f16-4de6-a91f-872b7eab8cfa req-e96b9a7d-a925-42b8-bded-93078d161119 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received unexpected event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 for instance with vm_state active and task_state None.
Oct 20 02:30:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-c3bce01c-1f16-4de6-a91f-872b7eab8cfa req-e96b9a7d-a925-42b8-bded-93078d161119 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c3bce01c-1f16-4de6-a91f-872b7eab8cfa req-e96b9a7d-a925-42b8-bded-93078d161119 service nova] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c3bce01c-1f16-4de6-a91f-872b7eab8cfa req-e96b9a7d-a925-42b8-bded-93078d161119 service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c3bce01c-1f16-4de6-a91f-872b7eab8cfa req-e96b9a7d-a925-42b8-bded-93078d161119 service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-c3bce01c-1f16-4de6-a91f-872b7eab8cfa req-e96b9a7d-a925-42b8-bded-93078d161119 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] No waiting events found dispatching network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:30:26 user nova-compute[74242]: WARNING nova.compute.manager [req-c3bce01c-1f16-4de6-a91f-872b7eab8cfa req-e96b9a7d-a925-42b8-bded-93078d161119 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received unexpected event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 for instance with vm_state active and task_state None.
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bb5f3f-40b3-4926-a83d-de2b0a3a86d2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5229a67e-8245-43f9-9a35-206236f5b7a7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:30:26 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:30:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df5b4a2-1923-4ded-8238-c1e5a7af54d6]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG os_brick.utils [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:30:26 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Updating existing volume attachment record: f5390590-f9b9-45d6-9d8c-84f2b55bbfe8 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:30:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "8497b901-64fb-44f3-bd07-f584ab799867" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:28 user nova-compute[74242]: INFO nova.compute.manager [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Detaching volume d222fae2-54cd-4649-9fb3-9e8fdb56f923
Oct 20 02:30:28 user nova-compute[74242]: INFO nova.virt.block_device [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Attempting to driver detach volume d222fae2-54cd-4649-9fb3-9e8fdb56f923 from mountpoint /dev/vdb
Oct 20 02:30:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Attempting to detach device vdb from instance 8497b901-64fb-44f3-bd07-f584ab799867 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:30:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:30:28 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:30:28 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:30:28 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:30:28 user nova-compute[74242]:   <serial>d222fae2-54cd-4649-9fb3-9e8fdb56f923</serial>
Oct 20 02:30:28 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:30:28 user nova-compute[74242]: </disk>
Oct 20 02:30:28 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:30:28 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Successfully detached device vdb from instance 8497b901-64fb-44f3-bd07-f584ab799867 from the persistent domain config.
Oct 20 02:30:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8497b901-64fb-44f3-bd07-f584ab799867 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:30:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:30:28 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:30:28 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:30:28 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:30:28 user nova-compute[74242]:   <serial>d222fae2-54cd-4649-9fb3-9e8fdb56f923</serial>
Oct 20 02:30:28 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:30:28 user nova-compute[74242]: </disk>
Oct 20 02:30:28 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:30:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8497b901-64fb-44f3-bd07-f584ab799867 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:30:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:40 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:30:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:30:41 user nova-compute[74242]: INFO nova.compute.claims [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Claim successful on node user
Oct 20 02:30:41 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.275s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG nova.network.neutron [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:30:41 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:30:41 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG nova.policy [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61536bdce5184c989843cc225dd547a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bf4c560c2a4a078d0f43aae70d4fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:30:41 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Creating image(s)
Oct 20 02:30:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "/opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "/opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.183s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk 1073741824" returned: 0 in 0.058s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG nova.network.neutron [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Successfully created port: 957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Cannot resize image /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Ensure instance console log exists: /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG nova.network.neutron [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Successfully updated port: 957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquired lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG nova.network.neutron [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-605da78c-965b-4241-8b80-3a1eeac5fc1b req-b821c230-a6b5-4789-8717-31648bd78650 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-changed-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-605da78c-965b-4241-8b80-3a1eeac5fc1b req-b821c230-a6b5-4789-8717-31648bd78650 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Refreshing instance network info cache due to event network-changed-957c2a1b-2b78-47c9-8e79-fc8ce92755ec. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-605da78c-965b-4241-8b80-3a1eeac5fc1b req-b821c230-a6b5-4789-8717-31648bd78650 service nova] Acquiring lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:30:42 user nova-compute[74242]: DEBUG nova.network.neutron [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.network.neutron [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Updating instance_info_cache with network_info: [{"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Releasing lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Instance network_info: |[{"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-605da78c-965b-4241-8b80-3a1eeac5fc1b req-b821c230-a6b5-4789-8717-31648bd78650 service nova] Acquired lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.network.neutron [req-605da78c-965b-4241-8b80-3a1eeac5fc1b req-b821c230-a6b5-4789-8717-31648bd78650 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Refreshing network info cache for port 957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Start _get_guest_xml network_info=[{"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:30:43 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:30:43 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:30:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-907928236',display_name='tempest-AttachVolumeTestJSON-server-907928236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-907928236',id=43,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+0C/EZq6BwMh+3wZbZgOw2m/JxCkcxWd9X6nujGwGDyr2EQvBu4YlJy6mRVBvBdc8CsjVHXkTNJTlT3+WS0iTSYuJCsZzoNxpr4cYb9sE8zXfgoepdKDpiPTJ/nXqUhw==',key_name='tempest-keypair-788125581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86bf4c560c2a4a078d0f43aae70d4fd3',ramdisk_id='',reservation_id='r-30ipsrv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-47724960',owner_user_name='tempest-AttachVolumeTestJSON-47724960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:30:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61536bdce5184c989843cc225dd547a0',uuid=3d6b9529-656c-45f3-b2de-3d1462751bf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converting VIF {"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.objects.instance [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:30:43 user nova-compute[74242]:   <uuid>3d6b9529-656c-45f3-b2de-3d1462751bf1</uuid>
Oct 20 02:30:43 user nova-compute[74242]:   <name>instance-0000002b</name>
Oct 20 02:30:43 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:30:43 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:30:43 user nova-compute[74242]:   <metadata>
Oct 20 02:30:43 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:30:43 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:30:43 user nova-compute[74242]:       <nova:name>tempest-AttachVolumeTestJSON-server-907928236</nova:name>
Oct 20 02:30:43 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:30:43</nova:creationTime>
Oct 20 02:30:43 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:30:43 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:30:43 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:30:43 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:30:43 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:30:43 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:30:43 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:30:43 user nova-compute[74242]:       <nova:owner>
Oct 20 02:30:43 user nova-compute[74242]:         <nova:user uuid="61536bdce5184c989843cc225dd547a0">tempest-AttachVolumeTestJSON-47724960-project-member</nova:user>
Oct 20 02:30:43 user nova-compute[74242]:         <nova:project uuid="86bf4c560c2a4a078d0f43aae70d4fd3">tempest-AttachVolumeTestJSON-47724960</nova:project>
Oct 20 02:30:43 user nova-compute[74242]:       </nova:owner>
Oct 20 02:30:43 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:30:43 user nova-compute[74242]:       <nova:ports>
Oct 20 02:30:43 user nova-compute[74242]:         <nova:port uuid="957c2a1b-2b78-47c9-8e79-fc8ce92755ec">
Oct 20 02:30:43 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 02:30:43 user nova-compute[74242]:         </nova:port>
Oct 20 02:30:43 user nova-compute[74242]:       </nova:ports>
Oct 20 02:30:43 user nova-compute[74242]:     </nova:instance>
Oct 20 02:30:43 user nova-compute[74242]:   </metadata>
Oct 20 02:30:43 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:30:43 user nova-compute[74242]:     <system>
Oct 20 02:30:43 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:30:43 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:30:43 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:30:43 user nova-compute[74242]:       <entry name="serial">3d6b9529-656c-45f3-b2de-3d1462751bf1</entry>
Oct 20 02:30:43 user nova-compute[74242]:       <entry name="uuid">3d6b9529-656c-45f3-b2de-3d1462751bf1</entry>
Oct 20 02:30:43 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:30:43 user nova-compute[74242]:     </system>
Oct 20 02:30:43 user nova-compute[74242]:   </sysinfo>
Oct 20 02:30:43 user nova-compute[74242]:   <os>
Oct 20 02:30:43 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:30:43 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:30:43 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:30:43 user nova-compute[74242]:   </os>
Oct 20 02:30:43 user nova-compute[74242]:   <features>
Oct 20 02:30:43 user nova-compute[74242]:     <acpi/>
Oct 20 02:30:43 user nova-compute[74242]:     <apic/>
Oct 20 02:30:43 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:30:43 user nova-compute[74242]:   </features>
Oct 20 02:30:43 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:30:43 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:30:43 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:30:43 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:30:43 user nova-compute[74242]:   </clock>
Oct 20 02:30:43 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:30:43 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:30:43 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:30:43 user nova-compute[74242]:   </cpu>
Oct 20 02:30:43 user nova-compute[74242]:   <devices>
Oct 20 02:30:43 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:30:43 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:30:43 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk"/>
Oct 20 02:30:43 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:30:43 user nova-compute[74242]:     </disk>
Oct 20 02:30:43 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:30:43 user nova-compute[74242]:       <mac address="fa:16:3e:87:ef:3f"/>
Oct 20 02:30:43 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:30:43 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:30:43 user nova-compute[74242]:       <target dev="tap957c2a1b-2b"/>
Oct 20 02:30:43 user nova-compute[74242]:     </interface>
Oct 20 02:30:43 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:30:43 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/console.log" append="off"/>
Oct 20 02:30:43 user nova-compute[74242]:     </serial>
Oct 20 02:30:43 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:30:43 user nova-compute[74242]:     <video>
Oct 20 02:30:43 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:30:43 user nova-compute[74242]:     </video>
Oct 20 02:30:43 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:30:43 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:30:43 user nova-compute[74242]:     </rng>
Oct 20 02:30:43 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:30:43 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:30:43 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:30:43 user nova-compute[74242]:     </memballoon>
Oct 20 02:30:43 user nova-compute[74242]:   </devices>
Oct 20 02:30:43 user nova-compute[74242]: </domain>
Oct 20 02:30:43 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:30:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-907928236',display_name='tempest-AttachVolumeTestJSON-server-907928236',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-907928236',id=43,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+0C/EZq6BwMh+3wZbZgOw2m/JxCkcxWd9X6nujGwGDyr2EQvBu4YlJy6mRVBvBdc8CsjVHXkTNJTlT3+WS0iTSYuJCsZzoNxpr4cYb9sE8zXfgoepdKDpiPTJ/nXqUhw==',key_name='tempest-keypair-788125581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86bf4c560c2a4a078d0f43aae70d4fd3',ramdisk_id='',reservation_id='r-30ipsrv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-47724960',owner_user_name='tempest-AttachVolumeTestJSON-47724960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:30:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61536bdce5184c989843cc225dd547a0',uuid=3d6b9529-656c-45f3-b2de-3d1462751bf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converting VIF {"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG os_vif [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddbdf184-6f1c-5709-b95b-4ab3b01f1226', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap957c2a1b-2b, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap957c2a1b-2b, col_values=(('qos', UUID('99f8efab-3a4e-455b-b765-2347cc7f0ca3')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap957c2a1b-2b, col_values=(('external_ids', {'iface-id': '957c2a1b-2b78-47c9-8e79-fc8ce92755ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:ef:3f', 'vm-uuid': '3d6b9529-656c-45f3-b2de-3d1462751bf1'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:43 user nova-compute[74242]: INFO os_vif [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b')
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] No VIF found with MAC fa:16:3e:87:ef:3f, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.network.neutron [req-605da78c-965b-4241-8b80-3a1eeac5fc1b req-b821c230-a6b5-4789-8717-31648bd78650 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Updated VIF entry in instance network info cache for port 957c2a1b-2b78-47c9-8e79-fc8ce92755ec. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG nova.network.neutron [req-605da78c-965b-4241-8b80-3a1eeac5fc1b req-b821c230-a6b5-4789-8717-31648bd78650 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Updating instance_info_cache with network_info: [{"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:30:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-605da78c-965b-4241-8b80-3a1eeac5fc1b req-b821c230-a6b5-4789-8717-31648bd78650 service nova] Releasing lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:30:44 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:30:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-ea0060d6-dd38-495d-85a7-979ca79bf878 req-ed982463-611c-461c-afe7-631ecf814454 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:30:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ea0060d6-dd38-495d-85a7-979ca79bf878 req-ed982463-611c-461c-afe7-631ecf814454 service nova] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ea0060d6-dd38-495d-85a7-979ca79bf878 req-ed982463-611c-461c-afe7-631ecf814454 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ea0060d6-dd38-495d-85a7-979ca79bf878 req-ed982463-611c-461c-afe7-631ecf814454 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-ea0060d6-dd38-495d-85a7-979ca79bf878 req-ed982463-611c-461c-afe7-631ecf814454 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] No waiting events found dispatching network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:30:44 user nova-compute[74242]: WARNING nova.compute.manager [req-ea0060d6-dd38-495d-85a7-979ca79bf878 req-ed982463-611c-461c-afe7-631ecf814454 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received unexpected event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec for instance with vm_state building and task_state spawning.
Oct 20 02:30:45 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:30:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:30:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:30:46 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Instance spawned successfully.
Oct 20 02:30:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:30:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:30:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:30:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:30:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:30:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:30:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:30:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-640b0b56-a0f4-4e09-a844-e02069bd7ddb req-c459e146-95e8-43ca-a36a-ee4d817c3bc2 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:30:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-640b0b56-a0f4-4e09-a844-e02069bd7ddb req-c459e146-95e8-43ca-a36a-ee4d817c3bc2 service nova] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-640b0b56-a0f4-4e09-a844-e02069bd7ddb req-c459e146-95e8-43ca-a36a-ee4d817c3bc2 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-640b0b56-a0f4-4e09-a844-e02069bd7ddb req-c459e146-95e8-43ca-a36a-ee4d817c3bc2 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-640b0b56-a0f4-4e09-a844-e02069bd7ddb req-c459e146-95e8-43ca-a36a-ee4d817c3bc2 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] No waiting events found dispatching network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:30:46 user nova-compute[74242]: WARNING nova.compute.manager [req-640b0b56-a0f4-4e09-a844-e02069bd7ddb req-c459e146-95e8-43ca-a36a-ee4d817c3bc2 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received unexpected event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec for instance with vm_state building and task_state spawning.
Oct 20 02:30:46 user nova-compute[74242]: INFO nova.compute.manager [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Took 5.44 seconds to spawn the instance on the hypervisor.
Oct 20 02:30:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:30:47 user nova-compute[74242]: INFO nova.compute.manager [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Took 6.05 seconds to build instance.
Oct 20 02:30:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c2b18bfc-243c-4971-8aeb-390ff57aa3ae tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.152s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:47 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:30:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:30:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:30:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:30:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:30:47 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updating instance_info_cache with network_info: [{"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:30:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-8497b901-64fb-44f3-bd07-f584ab799867" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:30:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:30:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:30:49 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8497b901-64fb-44f3-bd07-f584ab799867 is timed out.
Oct 20 02:30:49 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Successfully detached device vdb from instance 8497b901-64fb-44f3-bd07-f584ab799867 from the live domain config.
Oct 20 02:30:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jqMPlUeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:30:49 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff188383-9324-4311-8b27-874de2911365]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:30:49 user nova-compute[74242]: No targets found.
Oct 20 02:30:49 user nova-compute[74242]: iSNS:
Oct 20 02:30:49 user nova-compute[74242]: No targets found.
Oct 20 02:30:49 user nova-compute[74242]: STATIC:
Oct 20 02:30:49 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923
Oct 20 02:30:49 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:30:49 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:30:49 user nova-compute[74242]: FIRMWARE:
Oct 20 02:30:49 user nova-compute[74242]: No targets found.
Oct 20 02:30:49 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:30:49 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:30:49 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ba2dd8-ac4b-44b8-bbb1-3c54570d7001]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0eb899-b3a1-418f-ab17-b4c9eff3bf22]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 (non-flash)
Oct 20 02:30:49 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 (non-flash)
Oct 20 02:30:49 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b864acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923'): ({'sdb'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Removing single pathed devices sdb {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ff7dbc-d147-4969-8751-b9ddaab82ae5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8246fac3-c336-4512-b12f-b574ec5bfbad]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Flushing IO for device /dev/sdb {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4374a7-dc39-4237-9b18-9b98968fc4ae]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ec8d44-6be5-4f4c-88e8-919e53f8ca99]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a307d3ec-ff00-4774-a50e-4506c85042d2]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[67c88872-4408-46fe-8fe5-20bd4f94a9b8]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923, portal: 172.16.0.220,3260]
Oct 20 02:30:49 user nova-compute[74242]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923, portal: 172.16.0.220,3260] successful.
Oct 20 02:30:49 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d222fae2-54cd-4649-9fb3-9e8fdb56f923 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f090aa5-a6b8-44ac-b501-7f67adc40687]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.280s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] <== disconnect_volume: return (281ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:30:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:30:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:52 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG nova.objects.instance [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lazy-loading 'flavor' on Instance uuid 8497b901-64fb-44f3-bd07-f584ab799867 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-61509a1d-130c-4819-ae83-291f2a7924e9 tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "8497b901-64fb-44f3-bd07-f584ab799867" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.287s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NcVvtfhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:30:53 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:30:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.004s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:30:53 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:30:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:30:53 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:30:53 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:30:53 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c7f169-1161-4f0f-878f-e227a8979b0e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:30:54 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e506c2f-114d-45f2-abdc-58cb6807c8b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad] added
Oct 20 02:30:54 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8664f92-e8a4-47b8-913d-334d0b1c8787]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d87c457-e838-45fa-8a50-f528d1e12288]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NcVvtfhW {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NcVvtfhW" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a8d07b6-8629-43f2-b9a1-ae8b6e2b0d1d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NcVvtfhW'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[53bd7a00-3bda-4e8c-ae90-134b46e12b0f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[072a23f2-50e6-4833-ac5d-ec950e370c95]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 02:30:54 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 02:30:54 user nova-compute[74242]:  {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:30:54 user nova-compute[74242]: WARNING os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 02:30:54 user nova-compute[74242]: 
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dab0bfe-6704-47e5-b8d1-53943fded123]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad, portal: 172.16.0.220,3260]
Oct 20 02:30:54 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad, portal: 172.16.0.220,3260] successful.
Oct 20 02:30:54 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff59e5c-f0e1-4921-b9ce-81e78f753a19]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dda63b-9ab4-4088-91a3-4ef9a3707ed2]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad (non-flash)
Oct 20 02:30:54 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad (non-flash)
Oct 20 02:30:54 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.385s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[defe8265-3c55-40f5-9adb-34d571dccc11]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:54 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NcVvtfhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.423s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] <== connect_volume: return (1427ms) {'type': 'block', 'scsi_wwn': '26335623661346134', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335623661346134', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG nova.objects.instance [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lazy-loading 'flavor' on Instance uuid 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:30:55 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:30:55 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:30:55 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:30:55 user nova-compute[74242]:   <serial>d4b9532e-9234-40c8-9237-ff6f4f3cddad</serial>
Oct 20 02:30:55 user nova-compute[74242]: </disk>
Oct 20 02:30:55 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:30:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] No VIF found with MAC fa:16:3e:5d:02:57, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:30:56 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:30:56 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:30:56 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8290MB free_disk=24.846149444580078GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:30:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:30:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:30:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-780e8fb2-ebff-4882-8187-7ffa4f294020 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 29.698s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:56 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:30:56 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:30:56 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 8497b901-64fb-44f3-bd07-f584ab799867 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:30:56 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:30:56 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:30:56 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:30:56 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:30:56 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:30:56 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:30:56 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:30:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.389s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:30:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lazy-loading 'flavor' on Instance uuid 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:00 user nova-compute[74242]: INFO nova.compute.manager [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Attaching volume d137294a-55e4-41f7-a906-1c827cf21007 to /dev/vdc
Oct 20 02:31:00 user nova-compute[74242]: DEBUG os_brick.utils [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f056844-9b91-4ef7-b11f-4b39f07086de]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15de176-a251-405b-9803-03546c5e10c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1231fe7a-c0a9-469d-97ab-724b234d67bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9246250-3548-4fc8-b46a-654ff2c4f69b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:31:01 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:31:01 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf10e96-badf-49bc-a04b-1646a2290680]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:31:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:31:01 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:31:01 user nova-compute[74242]: DEBUG os_brick.utils [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:31:01 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Updating existing volume attachment record: 028bc9d3-459e-41ab-a9a9-6510f9ab760c {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:31:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:04 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:31:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "67575ff4-ecf0-493a-b07d-0e808f209b23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:11 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:31:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:11 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:31:11 user nova-compute[74242]: INFO nova.compute.claims [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Claim successful on node user
Oct 20 02:31:11 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:31:11 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:31:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.379s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:11 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:31:11 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:31:11 user nova-compute[74242]: DEBUG nova.network.neutron [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:31:11 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:31:11 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:31:11 user nova-compute[74242]: DEBUG nova.policy [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebacf16af7234540acea291a74a1b68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2982c9c65e548478739144ba83306ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:31:12 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Creating image(s)
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "/opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "/opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "/opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk 1073741824" returned: 0 in 0.047s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG nova.network.neutron [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Successfully created port: 7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Checking if we can resize image /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Cannot resize image /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Ensure instance console log exists: /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.network.neutron [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Successfully updated port: 7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "refresh_cache-67575ff4-ecf0-493a-b07d-0e808f209b23" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquired lock "refresh_cache-67575ff4-ecf0-493a-b07d-0e808f209b23" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.network.neutron [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.compute.manager [req-9a1624a1-162c-4f06-adae-1bbf0005a701 req-9771abf7-c6d7-4669-b404-e8dafc69bf51 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Received event network-changed-7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.compute.manager [req-9a1624a1-162c-4f06-adae-1bbf0005a701 req-9771abf7-c6d7-4669-b404-e8dafc69bf51 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Refreshing instance network info cache due to event network-changed-7ea2f019-bafe-4b3a-a937-17d367233bc6. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9a1624a1-162c-4f06-adae-1bbf0005a701 req-9771abf7-c6d7-4669-b404-e8dafc69bf51 service nova] Acquiring lock "refresh_cache-67575ff4-ecf0-493a-b07d-0e808f209b23" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.network.neutron [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.network.neutron [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Updating instance_info_cache with network_info: [{"id": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "address": "fa:16:3e:75:e6:79", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea2f019-ba", "ovs_interfaceid": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Releasing lock "refresh_cache-67575ff4-ecf0-493a-b07d-0e808f209b23" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Instance network_info: |[{"id": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "address": "fa:16:3e:75:e6:79", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea2f019-ba", "ovs_interfaceid": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9a1624a1-162c-4f06-adae-1bbf0005a701 req-9771abf7-c6d7-4669-b404-e8dafc69bf51 service nova] Acquired lock "refresh_cache-67575ff4-ecf0-493a-b07d-0e808f209b23" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.network.neutron [req-9a1624a1-162c-4f06-adae-1bbf0005a701 req-9771abf7-c6d7-4669-b404-e8dafc69bf51 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Refreshing network info cache for port 7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Start _get_guest_xml network_info=[{"id": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "address": "fa:16:3e:75:e6:79", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea2f019-ba", "ovs_interfaceid": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:31:13 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:31:13 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-525730713',display_name='tempest-TestStampPattern-server-525730713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-525730713',id=44,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYGIAL3BPbNRP/f8TTaaS+fRSqiqmwNAp8S9LYWbQcGSs8gpOlmyAN8s6c1MVpMgmvgEs1210r1izyM79vKpMSRksL+RI4OA1L+LaWwUc2PcO3Orr5NlrQNvhE5JyjJpg==',key_name='tempest-TestStampPattern-200219955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2982c9c65e548478739144ba83306ea',ramdisk_id='',reservation_id='r-nxukjbk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1416614973',owner_user_name='tempest-TestStampPattern-1416614973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:31:12Z,user_data=None,user_id='ebacf16af7234540acea291a74a1b68d',uuid=67575ff4-ecf0-493a-b07d-0e808f209b23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "address": "fa:16:3e:75:e6:79", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea2f019-ba", "ovs_interfaceid": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Converting VIF {"id": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "address": "fa:16:3e:75:e6:79", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea2f019-ba", "ovs_interfaceid": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:e6:79,bridge_name='br-int',has_traffic_filtering=True,id=7ea2f019-bafe-4b3a-a937-17d367233bc6,network=Network(4bfd9e0b-6a72-45b3-9618-8c8b91bb3604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea2f019-ba') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.objects.instance [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lazy-loading 'pci_devices' on Instance uuid 67575ff4-ecf0-493a-b07d-0e808f209b23 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:31:13 user nova-compute[74242]:   <uuid>67575ff4-ecf0-493a-b07d-0e808f209b23</uuid>
Oct 20 02:31:13 user nova-compute[74242]:   <name>instance-0000002c</name>
Oct 20 02:31:13 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:31:13 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:31:13 user nova-compute[74242]:   <metadata>
Oct 20 02:31:13 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:31:13 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:31:13 user nova-compute[74242]:       <nova:name>tempest-TestStampPattern-server-525730713</nova:name>
Oct 20 02:31:13 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:31:13</nova:creationTime>
Oct 20 02:31:13 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:31:13 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:31:13 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:31:13 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:31:13 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:31:13 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:31:13 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:31:13 user nova-compute[74242]:       <nova:owner>
Oct 20 02:31:13 user nova-compute[74242]:         <nova:user uuid="ebacf16af7234540acea291a74a1b68d">tempest-TestStampPattern-1416614973-project-member</nova:user>
Oct 20 02:31:13 user nova-compute[74242]:         <nova:project uuid="d2982c9c65e548478739144ba83306ea">tempest-TestStampPattern-1416614973</nova:project>
Oct 20 02:31:13 user nova-compute[74242]:       </nova:owner>
Oct 20 02:31:13 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:31:13 user nova-compute[74242]:       <nova:ports>
Oct 20 02:31:13 user nova-compute[74242]:         <nova:port uuid="7ea2f019-bafe-4b3a-a937-17d367233bc6">
Oct 20 02:31:13 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 02:31:13 user nova-compute[74242]:         </nova:port>
Oct 20 02:31:13 user nova-compute[74242]:       </nova:ports>
Oct 20 02:31:13 user nova-compute[74242]:     </nova:instance>
Oct 20 02:31:13 user nova-compute[74242]:   </metadata>
Oct 20 02:31:13 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:31:13 user nova-compute[74242]:     <system>
Oct 20 02:31:13 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:31:13 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:31:13 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:31:13 user nova-compute[74242]:       <entry name="serial">67575ff4-ecf0-493a-b07d-0e808f209b23</entry>
Oct 20 02:31:13 user nova-compute[74242]:       <entry name="uuid">67575ff4-ecf0-493a-b07d-0e808f209b23</entry>
Oct 20 02:31:13 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:31:13 user nova-compute[74242]:     </system>
Oct 20 02:31:13 user nova-compute[74242]:   </sysinfo>
Oct 20 02:31:13 user nova-compute[74242]:   <os>
Oct 20 02:31:13 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:31:13 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:31:13 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:31:13 user nova-compute[74242]:   </os>
Oct 20 02:31:13 user nova-compute[74242]:   <features>
Oct 20 02:31:13 user nova-compute[74242]:     <acpi/>
Oct 20 02:31:13 user nova-compute[74242]:     <apic/>
Oct 20 02:31:13 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:31:13 user nova-compute[74242]:   </features>
Oct 20 02:31:13 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:31:13 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:31:13 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:31:13 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:31:13 user nova-compute[74242]:   </clock>
Oct 20 02:31:13 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:31:13 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:31:13 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:31:13 user nova-compute[74242]:   </cpu>
Oct 20 02:31:13 user nova-compute[74242]:   <devices>
Oct 20 02:31:13 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:31:13 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:31:13 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk"/>
Oct 20 02:31:13 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:31:13 user nova-compute[74242]:     </disk>
Oct 20 02:31:13 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:31:13 user nova-compute[74242]:       <mac address="fa:16:3e:75:e6:79"/>
Oct 20 02:31:13 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:31:13 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:31:13 user nova-compute[74242]:       <target dev="tap7ea2f019-ba"/>
Oct 20 02:31:13 user nova-compute[74242]:     </interface>
Oct 20 02:31:13 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:31:13 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/console.log" append="off"/>
Oct 20 02:31:13 user nova-compute[74242]:     </serial>
Oct 20 02:31:13 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:31:13 user nova-compute[74242]:     <video>
Oct 20 02:31:13 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:31:13 user nova-compute[74242]:     </video>
Oct 20 02:31:13 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:31:13 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:31:13 user nova-compute[74242]:     </rng>
Oct 20 02:31:13 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:31:13 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:31:13 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:31:13 user nova-compute[74242]:     </memballoon>
Oct 20 02:31:13 user nova-compute[74242]:   </devices>
Oct 20 02:31:13 user nova-compute[74242]: </domain>
Oct 20 02:31:13 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-525730713',display_name='tempest-TestStampPattern-server-525730713',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-525730713',id=44,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYGIAL3BPbNRP/f8TTaaS+fRSqiqmwNAp8S9LYWbQcGSs8gpOlmyAN8s6c1MVpMgmvgEs1210r1izyM79vKpMSRksL+RI4OA1L+LaWwUc2PcO3Orr5NlrQNvhE5JyjJpg==',key_name='tempest-TestStampPattern-200219955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2982c9c65e548478739144ba83306ea',ramdisk_id='',reservation_id='r-nxukjbk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1416614973',owner_user_name='tempest-TestStampPattern-1416614973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:31:12Z,user_data=None,user_id='ebacf16af7234540acea291a74a1b68d',uuid=67575ff4-ecf0-493a-b07d-0e808f209b23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "address": "fa:16:3e:75:e6:79", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea2f019-ba", "ovs_interfaceid": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Converting VIF {"id": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "address": "fa:16:3e:75:e6:79", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea2f019-ba", "ovs_interfaceid": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:e6:79,bridge_name='br-int',has_traffic_filtering=True,id=7ea2f019-bafe-4b3a-a937-17d367233bc6,network=Network(4bfd9e0b-6a72-45b3-9618-8c8b91bb3604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea2f019-ba') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG os_vif [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:e6:79,bridge_name='br-int',has_traffic_filtering=True,id=7ea2f019-bafe-4b3a-a937-17d367233bc6,network=Network(4bfd9e0b-6a72-45b3-9618-8c8b91bb3604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea2f019-ba') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'daa0c2e2-f959-505f-ac52-3b2e41ae9c6c', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ea2f019-ba, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ea2f019-ba, col_values=(('qos', UUID('0aca9085-b205-40f0-a8c5-64f7201f3eef')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ea2f019-ba, col_values=(('external_ids', {'iface-id': '7ea2f019-bafe-4b3a-a937-17d367233bc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:e6:79', 'vm-uuid': '67575ff4-ecf0-493a-b07d-0e808f209b23'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:13 user nova-compute[74242]: INFO os_vif [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:e6:79,bridge_name='br-int',has_traffic_filtering=True,id=7ea2f019-bafe-4b3a-a937-17d367233bc6,network=Network(4bfd9e0b-6a72-45b3-9618-8c8b91bb3604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea2f019-ba')
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:31:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] No VIF found with MAC fa:16:3e:75:e6:79, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:31:14 user nova-compute[74242]: DEBUG nova.network.neutron [req-9a1624a1-162c-4f06-adae-1bbf0005a701 req-9771abf7-c6d7-4669-b404-e8dafc69bf51 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Updated VIF entry in instance network info cache for port 7ea2f019-bafe-4b3a-a937-17d367233bc6. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:31:14 user nova-compute[74242]: DEBUG nova.network.neutron [req-9a1624a1-162c-4f06-adae-1bbf0005a701 req-9771abf7-c6d7-4669-b404-e8dafc69bf51 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Updating instance_info_cache with network_info: [{"id": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "address": "fa:16:3e:75:e6:79", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea2f019-ba", "ovs_interfaceid": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:31:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9a1624a1-162c-4f06-adae-1bbf0005a701 req-9771abf7-c6d7-4669-b404-e8dafc69bf51 service nova] Releasing lock "refresh_cache-67575ff4-ecf0-493a-b07d-0e808f209b23" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:31:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-69f86e62-5cd8-48ef-95cc-6b9fabaf0740 req-c87b5713-564f-4825-b929-347a16ba2953 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Received event network-vif-plugged-7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:31:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-69f86e62-5cd8-48ef-95cc-6b9fabaf0740 req-c87b5713-564f-4825-b929-347a16ba2953 service nova] Acquiring lock "67575ff4-ecf0-493a-b07d-0e808f209b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-69f86e62-5cd8-48ef-95cc-6b9fabaf0740 req-c87b5713-564f-4825-b929-347a16ba2953 service nova] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-69f86e62-5cd8-48ef-95cc-6b9fabaf0740 req-c87b5713-564f-4825-b929-347a16ba2953 service nova] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-69f86e62-5cd8-48ef-95cc-6b9fabaf0740 req-c87b5713-564f-4825-b929-347a16ba2953 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] No waiting events found dispatching network-vif-plugged-7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:31:15 user nova-compute[74242]: WARNING nova.compute.manager [req-69f86e62-5cd8-48ef-95cc-6b9fabaf0740 req-c87b5713-564f-4825-b929-347a16ba2953 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Received unexpected event network-vif-plugged-7ea2f019-bafe-4b3a-a937-17d367233bc6 for instance with vm_state building and task_state spawning.
Oct 20 02:31:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:31:17 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Instance spawned successfully.
Oct 20 02:31:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:31:17 user nova-compute[74242]: INFO nova.compute.manager [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Took 5.11 seconds to spawn the instance on the hypervisor.
Oct 20 02:31:17 user nova-compute[74242]: DEBUG nova.compute.manager [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG nova.compute.manager [req-10cc1dae-c055-4edb-a144-a573c1daab70 req-877e4f4a-1094-42a7-916a-8f6bc8d861b1 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Received event network-vif-plugged-7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-10cc1dae-c055-4edb-a144-a573c1daab70 req-877e4f4a-1094-42a7-916a-8f6bc8d861b1 service nova] Acquiring lock "67575ff4-ecf0-493a-b07d-0e808f209b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-10cc1dae-c055-4edb-a144-a573c1daab70 req-877e4f4a-1094-42a7-916a-8f6bc8d861b1 service nova] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-10cc1dae-c055-4edb-a144-a573c1daab70 req-877e4f4a-1094-42a7-916a-8f6bc8d861b1 service nova] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG nova.compute.manager [req-10cc1dae-c055-4edb-a144-a573c1daab70 req-877e4f4a-1094-42a7-916a-8f6bc8d861b1 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] No waiting events found dispatching network-vif-plugged-7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:31:17 user nova-compute[74242]: WARNING nova.compute.manager [req-10cc1dae-c055-4edb-a144-a573c1daab70 req-877e4f4a-1094-42a7-916a-8f6bc8d861b1 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Received unexpected event network-vif-plugged-7ea2f019-bafe-4b3a-a937-17d367233bc6 for instance with vm_state building and task_state spawning.
Oct 20 02:31:17 user nova-compute[74242]: INFO nova.compute.manager [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Took 5.84 seconds to build instance.
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-c40fbed9-4cf5-435a-925e-d14946ffe3e3 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.931s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sSixWFYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:31:17 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:31:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:31:17 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:31:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:31:17 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32635a7-27ac-421a-82e4-3b801a65b133]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:31:17 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[502a6a0b-4cc5-4cd1-af9e-c3f678d61bfe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007] added
Oct 20 02:31:17 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[717b1cce-6e80-4f57-9337-1e91a26adaf2]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27de61a-b963-4d27-b691-5edaea9c520a]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:31:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sSixWFYL {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sSixWFYL" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7f07c4-01d7-4279-89cd-d28bcce445f5]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sSixWFYL'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[403db0a7-15fb-476a-b348-1a04cc400b6e]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef703329-ba06-4ee2-b00d-751db6d941da]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad (non-flash)
Oct 20 02:31:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad (non-flash)
Oct 20 02:31:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7fd87b-8f62-4b3e-9b42-3a2ff84f89f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007, portal: 172.16.0.220,3260]
Oct 20 02:31:18 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007, portal: 172.16.0.220,3260] successful.
Oct 20 02:31:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab58629c-e95b-4cd0-ad33-41d197d055f3]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76d6b62-460c-4a4a-940a-c421b61ce64c]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad (non-flash)
Oct 20 02:31:18 user nova-compute[74242]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 (non-flash)
Oct 20 02:31:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad (non-flash)
Oct 20 02:31:18 user nova-compute[74242]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 (non-flash)
Oct 20 02:31:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] HCTL ('34', '-', '-', 0) found on session 50 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c20b9614-bec7-4ce8-a109-bd97bffc12a4]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Searching for a device in session 50 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sSixWFYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:31:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23431666562393063', 'path': '/dev/sdc'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431666562393063', 'path': '/dev/sdc'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lazy-loading 'flavor' on Instance uuid 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:31:19 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:31:19 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:31:19 user nova-compute[74242]:   <target dev="vdc" bus="virtio"/>
Oct 20 02:31:19 user nova-compute[74242]:   <serial>d137294a-55e4-41f7-a906-1c827cf21007</serial>
Oct 20 02:31:19 user nova-compute[74242]: </disk>
Oct 20 02:31:19 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "8497b901-64fb-44f3-bd07-f584ab799867" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:19 user nova-compute[74242]: INFO nova.compute.manager [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Terminating instance
Oct 20 02:31:19 user nova-compute[74242]: DEBUG nova.compute.manager [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG nova.compute.manager [req-814b54c2-e0be-4f38-83d2-7d2be33a18dd req-bb3bdd45-00d8-409c-a133-e88e1554bd86 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-unplugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-814b54c2-e0be-4f38-83d2-7d2be33a18dd req-bb3bdd45-00d8-409c-a133-e88e1554bd86 service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-814b54c2-e0be-4f38-83d2-7d2be33a18dd req-bb3bdd45-00d8-409c-a133-e88e1554bd86 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-814b54c2-e0be-4f38-83d2-7d2be33a18dd req-bb3bdd45-00d8-409c-a133-e88e1554bd86 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG nova.compute.manager [req-814b54c2-e0be-4f38-83d2-7d2be33a18dd req-bb3bdd45-00d8-409c-a133-e88e1554bd86 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-unplugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG nova.compute.manager [req-814b54c2-e0be-4f38-83d2-7d2be33a18dd req-bb3bdd45-00d8-409c-a133-e88e1554bd86 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-unplugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] No VIF found with MAC fa:16:3e:5d:02:57, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:31:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8aa96d7a-2c2d-4b39-903a-9ba724692bb3 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.150s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:20 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Instance destroyed successfully.
Oct 20 02:31:20 user nova-compute[74242]: DEBUG nova.objects.instance [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lazy-loading 'resources' on Instance uuid 8497b901-64fb-44f3-bd07-f584ab799867 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:31:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:23:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-2059081696',display_name='tempest-ServerStableDeviceRescueTest-server-2059081696',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-2059081696',id=40,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTAAcf8Y7sAmdQqd5z9q/RF6wwhR0b02FbKRBj+uRza53X4eObcjHf3dPZyS7adSfQYxggRP2hP3ekB/6YppEmRoXNmwoWWIl3XxzwKP3FiyDhp+6BlBzskARDdOcrztA==',key_name='tempest-keypair-274219542',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:28:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='362d9ed2d8ed40df9e4502c3fb9ae8ae',ramdisk_id='',reservation_id='r-rie4dx62',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1200020058',owner_user_name='tempest-ServerStableDeviceRescueTest-1200020058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:30:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d8dc8fca651343beac526aee0a74023f',uuid=8497b901-64fb-44f3-bd07-f584ab799867,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:31:20 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Converting VIF {"id": "df5d650c-5e5c-4822-8154-7fc1213190b4", "address": "fa:16:3e:ed:17:65", "network": {"id": "02e4212b-93a0-4444-a4c5-793b52071c0b", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-1220659467-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "362d9ed2d8ed40df9e4502c3fb9ae8ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdf5d650c-5e", "ovs_interfaceid": "df5d650c-5e5c-4822-8154-7fc1213190b4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:31:20 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:17:65,bridge_name='br-int',has_traffic_filtering=True,id=df5d650c-5e5c-4822-8154-7fc1213190b4,network=Network(02e4212b-93a0-4444-a4c5-793b52071c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5d650c-5e') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:31:20 user nova-compute[74242]: DEBUG os_vif [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:17:65,bridge_name='br-int',has_traffic_filtering=True,id=df5d650c-5e5c-4822-8154-7fc1213190b4,network=Network(02e4212b-93a0-4444-a4c5-793b52071c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5d650c-5e') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:31:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdf5d650c-5e, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:31:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:31:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7af9ce1-6e23-46b3-a1bd-67f569245fdd) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:31:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:31:20 user nova-compute[74242]: INFO os_vif [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:17:65,bridge_name='br-int',has_traffic_filtering=True,id=df5d650c-5e5c-4822-8154-7fc1213190b4,network=Network(02e4212b-93a0-4444-a4c5-793b52071c0b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdf5d650c-5e')
Oct 20 02:31:20 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Deleting instance files /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867_del
Oct 20 02:31:20 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Deletion of /opt/stack/data/nova/instances/8497b901-64fb-44f3-bd07-f584ab799867_del complete
Oct 20 02:31:20 user nova-compute[74242]: INFO nova.compute.manager [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Took 1.08 seconds to destroy the instance on the hypervisor.
Oct 20 02:31:20 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:31:20 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:31:20 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:31:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:20 user nova-compute[74242]: INFO nova.compute.manager [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Detaching volume d137294a-55e4-41f7-a906-1c827cf21007
Oct 20 02:31:20 user nova-compute[74242]: INFO nova.virt.block_device [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Attempting to driver detach volume d137294a-55e4-41f7-a906-1c827cf21007 from mountpoint /dev/vdc
Oct 20 02:31:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Attempting to detach device vdc from instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:31:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:31:21 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:31:21 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:31:21 user nova-compute[74242]:   <target dev="vdc" bus="virtio"/>
Oct 20 02:31:21 user nova-compute[74242]:   <serial>d137294a-55e4-41f7-a906-1c827cf21007</serial>
Oct 20 02:31:21 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 02:31:21 user nova-compute[74242]: </disk>
Oct 20 02:31:21 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:31:21 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Successfully detached device vdc from instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 from the persistent domain config.
Oct 20 02:31:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:31:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:31:21 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:31:21 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:31:21 user nova-compute[74242]:   <target dev="vdc" bus="virtio"/>
Oct 20 02:31:21 user nova-compute[74242]:   <serial>d137294a-55e4-41f7-a906-1c827cf21007</serial>
Oct 20 02:31:21 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 02:31:21 user nova-compute[74242]: </disk>
Oct 20 02:31:21 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:31:21 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:31:21 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Took 0.95 seconds to deallocate network for instance.
Oct 20 02:31:21 user nova-compute[74242]: DEBUG nova.compute.manager [req-e005759a-5c7d-46f3-bfe4-f7c73a6211f4 req-a8a0d940-fe72-46a2-aec3-5e507539aacd service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-deleted-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:31:21 user nova-compute[74242]: INFO nova.compute.manager [req-e005759a-5c7d-46f3-bfe4-f7c73a6211f4 req-a8a0d940-fe72-46a2-aec3-5e507539aacd service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Neutron deleted interface df5d650c-5e5c-4822-8154-7fc1213190b4; detaching it from the instance and deleting it from the info cache
Oct 20 02:31:21 user nova-compute[74242]: DEBUG nova.network.neutron [req-e005759a-5c7d-46f3-bfe4-f7c73a6211f4 req-a8a0d940-fe72-46a2-aec3-5e507539aacd service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:31:21 user nova-compute[74242]: DEBUG nova.compute.manager [req-e005759a-5c7d-46f3-bfe4-f7c73a6211f4 req-a8a0d940-fe72-46a2-aec3-5e507539aacd service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Detach interface failed, port_id=df5d650c-5e5c-4822-8154-7fc1213190b4, reason: Instance 8497b901-64fb-44f3-bd07-f584ab799867 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:31:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:31:21 user nova-compute[74242]: DEBUG nova.compute.manager [req-7fb22707-4199-4356-ac35-9a770b363581 req-983ed5ff-9409-4b28-aa93-7edfe34139f1 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:31:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7fb22707-4199-4356-ac35-9a770b363581 req-983ed5ff-9409-4b28-aa93-7edfe34139f1 service nova] Acquiring lock "8497b901-64fb-44f3-bd07-f584ab799867-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7fb22707-4199-4356-ac35-9a770b363581 req-983ed5ff-9409-4b28-aa93-7edfe34139f1 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7fb22707-4199-4356-ac35-9a770b363581 req-983ed5ff-9409-4b28-aa93-7edfe34139f1 service nova] Lock "8497b901-64fb-44f3-bd07-f584ab799867-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:21 user nova-compute[74242]: DEBUG nova.compute.manager [req-7fb22707-4199-4356-ac35-9a770b363581 req-983ed5ff-9409-4b28-aa93-7edfe34139f1 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] No waiting events found dispatching network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:31:21 user nova-compute[74242]: WARNING nova.compute.manager [req-7fb22707-4199-4356-ac35-9a770b363581 req-983ed5ff-9409-4b28-aa93-7edfe34139f1 service nova] [instance: 8497b901-64fb-44f3-bd07-f584ab799867] Received unexpected event network-vif-plugged-df5d650c-5e5c-4822-8154-7fc1213190b4 for instance with vm_state deleted and task_state None.
Oct 20 02:31:21 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:31:21 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:31:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.288s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:21 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Deleted allocations for instance 8497b901-64fb-44f3-bd07-f584ab799867
Oct 20 02:31:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-930aafaa-ccd8-4a2e-8d39-38e264ca676d tempest-ServerStableDeviceRescueTest-1200020058 tempest-ServerStableDeviceRescueTest-1200020058-project-member] Lock "8497b901-64fb-44f3-bd07-f584ab799867" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.532s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:41 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 is timed out.
Oct 20 02:31:41 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Successfully detached device vdc from instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 from the live domain config.
Oct 20 02:31:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sSixWFYL', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:31:41 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bf44c6-9fe5-4efd-90ff-f814f5ddf607]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:31:41 user nova-compute[74242]: No targets found.
Oct 20 02:31:41 user nova-compute[74242]: iSNS:
Oct 20 02:31:41 user nova-compute[74242]: No targets found.
Oct 20 02:31:41 user nova-compute[74242]: STATIC:
Oct 20 02:31:41 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007
Oct 20 02:31:41 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:31:41 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:31:41 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad
Oct 20 02:31:41 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:31:41 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:31:41 user nova-compute[74242]: FIRMWARE:
Oct 20 02:31:41 user nova-compute[74242]: No targets found.
Oct 20 02:31:41 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:31:41 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:31:41 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1622aa92-a618-4cbc-90ee-deb17f7080fe]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a0a2c65-9174-4857-9bf8-31094ac71a9d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad (non-flash)
Oct 20 02:31:41 user nova-compute[74242]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 (non-flash)
Oct 20 02:31:41 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad (non-flash)
Oct 20 02:31:41 user nova-compute[74242]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 (non-flash)
Oct 20 02:31:41 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8947ec790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007'): ({'sdc'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Removing single pathed devices sdc {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cba8c117-8866-464a-a1f7-30f96d6894cd]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c526a49f-aefb-4834-8422-1576c54ac2a0]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Flushing IO for device /dev/sdc {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e61ba1-9d43-4c13-a2ec-3955d482f773]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.031s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41f1e23-446f-4144-bb74-582fad58fced]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[293aec3a-bd9e-40ac-965e-28fab7a76601]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e17261-0925-4c90-b1cf-45d4bcf7ff13]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007, portal: 172.16.0.220,3260]
Oct 20 02:31:41 user nova-compute[74242]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007, portal: 172.16.0.220,3260] successful.
Oct 20 02:31:41 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d137294a-55e4-41f7-a906-1c827cf21007 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcefac2-bb18-443b-8ea0-105961d3fb76]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] <== disconnect_volume: return (283ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:31:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:31:42 user nova-compute[74242]: DEBUG nova.objects.instance [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lazy-loading 'flavor' on Instance uuid 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:31:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-92fb5485-90dc-4062-811f-ec91669d800f tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.923s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:45 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:31:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:46 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:31:49 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:31:49 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:31:49 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Didn't find any instances for network info cache update. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 02:31:50 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:31:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:31:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:31:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:31:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:31:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:31:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:31:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:53 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:31:54 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:31:55 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:31:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:31:55 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:31:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:31:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:31:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:55 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:56 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:31:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:31:58 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:31:58 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:31:58 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8286MB free_disk=24.904212951660156GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:31:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:31:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:31:58 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:31:58 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:31:58 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:31:58 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:31:58 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 67575ff4-ecf0-493a-b07d-0e808f209b23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:31:58 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:31:58 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:31:58 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:31:58 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:31:58 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:31:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:32:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:32:01 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:32:01 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:32:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:32:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:32:11 user nova-compute[74242]: INFO nova.compute.manager [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Detaching volume d4b9532e-9234-40c8-9237-ff6f4f3cddad
Oct 20 02:32:11 user nova-compute[74242]: INFO nova.virt.block_device [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Attempting to driver detach volume d4b9532e-9234-40c8-9237-ff6f4f3cddad from mountpoint /dev/vdb
Oct 20 02:32:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Attempting to detach device vdb from instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:32:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:32:11 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:32:11 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:32:11 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:32:11 user nova-compute[74242]:   <serial>d4b9532e-9234-40c8-9237-ff6f4f3cddad</serial>
Oct 20 02:32:11 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:32:11 user nova-compute[74242]: </disk>
Oct 20 02:32:11 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:32:11 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Successfully detached device vdb from instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 from the persistent domain config.
Oct 20 02:32:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:32:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:32:11 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:32:11 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:32:11 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:32:11 user nova-compute[74242]:   <serial>d4b9532e-9234-40c8-9237-ff6f4f3cddad</serial>
Oct 20 02:32:11 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:32:11 user nova-compute[74242]: </disk>
Oct 20 02:32:11 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:32:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:32:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:32:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:32:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "d4ccd900-744b-49d8-a892-897591be031c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:32:19 user nova-compute[74242]: DEBUG nova.compute.manager [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:32:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:32:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:32:19 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:32:19 user nova-compute[74242]: INFO nova.compute.claims [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Claim successful on node user
Oct 20 02:32:20 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG nova.network.neutron [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:32:20 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:32:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG nova.policy [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c7a7db373740428d89dcda898a04410c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80fa40dfb2c84a84b3399b643fcde4c5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:32:20 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Creating image(s)
Oct 20 02:32:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "/opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "/opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.233s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:32:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.231s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk 1073741824" returned: 0 in 0.062s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.301s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG nova.network.neutron [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Successfully created port: 7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Cannot resize image /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Ensure instance console log exists: /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:32:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.network.neutron [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Successfully updated port: 7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquired lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.network.neutron [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.compute.manager [req-d2967836-59a9-467e-bfb4-f3ec904e1fae req-2a1c8504-3390-49ab-94c0-dea81cc6118c service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-changed-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.compute.manager [req-d2967836-59a9-467e-bfb4-f3ec904e1fae req-2a1c8504-3390-49ab-94c0-dea81cc6118c service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Refreshing instance network info cache due to event network-changed-7e3b7bad-876a-447a-85da-4e5f501f7870. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d2967836-59a9-467e-bfb4-f3ec904e1fae req-2a1c8504-3390-49ab-94c0-dea81cc6118c service nova] Acquiring lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.network.neutron [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.network.neutron [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updating instance_info_cache with network_info: [{"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Releasing lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.compute.manager [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Instance network_info: |[{"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d2967836-59a9-467e-bfb4-f3ec904e1fae req-2a1c8504-3390-49ab-94c0-dea81cc6118c service nova] Acquired lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.network.neutron [req-d2967836-59a9-467e-bfb4-f3ec904e1fae req-2a1c8504-3390-49ab-94c0-dea81cc6118c service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Refreshing network info cache for port 7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Start _get_guest_xml network_info=[{"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:32:22 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:32:22 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-152224677',display_name='tempest-ServerRescueNegativeTestJSON-server-152224677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-152224677',id=45,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9Mtlxvqlj1pE6vYvPdL1UdNCYZPX0lT8au15a5bX8mGhRxSjUvSnM8xuUjtjZDzFHL1AQVy9cO5NTiAIkYEV8cAWKKCHrUdE3NaT8luGUIzQMGdmnKDEEYl1FHNnaQHw==',key_name='tempest-keypair-62369157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80fa40dfb2c84a84b3399b643fcde4c5',ramdisk_id='',reservation_id='r-ka1vb9ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-630282540',owner_user_name='tempest-ServerRescueNegativeTestJSON-630282540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:32:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7a7db373740428d89dcda898a04410c',uuid=d4ccd900-744b-49d8-a892-897591be031c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converting VIF {"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:22:b6,bridge_name='br-int',has_traffic_filtering=True,id=7e3b7bad-876a-447a-85da-4e5f501f7870,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3b7bad-87') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.objects.instance [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'pci_devices' on Instance uuid d4ccd900-744b-49d8-a892-897591be031c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:32:22 user nova-compute[74242]:   <uuid>d4ccd900-744b-49d8-a892-897591be031c</uuid>
Oct 20 02:32:22 user nova-compute[74242]:   <name>instance-0000002d</name>
Oct 20 02:32:22 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:32:22 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:32:22 user nova-compute[74242]:   <metadata>
Oct 20 02:32:22 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:32:22 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:32:22 user nova-compute[74242]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-152224677</nova:name>
Oct 20 02:32:22 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:32:22</nova:creationTime>
Oct 20 02:32:22 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:32:22 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:32:22 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:32:22 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:32:22 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:32:22 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:32:22 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:32:22 user nova-compute[74242]:       <nova:owner>
Oct 20 02:32:22 user nova-compute[74242]:         <nova:user uuid="c7a7db373740428d89dcda898a04410c">tempest-ServerRescueNegativeTestJSON-630282540-project-member</nova:user>
Oct 20 02:32:22 user nova-compute[74242]:         <nova:project uuid="80fa40dfb2c84a84b3399b643fcde4c5">tempest-ServerRescueNegativeTestJSON-630282540</nova:project>
Oct 20 02:32:22 user nova-compute[74242]:       </nova:owner>
Oct 20 02:32:22 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:32:22 user nova-compute[74242]:       <nova:ports>
Oct 20 02:32:22 user nova-compute[74242]:         <nova:port uuid="7e3b7bad-876a-447a-85da-4e5f501f7870">
Oct 20 02:32:22 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 02:32:22 user nova-compute[74242]:         </nova:port>
Oct 20 02:32:22 user nova-compute[74242]:       </nova:ports>
Oct 20 02:32:22 user nova-compute[74242]:     </nova:instance>
Oct 20 02:32:22 user nova-compute[74242]:   </metadata>
Oct 20 02:32:22 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:32:22 user nova-compute[74242]:     <system>
Oct 20 02:32:22 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:32:22 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:32:22 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:32:22 user nova-compute[74242]:       <entry name="serial">d4ccd900-744b-49d8-a892-897591be031c</entry>
Oct 20 02:32:22 user nova-compute[74242]:       <entry name="uuid">d4ccd900-744b-49d8-a892-897591be031c</entry>
Oct 20 02:32:22 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:32:22 user nova-compute[74242]:     </system>
Oct 20 02:32:22 user nova-compute[74242]:   </sysinfo>
Oct 20 02:32:22 user nova-compute[74242]:   <os>
Oct 20 02:32:22 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:32:22 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:32:22 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:32:22 user nova-compute[74242]:   </os>
Oct 20 02:32:22 user nova-compute[74242]:   <features>
Oct 20 02:32:22 user nova-compute[74242]:     <acpi/>
Oct 20 02:32:22 user nova-compute[74242]:     <apic/>
Oct 20 02:32:22 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:32:22 user nova-compute[74242]:   </features>
Oct 20 02:32:22 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:32:22 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:32:22 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:32:22 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:32:22 user nova-compute[74242]:   </clock>
Oct 20 02:32:22 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:32:22 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:32:22 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:32:22 user nova-compute[74242]:   </cpu>
Oct 20 02:32:22 user nova-compute[74242]:   <devices>
Oct 20 02:32:22 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:32:22 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:32:22 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk"/>
Oct 20 02:32:22 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:32:22 user nova-compute[74242]:     </disk>
Oct 20 02:32:22 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:32:22 user nova-compute[74242]:       <mac address="fa:16:3e:a6:22:b6"/>
Oct 20 02:32:22 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:32:22 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:32:22 user nova-compute[74242]:       <target dev="tap7e3b7bad-87"/>
Oct 20 02:32:22 user nova-compute[74242]:     </interface>
Oct 20 02:32:22 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:32:22 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/console.log" append="off"/>
Oct 20 02:32:22 user nova-compute[74242]:     </serial>
Oct 20 02:32:22 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:32:22 user nova-compute[74242]:     <video>
Oct 20 02:32:22 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:32:22 user nova-compute[74242]:     </video>
Oct 20 02:32:22 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:32:22 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:32:22 user nova-compute[74242]:     </rng>
Oct 20 02:32:22 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:32:22 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:32:22 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:32:22 user nova-compute[74242]:     </memballoon>
Oct 20 02:32:22 user nova-compute[74242]:   </devices>
Oct 20 02:32:22 user nova-compute[74242]: </domain>
Oct 20 02:32:22 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-152224677',display_name='tempest-ServerRescueNegativeTestJSON-server-152224677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-152224677',id=45,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9Mtlxvqlj1pE6vYvPdL1UdNCYZPX0lT8au15a5bX8mGhRxSjUvSnM8xuUjtjZDzFHL1AQVy9cO5NTiAIkYEV8cAWKKCHrUdE3NaT8luGUIzQMGdmnKDEEYl1FHNnaQHw==',key_name='tempest-keypair-62369157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='80fa40dfb2c84a84b3399b643fcde4c5',ramdisk_id='',reservation_id='r-ka1vb9ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-630282540',owner_user_name='tempest-ServerRescueNegativeTestJSON-630282540-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:32:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7a7db373740428d89dcda898a04410c',uuid=d4ccd900-744b-49d8-a892-897591be031c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converting VIF {"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a6:22:b6,bridge_name='br-int',has_traffic_filtering=True,id=7e3b7bad-876a-447a-85da-4e5f501f7870,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3b7bad-87') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG os_vif [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:22:b6,bridge_name='br-int',has_traffic_filtering=True,id=7e3b7bad-876a-447a-85da-4e5f501f7870,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3b7bad-87') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61e863bb-2c92-5fa7-a88e-1d50f0bd5f7b', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e3b7bad-87, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e3b7bad-87, col_values=(('qos', UUID('88b4fa43-a05c-4bf6-b9d3-11138357cc4b')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e3b7bad-87, col_values=(('external_ids', {'iface-id': '7e3b7bad-876a-447a-85da-4e5f501f7870', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a6:22:b6', 'vm-uuid': 'd4ccd900-744b-49d8-a892-897591be031c'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:22 user nova-compute[74242]: INFO os_vif [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a6:22:b6,bridge_name='br-int',has_traffic_filtering=True,id=7e3b7bad-876a-447a-85da-4e5f501f7870,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3b7bad-87')
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:32:22 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No VIF found with MAC fa:16:3e:a6:22:b6, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:32:23 user nova-compute[74242]: DEBUG nova.network.neutron [req-d2967836-59a9-467e-bfb4-f3ec904e1fae req-2a1c8504-3390-49ab-94c0-dea81cc6118c service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updated VIF entry in instance network info cache for port 7e3b7bad-876a-447a-85da-4e5f501f7870. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:32:23 user nova-compute[74242]: DEBUG nova.network.neutron [req-d2967836-59a9-467e-bfb4-f3ec904e1fae req-2a1c8504-3390-49ab-94c0-dea81cc6118c service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updating instance_info_cache with network_info: [{"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:32:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d2967836-59a9-467e-bfb4-f3ec904e1fae req-2a1c8504-3390-49ab-94c0-dea81cc6118c service nova] Releasing lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:32:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-c6563f5f-3d04-4f03-b9c9-fa5175f476f4 req-117e535c-a447-4b6e-97e4-869e9366fb8a service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:32:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c6563f5f-3d04-4f03-b9c9-fa5175f476f4 req-117e535c-a447-4b6e-97e4-869e9366fb8a service nova] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:32:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c6563f5f-3d04-4f03-b9c9-fa5175f476f4 req-117e535c-a447-4b6e-97e4-869e9366fb8a service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:32:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c6563f5f-3d04-4f03-b9c9-fa5175f476f4 req-117e535c-a447-4b6e-97e4-869e9366fb8a service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:32:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-c6563f5f-3d04-4f03-b9c9-fa5175f476f4 req-117e535c-a447-4b6e-97e4-869e9366fb8a service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] No waiting events found dispatching network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:32:24 user nova-compute[74242]: WARNING nova.compute.manager [req-c6563f5f-3d04-4f03-b9c9-fa5175f476f4 req-117e535c-a447-4b6e-97e4-869e9366fb8a service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received unexpected event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 for instance with vm_state building and task_state spawning.
Oct 20 02:32:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:26 user nova-compute[74242]: DEBUG nova.compute.manager [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:32:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:32:26 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: d4ccd900-744b-49d8-a892-897591be031c] Instance spawned successfully.
Oct 20 02:32:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:32:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:32:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:32:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:32:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:32:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:32:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:32:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-6ed10411-a189-45e1-b394-deab47725a37 req-80fca62e-cc7c-4d18-befd-00a3b4d9b7b6 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:32:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6ed10411-a189-45e1-b394-deab47725a37 req-80fca62e-cc7c-4d18-befd-00a3b4d9b7b6 service nova] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:32:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6ed10411-a189-45e1-b394-deab47725a37 req-80fca62e-cc7c-4d18-befd-00a3b4d9b7b6 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:32:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6ed10411-a189-45e1-b394-deab47725a37 req-80fca62e-cc7c-4d18-befd-00a3b4d9b7b6 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:32:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-6ed10411-a189-45e1-b394-deab47725a37 req-80fca62e-cc7c-4d18-befd-00a3b4d9b7b6 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] No waiting events found dispatching network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:32:26 user nova-compute[74242]: WARNING nova.compute.manager [req-6ed10411-a189-45e1-b394-deab47725a37 req-80fca62e-cc7c-4d18-befd-00a3b4d9b7b6 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received unexpected event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 for instance with vm_state building and task_state spawning.
Oct 20 02:32:26 user nova-compute[74242]: INFO nova.compute.manager [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Took 5.88 seconds to spawn the instance on the hypervisor.
Oct 20 02:32:26 user nova-compute[74242]: DEBUG nova.compute.manager [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:32:26 user nova-compute[74242]: INFO nova.compute.manager [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Took 6.78 seconds to build instance.
Oct 20 02:32:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-be953c11-e6d8-478d-8eb2-a345dc537201 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "d4ccd900-744b-49d8-a892-897591be031c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.921s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:32:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7d8fdf4-6740-48c1-8f22-22d4bd35e835 req-73655a84-4422-422e-8df8-7caa61558e58 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-changed-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7d8fdf4-6740-48c1-8f22-22d4bd35e835 req-73655a84-4422-422e-8df8-7caa61558e58 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Refreshing instance network info cache due to event network-changed-957c2a1b-2b78-47c9-8e79-fc8ce92755ec. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7d8fdf4-6740-48c1-8f22-22d4bd35e835 req-73655a84-4422-422e-8df8-7caa61558e58 service nova] Acquiring lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7d8fdf4-6740-48c1-8f22-22d4bd35e835 req-73655a84-4422-422e-8df8-7caa61558e58 service nova] Acquired lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG nova.network.neutron [req-d7d8fdf4-6740-48c1-8f22-22d4bd35e835 req-73655a84-4422-422e-8df8-7caa61558e58 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Refreshing network info cache for port 957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:32:31 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 is timed out.
Oct 20 02:32:31 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Successfully detached device vdb from instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 from the live domain config.
Oct 20 02:32:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NcVvtfhW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:32:31 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:32:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b7ae0e-9200-400a-a6d5-48cc65d05407]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:32:31 user nova-compute[74242]: No targets found.
Oct 20 02:32:31 user nova-compute[74242]: iSNS:
Oct 20 02:32:31 user nova-compute[74242]: No targets found.
Oct 20 02:32:31 user nova-compute[74242]: STATIC:
Oct 20 02:32:31 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad
Oct 20 02:32:31 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:32:31 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:32:31 user nova-compute[74242]: FIRMWARE:
Oct 20 02:32:31 user nova-compute[74242]: No targets found.
Oct 20 02:32:31 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:32:31 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:32:31 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fdd09c-74c3-4525-875c-c3361d7c7e5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:32:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8c0a5f0-0436-4d38-8dd2-86bede1f3ecf]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad (non-flash)
Oct 20 02:32:32 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad (non-flash)
Oct 20 02:32:32 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b84d6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad'): ({'sdb'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Removing single pathed devices sdb {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b493d48-641d-4615-ab9e-1d03b58f7b49]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e1797a-7772-417b-8224-df7d36002ce7]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Flushing IO for device /dev/sdb {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[939bceb3-e8fc-474e-9118-955fb715d6f8]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-d7d8fdf4-6740-48c1-8f22-22d4bd35e835 req-73655a84-4422-422e-8df8-7caa61558e58 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Updated VIF entry in instance network info cache for port 957c2a1b-2b78-47c9-8e79-fc8ce92755ec. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-d7d8fdf4-6740-48c1-8f22-22d4bd35e835 req-73655a84-4422-422e-8df8-7caa61558e58 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Updating instance_info_cache with network_info: [{"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7d8fdf4-6740-48c1-8f22-22d4bd35e835 req-73655a84-4422-422e-8df8-7caa61558e58 service nova] Releasing lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9331d45-c762-454c-ace0-6ca0916b37ab]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a6a110-32a7-48b7-a71b-e82396190373]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[187e14be-afc5-4241-af3e-bef83b08ce38]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad, portal: 172.16.0.220,3260]
Oct 20 02:32:32 user nova-compute[74242]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad, portal: 172.16.0.220,3260] successful.
Oct 20 02:32:32 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d4b9532e-9234-40c8-9237-ff6f4f3cddad -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b8f659-a54c-4404-9f23-052f3ba56fc6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] <== disconnect_volume: return (308ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:32:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG nova.objects.instance [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'flavor' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:32:41 user nova-compute[74242]: INFO nova.compute.manager [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Attaching volume 4daf3c70-6911-47b4-bc0d-9840e04ae0c0 to /dev/vdb
Oct 20 02:32:41 user nova-compute[74242]: DEBUG os_brick.utils [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4773352b-f322-4cd3-b730-0c67227a05df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece11525-bcbd-41cb-b2ed-9299fb1fe0f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba03fe7b-56dc-42cf-95e9-0c194d3848b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a173b3-eed0-47d0-b8ec-b1b09a836f44]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:32:41 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:32:41 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aa9360-7c05-4939-9033-d6d912cb825a]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG os_brick.utils [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:32:41 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Updating existing volume attachment record: d64f46e0-782a-44e3-ad77-92fe21f2bbae {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:32:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:44 user nova-compute[74242]: DEBUG nova.objects.instance [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lazy-loading 'flavor' on Instance uuid 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:32:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-eb58a303-8baf-46b2-ba3c-ddb9fe8b83cf tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 32.915s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:32:45 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:32:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:48 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:32:49 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:32:49 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:32:49 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:32:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:32:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:32:49 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:32:49 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid 2bf62933-66ea-469e-a70e-92184f311110 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:32:49 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Updating instance_info_cache with network_info: [{"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:32:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:32:49 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:32:50 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:32:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:32:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:53 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:32:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:56 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:32:57 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:32:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:32:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:32:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:32:57 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:32:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:32:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.247s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:32:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:32:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:00 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:33:00 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:33:00 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8229MB free_disk=24.864967346191406GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:33:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:33:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:33:00 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:33:00 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:33:00 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:33:00 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:33:00 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 67575ff4-ecf0-493a-b07d-0e808f209b23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:33:00 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d4ccd900-744b-49d8-a892-897591be031c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:33:00 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:33:00 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:33:00 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:33:00 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:33:00 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:33:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:33:01 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:33:01 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:33:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:33:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:33:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:33:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:33:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:33:01 user nova-compute[74242]: INFO nova.compute.manager [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Terminating instance
Oct 20 02:33:01 user nova-compute[74242]: DEBUG nova.compute.manager [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:33:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-d99b5235-4855-4617-a5af-e449844a3986 req-2ca6b582-bf59-4c39-9b65-f927f8eda87e service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Received event network-vif-unplugged-e615d9b4-3b1b-4350-9174-c9bb7d0feba1 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d99b5235-4855-4617-a5af-e449844a3986 req-2ca6b582-bf59-4c39-9b65-f927f8eda87e service nova] Acquiring lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d99b5235-4855-4617-a5af-e449844a3986 req-2ca6b582-bf59-4c39-9b65-f927f8eda87e service nova] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d99b5235-4855-4617-a5af-e449844a3986 req-2ca6b582-bf59-4c39-9b65-f927f8eda87e service nova] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-d99b5235-4855-4617-a5af-e449844a3986 req-2ca6b582-bf59-4c39-9b65-f927f8eda87e service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] No waiting events found dispatching network-vif-unplugged-e615d9b4-3b1b-4350-9174-c9bb7d0feba1 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG nova.compute.manager [req-d99b5235-4855-4617-a5af-e449844a3986 req-2ca6b582-bf59-4c39-9b65-f927f8eda87e service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Received event network-vif-unplugged-e615d9b4-3b1b-4350-9174-c9bb7d0feba1 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:33:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Instance destroyed successfully.
Oct 20 02:33:02 user nova-compute[74242]: DEBUG nova.objects.instance [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lazy-loading 'resources' on Instance uuid 3bbdf97b-2499-4c4e-b531-8297ad2e7a38 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:28:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-349934967',display_name='tempest-TestServerVolumeAttachmentScenario-server-349934967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-349934967',id=42,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaaSJzyY7lF+jrNYnQ3BoU/8TWhEMxZ0TB3AoSQeYn5OBB/rwz4adHZtg1H6bdz4gXQ0gKSh291/+MhGmhNwry5vRwPn9AyECfsxSb+g6YkMPeHAC9k76mZ1wsJiOlG+A==',key_name='tempest-keypair-1863196751',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:28:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e3092afce2f481282ed71b01dba0675',ramdisk_id='',reservation_id='r-j3znw7lb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1001240990',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1001240990-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:28:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8efe11f71aba46d8bf834150b6284612',uuid=3bbdf97b-2499-4c4e-b531-8297ad2e7a38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "address": "fa:16:3e:5d:02:57", "network": {"id": "f2d4b88b-6573-44ea-a8b0-b597f04b986c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1466603443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e3092afce2f481282ed71b01dba0675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape615d9b4-3b", "ovs_interfaceid": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Converting VIF {"id": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "address": "fa:16:3e:5d:02:57", "network": {"id": "f2d4b88b-6573-44ea-a8b0-b597f04b986c", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-1466603443-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.90", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e3092afce2f481282ed71b01dba0675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape615d9b4-3b", "ovs_interfaceid": "e615d9b4-3b1b-4350-9174-c9bb7d0feba1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5d:02:57,bridge_name='br-int',has_traffic_filtering=True,id=e615d9b4-3b1b-4350-9174-c9bb7d0feba1,network=Network(f2d4b88b-6573-44ea-a8b0-b597f04b986c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape615d9b4-3b') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG os_vif [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:02:57,bridge_name='br-int',has_traffic_filtering=True,id=e615d9b4-3b1b-4350-9174-c9bb7d0feba1,network=Network(f2d4b88b-6573-44ea-a8b0-b597f04b986c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape615d9b4-3b') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape615d9b4-3b, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=44d20112-9098-41a9-a1fc-b06ac3acfdcd) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:02 user nova-compute[74242]: INFO os_vif [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5d:02:57,bridge_name='br-int',has_traffic_filtering=True,id=e615d9b4-3b1b-4350-9174-c9bb7d0feba1,network=Network(f2d4b88b-6573-44ea-a8b0-b597f04b986c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape615d9b4-3b')
Oct 20 02:33:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Deleting instance files /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38_del
Oct 20 02:33:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Deletion of /opt/stack/data/nova/instances/3bbdf97b-2499-4c4e-b531-8297ad2e7a38_del complete
Oct 20 02:33:02 user nova-compute[74242]: INFO nova.compute.manager [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 20 02:33:02 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:33:02 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:33:03 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:33:03 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Took 1.31 seconds to deallocate network for instance.
Oct 20 02:33:03 user nova-compute[74242]: DEBUG nova.compute.manager [req-32e87bbd-31ef-4f4a-9566-830e7736ce3c req-fa5833e4-9419-4405-b16b-3948e59f09a3 service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Received event network-vif-deleted-e615d9b4-3b1b-4350-9174-c9bb7d0feba1 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.220s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:33:04 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Deleted allocations for instance 3bbdf97b-2499-4c4e-b531-8297ad2e7a38
Oct 20 02:33:04 user nova-compute[74242]: DEBUG nova.compute.manager [req-c09d73cd-fdf1-4aef-abe8-774f4ef92e01 req-06f0114b-72d0-4e28-a334-39f365a2d748 service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Received event network-vif-plugged-e615d9b4-3b1b-4350-9174-c9bb7d0feba1 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c09d73cd-fdf1-4aef-abe8-774f4ef92e01 req-06f0114b-72d0-4e28-a334-39f365a2d748 service nova] Acquiring lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c09d73cd-fdf1-4aef-abe8-774f4ef92e01 req-06f0114b-72d0-4e28-a334-39f365a2d748 service nova] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c09d73cd-fdf1-4aef-abe8-774f4ef92e01 req-06f0114b-72d0-4e28-a334-39f365a2d748 service nova] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG nova.compute.manager [req-c09d73cd-fdf1-4aef-abe8-774f4ef92e01 req-06f0114b-72d0-4e28-a334-39f365a2d748 service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] No waiting events found dispatching network-vif-plugged-e615d9b4-3b1b-4350-9174-c9bb7d0feba1 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:33:04 user nova-compute[74242]: WARNING nova.compute.manager [req-c09d73cd-fdf1-4aef-abe8-774f4ef92e01 req-06f0114b-72d0-4e28-a334-39f365a2d748 service nova] [instance: 3bbdf97b-2499-4c4e-b531-8297ad2e7a38] Received unexpected event network-vif-plugged-e615d9b4-3b1b-4350-9174-c9bb7d0feba1 for instance with vm_state deleted and task_state None.
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6e8a65b1-1bd1-4927-ada2-1d3a80323143 tempest-TestServerVolumeAttachmentScenario-1001240990 tempest-TestServerVolumeAttachmentScenario-1001240990-project-member] Lock "3bbdf97b-2499-4c4e-b531-8297ad2e7a38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.595s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "67575ff4-ecf0-493a-b07d-0e808f209b23" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lazy-loading 'flavor' on Instance uuid 67575ff4-ecf0-493a-b07d-0e808f209b23 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "67575ff4-ecf0-493a-b07d-0e808f209b23" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:33:04 user nova-compute[74242]: INFO nova.compute.manager [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Attaching volume d31cb8c6-ef82-40ca-911a-a61af4e5548d to /dev/vdb
Oct 20 02:33:04 user nova-compute[74242]: DEBUG os_brick.utils [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ca34cb-849c-44c1-9a07-be6a5f7ad288]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[16aa4224-ca73-41cb-abb4-b344bfb43c0d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ad7406-0964-4283-b3bb-900132a5363d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[64426c22-1196-4043-b3e0-dc30babee3fb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:33:04 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:33:04 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[082c19e3-1899-40b8-933e-285a518d4012]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG os_brick.utils [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:33:04 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Updating existing volume attachment record: 42030f6b-95d5-46b0-aec4-20b593fd9aee {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:33:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-242a3cb3-c314-4a71-a2b2-5fdd02edb12b req-a4eff1c7-ed16-495a-995a-61134c39909e service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Received event network-changed-7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:33:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-242a3cb3-c314-4a71-a2b2-5fdd02edb12b req-a4eff1c7-ed16-495a-995a-61134c39909e service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Refreshing instance network info cache due to event network-changed-7ea2f019-bafe-4b3a-a937-17d367233bc6. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:33:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-242a3cb3-c314-4a71-a2b2-5fdd02edb12b req-a4eff1c7-ed16-495a-995a-61134c39909e service nova] Acquiring lock "refresh_cache-67575ff4-ecf0-493a-b07d-0e808f209b23" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:33:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-242a3cb3-c314-4a71-a2b2-5fdd02edb12b req-a4eff1c7-ed16-495a-995a-61134c39909e service nova] Acquired lock "refresh_cache-67575ff4-ecf0-493a-b07d-0e808f209b23" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:33:06 user nova-compute[74242]: DEBUG nova.network.neutron [req-242a3cb3-c314-4a71-a2b2-5fdd02edb12b req-a4eff1c7-ed16-495a-995a-61134c39909e service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Refreshing network info cache for port 7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:33:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:33:06 user nova-compute[74242]: DEBUG nova.network.neutron [req-242a3cb3-c314-4a71-a2b2-5fdd02edb12b req-a4eff1c7-ed16-495a-995a-61134c39909e service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Updated VIF entry in instance network info cache for port 7ea2f019-bafe-4b3a-a937-17d367233bc6. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:33:06 user nova-compute[74242]: DEBUG nova.network.neutron [req-242a3cb3-c314-4a71-a2b2-5fdd02edb12b req-a4eff1c7-ed16-495a-995a-61134c39909e service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Updating instance_info_cache with network_info: [{"id": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "address": "fa:16:3e:75:e6:79", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea2f019-ba", "ovs_interfaceid": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:33:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-242a3cb3-c314-4a71-a2b2-5fdd02edb12b req-a4eff1c7-ed16-495a-995a-61134c39909e service nova] Releasing lock "refresh_cache-67575ff4-ecf0-493a-b07d-0e808f209b23" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:33:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lURfmLcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:33:08 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:33:08 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:33:08 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[224bb611-66aa-4e54-985c-42487f5ca785]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:33:08 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[edeb56d6-6d33-403f-b17d-c6ce06a944cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0] added
Oct 20 02:33:08 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6011cc11-f0d5-4e10-8fa9-e9232c06debf]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[28617451-95e9-4633-a071-f9e0653f614c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lURfmLcI {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lURfmLcI" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e663b57-f5b2-4d21-9a0c-c937e00987ef]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lURfmLcI'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0ae40cf-23c8-4b10-b258-5772477acf23]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[08275c32-9f42-451c-a72f-d5239f5850dd]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 02:33:08 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 02:33:08 user nova-compute[74242]:  {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:33:08 user nova-compute[74242]: WARNING os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 02:33:08 user nova-compute[74242]: 
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc182a29-bc34-4f2f-b8e1-579a7c584744]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260]
Oct 20 02:33:08 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260] successful.
Oct 20 02:33:08 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[850b60a1-7f6b-4fa2-bdda-3489e3adb2f6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1625228b-5d00-4cc9-b733-00ff641862de]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:33:08 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:33:08 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7fe0bc9-4f3d-4825-96b1-6a132cc0f20e]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:33:08 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lURfmLcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:33:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.287s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:33:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] <== connect_volume: return (1289ms) {'type': 'block', 'scsi_wwn': '23035346633633833', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:33:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035346633633833', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:33:09 user nova-compute[74242]: DEBUG nova.objects.instance [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'flavor' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:33:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:33:09 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:33:09 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:33:09 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:33:09 user nova-compute[74242]:   <serial>4daf3c70-6911-47b4-bc0d-9840e04ae0c0</serial>
Oct 20 02:33:09 user nova-compute[74242]: </disk>
Oct 20 02:33:09 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:33:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:33:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:33:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] No VIF found with MAC fa:16:3e:87:ef:3f, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:33:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-a5a9ad17-aa58-4859-bb7f-1b9e07df06a3 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.836s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:33:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-eb9b8263-5851-4c17-8484-6930c4fde299 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:33:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-eb9b8263-5851-4c17-8484-6930c4fde299 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:33:10 user nova-compute[74242]: DEBUG nova.compute.manager [None req-eb9b8263-5851-4c17-8484-6930c4fde299 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:33:10 user nova-compute[74242]: DEBUG nova.compute.manager [None req-eb9b8263-5851-4c17-8484-6930c4fde299 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74242) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 20 02:33:10 user nova-compute[74242]: DEBUG nova.objects.instance [None req-eb9b8263-5851-4c17-8484-6930c4fde299 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'flavor' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:33:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:10 user nova-compute[74242]: DEBUG nova.compute.manager [req-367bb8a1-ecea-4deb-b0a7-cb6c9f3d53aa req-268552a2-87f1-4149-8812-0c8b5ee24f10 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-vif-unplugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:33:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-367bb8a1-ecea-4deb-b0a7-cb6c9f3d53aa req-268552a2-87f1-4149-8812-0c8b5ee24f10 service nova] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:33:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-367bb8a1-ecea-4deb-b0a7-cb6c9f3d53aa req-268552a2-87f1-4149-8812-0c8b5ee24f10 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:33:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-367bb8a1-ecea-4deb-b0a7-cb6c9f3d53aa req-268552a2-87f1-4149-8812-0c8b5ee24f10 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:33:10 user nova-compute[74242]: DEBUG nova.compute.manager [req-367bb8a1-ecea-4deb-b0a7-cb6c9f3d53aa req-268552a2-87f1-4149-8812-0c8b5ee24f10 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] No waiting events found dispatching network-vif-unplugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:33:10 user nova-compute[74242]: WARNING nova.compute.manager [req-367bb8a1-ecea-4deb-b0a7-cb6c9f3d53aa req-268552a2-87f1-4149-8812-0c8b5ee24f10 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received unexpected event network-vif-unplugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec for instance with vm_state active and task_state powering-off.
Oct 20 02:33:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:11 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Instance destroyed successfully.
Oct 20 02:33:11 user nova-compute[74242]: DEBUG nova.compute.manager [None req-eb9b8263-5851-4c17-8484-6930c4fde299 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:33:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-eb9b8263-5851-4c17-8484-6930c4fde299 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.862s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:33:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:12 user nova-compute[74242]: DEBUG nova.compute.manager [req-f6ba70d7-6a72-4130-a3d4-408571276eed req-6f12042e-69d0-4a7d-8c94-97726d039fb6 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:33:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f6ba70d7-6a72-4130-a3d4-408571276eed req-6f12042e-69d0-4a7d-8c94-97726d039fb6 service nova] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:33:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f6ba70d7-6a72-4130-a3d4-408571276eed req-6f12042e-69d0-4a7d-8c94-97726d039fb6 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:33:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f6ba70d7-6a72-4130-a3d4-408571276eed req-6f12042e-69d0-4a7d-8c94-97726d039fb6 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:33:12 user nova-compute[74242]: DEBUG nova.compute.manager [req-f6ba70d7-6a72-4130-a3d4-408571276eed req-6f12042e-69d0-4a7d-8c94-97726d039fb6 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] No waiting events found dispatching network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:33:12 user nova-compute[74242]: WARNING nova.compute.manager [req-f6ba70d7-6a72-4130-a3d4-408571276eed req-6f12042e-69d0-4a7d-8c94-97726d039fb6 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received unexpected event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec for instance with vm_state stopped and task_state None.
Oct 20 02:33:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:33:21 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsuzifBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:33:21 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:33:21 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:33:21 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:33:21 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:33:21 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:33:21 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:33:21 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:33:21 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:21 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:21 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef41f73b-4f5a-442b-b403-7df5a5ecaf2c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:21 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:33:21 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:21 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:21 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:21 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[84546a12-3fc3-411c-91d3-ec9efd274c76]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:21 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d] added
Oct 20 02:33:21 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:21 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24b10d1-43c5-4ba6-9225-4aae9a5c7365]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4d56f0-9858-45b2-9be0-1f43f15fe348]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HsuzifBt {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HsuzifBt" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdca499-5ed4-4001-a176-b4cbc8518e65]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HsuzifBt'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddc8654-472b-41fc-b78b-67675bf4e03f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[756b962d-0e9c-4a28-abac-86629e08785e]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:33:22 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:33:22 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b4e144-4d3b-40a3-a602-ed9ade306898]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d, portal: 172.16.0.220,3260]
Oct 20 02:33:22 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d, portal: 172.16.0.220,3260] successful.
Oct 20 02:33:22 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[83081d2e-7471-4394-a4b5-58c7a5495926]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35e6810-ca22-4f56-a4e1-949f929334a7]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:33:22 user nova-compute[74242]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d (non-flash)
Oct 20 02:33:22 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:33:22 user nova-compute[74242]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d (non-flash)
Oct 20 02:33:22 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aea42ea3-dffd-4412-b8c2-3442d06a00c4]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsuzifBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:33:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:33:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26235366139346438', 'path': '/dev/sdc'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:33:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235366139346438', 'path': '/dev/sdc'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:33:23 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lazy-loading 'flavor' on Instance uuid 67575ff4-ecf0-493a-b07d-0e808f209b23 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:33:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:33:23 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:33:23 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:33:23 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:33:23 user nova-compute[74242]:   <serial>d31cb8c6-ef82-40ca-911a-a61af4e5548d</serial>
Oct 20 02:33:23 user nova-compute[74242]: </disk>
Oct 20 02:33:23 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:33:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:33:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:33:23 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] No VIF found with MAC fa:16:3e:75:e6:79, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:33:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8dca53fa-6035-4b05-a481-59906d32fe89 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.070s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:33:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "67575ff4-ecf0-493a-b07d-0e808f209b23" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:33:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:33:25 user nova-compute[74242]: INFO nova.compute.manager [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Detaching volume d31cb8c6-ef82-40ca-911a-a61af4e5548d
Oct 20 02:33:25 user nova-compute[74242]: INFO nova.virt.block_device [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Attempting to driver detach volume d31cb8c6-ef82-40ca-911a-a61af4e5548d from mountpoint /dev/vdb
Oct 20 02:33:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Attempting to detach device vdb from instance 67575ff4-ecf0-493a-b07d-0e808f209b23 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:33:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:33:25 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:33:25 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:33:25 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:33:25 user nova-compute[74242]:   <serial>d31cb8c6-ef82-40ca-911a-a61af4e5548d</serial>
Oct 20 02:33:25 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:33:25 user nova-compute[74242]: </disk>
Oct 20 02:33:25 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:33:25 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Successfully detached device vdb from instance 67575ff4-ecf0-493a-b07d-0e808f209b23 from the persistent domain config.
Oct 20 02:33:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 67575ff4-ecf0-493a-b07d-0e808f209b23 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:33:25 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:33:25 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:33:25 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:33:25 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:33:25 user nova-compute[74242]:   <serial>d31cb8c6-ef82-40ca-911a-a61af4e5548d</serial>
Oct 20 02:33:25 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:33:25 user nova-compute[74242]: </disk>
Oct 20 02:33:25 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:33:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 67575ff4-ecf0-493a-b07d-0e808f209b23 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:33:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:33:46 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 67575ff4-ecf0-493a-b07d-0e808f209b23 is timed out.
Oct 20 02:33:46 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Successfully detached device vdb from instance 67575ff4-ecf0-493a-b07d-0e808f209b23 from the live domain config.
Oct 20 02:33:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HsuzifBt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:33:46 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[501a324e-580b-4801-8252-61a28c1f491c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:33:46 user nova-compute[74242]: No targets found.
Oct 20 02:33:46 user nova-compute[74242]: iSNS:
Oct 20 02:33:46 user nova-compute[74242]: No targets found.
Oct 20 02:33:46 user nova-compute[74242]: STATIC:
Oct 20 02:33:46 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0
Oct 20 02:33:46 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:33:46 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:33:46 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d
Oct 20 02:33:46 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:33:46 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:33:46 user nova-compute[74242]: FIRMWARE:
Oct 20 02:33:46 user nova-compute[74242]: No targets found.
Oct 20 02:33:46 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:33:46 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:33:46 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac1bd84-15df-4e2d-a58a-79792f721bd3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[83a03cc5-cfee-4560-bd1e-ead52cb13bff]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:33:46 user nova-compute[74242]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d (non-flash)
Oct 20 02:33:46 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:33:46 user nova-compute[74242]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d (non-flash)
Oct 20 02:33:46 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d01895a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d'): ({'sdc'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Removing single pathed devices sdc {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03ff55b-d351-4589-8b17-d9eb514fc0d6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cef250-f174-4fde-937f-3e5b2f42a7ac]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Flushing IO for device /dev/sdc {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f803c54-f8c3-43f1-ab3c-bcf7c944b976]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d64cd58-13de-4c71-a085-7cb3fa4f5a32]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[08f1581b-4edd-4e86-a9d8-6c8acf800175]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ebdc15-6d26-4eb7-8c24-2bedaf6ba09c]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d, portal: 172.16.0.220,3260]
Oct 20 02:33:46 user nova-compute[74242]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d, portal: 172.16.0.220,3260] successful.
Oct 20 02:33:46 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d31cb8c6-ef82-40ca-911a-a61af4e5548d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b78d8dd-9523-487c-87dc-26dafb1a0122]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] <== disconnect_volume: return (293ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:33:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:33:47 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lazy-loading 'flavor' on Instance uuid 67575ff4-ecf0-493a-b07d-0e808f209b23 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:33:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8cd9855f-f5af-4561-a075-fbfc6aaa0336 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.630s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:33:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:33:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:33:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:33:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:33:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:48 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:33:50 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:33:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:33:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:33:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:33:50 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:33:50 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Updating instance_info_cache with network_info: [{"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:33:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:33:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:33:51 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:33:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:33:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:33:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:33:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:33:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:33:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:55 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:33:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:33:58 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:33:58 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:33:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:33:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:33:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:33:58 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:33:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:58 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:33:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:33:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:33:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:01 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:34:01 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8512MB free_disk=24.890483856201172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 67575ff4-ecf0-493a-b07d-0e808f209b23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d4ccd900-744b-49d8-a892-897591be031c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing inventories for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Updating ProviderTree inventory for provider 07b40460-b6ac-48c1-8447-e1778d50b26e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Updating inventory in ProviderTree for provider 07b40460-b6ac-48c1-8447-e1778d50b26e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing aggregate associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, aggregates: None {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing trait associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:34:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:02 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:34:02 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:34:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:34:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:34:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:34:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:34:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:03 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:34:05 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:34:05 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74242) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 02:34:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:34:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:34:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:34:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:34:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:34:10 user nova-compute[74242]: DEBUG nova.compute.manager [req-5f62c899-4692-480e-87a0-3f2421ffadea req-3c97b23d-1d48-47c1-b28b-9da89666badb service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-changed-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:34:10 user nova-compute[74242]: DEBUG nova.compute.manager [req-5f62c899-4692-480e-87a0-3f2421ffadea req-3c97b23d-1d48-47c1-b28b-9da89666badb service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Refreshing instance network info cache due to event network-changed-7e3b7bad-876a-447a-85da-4e5f501f7870. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:34:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5f62c899-4692-480e-87a0-3f2421ffadea req-3c97b23d-1d48-47c1-b28b-9da89666badb service nova] Acquiring lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:34:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5f62c899-4692-480e-87a0-3f2421ffadea req-3c97b23d-1d48-47c1-b28b-9da89666badb service nova] Acquired lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:34:10 user nova-compute[74242]: DEBUG nova.network.neutron [req-5f62c899-4692-480e-87a0-3f2421ffadea req-3c97b23d-1d48-47c1-b28b-9da89666badb service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Refreshing network info cache for port 7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "d4ccd900-744b-49d8-a892-897591be031c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG nova.objects.instance [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'flavor' on Instance uuid d4ccd900-744b-49d8-a892-897591be031c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "d4ccd900-744b-49d8-a892-897591be031c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "d4ccd900-744b-49d8-a892-897591be031c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:11 user nova-compute[74242]: INFO nova.compute.manager [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Attaching volume e08be8b8-bdca-492d-a95d-4a497b160701 to /dev/vdb
Oct 20 02:34:11 user nova-compute[74242]: DEBUG nova.network.neutron [req-5f62c899-4692-480e-87a0-3f2421ffadea req-3c97b23d-1d48-47c1-b28b-9da89666badb service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updated VIF entry in instance network info cache for port 7e3b7bad-876a-447a-85da-4e5f501f7870. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG nova.network.neutron [req-5f62c899-4692-480e-87a0-3f2421ffadea req-3c97b23d-1d48-47c1-b28b-9da89666badb service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updating instance_info_cache with network_info: [{"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG os_brick.utils [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5f62c899-4692-480e-87a0-3f2421ffadea req-3c97b23d-1d48-47c1-b28b-9da89666badb service nova] Releasing lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86be1b7-c715-4d67-87c0-cd7174af470a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae30187d-3f26-430c-ab38-301b8c7032f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ccb78e7-6dbe-430b-b5a4-ac00190476f6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[410a2b7c-b730-4127-965a-9ad0983746c1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:34:11 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:34:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cab5451-9bb8-42a9-a8ad-76b22ba51b73]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG os_brick.utils [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:34:11 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updating existing volume attachment record: f637b9ef-03d7-41c5-8bf3-0440817fa191 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:34:12 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:34:12 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 02:34:12 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] There are 0 instances to clean {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 02:34:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:34:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:26 user nova-compute[74242]: DEBUG nova.compute.manager [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:34:26 user nova-compute[74242]: INFO nova.compute.manager [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] instance snapshotting
Oct 20 02:34:26 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Beginning live snapshot process
Oct 20 02:34:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json -f qcow2 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json -f qcow2" returned: 0 in 0.171s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json -f qcow2 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu0spxw83/ab388ecf9b194d2a95500cf4e9e8abc8.delta 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu0spxw83/ab388ecf9b194d2a95500cf4e9e8abc8.delta 1073741824" returned: 0 in 0.060s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:27 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 20 02:34:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:34:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74242) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 20 02:34:28 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 20 02:34:28 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:34:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu0spxw83/ab388ecf9b194d2a95500cf4e9e8abc8.delta /opt/stack/data/nova/instances/snapshots/tmpu0spxw83/ab388ecf9b194d2a95500cf4e9e8abc8 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuqrxNAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:34:29 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:34:29 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:34:29 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[56221696-f7a3-4211-a9fe-6217fb4e0303]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:34:29 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7884d262-bf72-4841-abef-01a42fde6a93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701] added
Oct 20 02:34:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[500a7f92-f52b-461c-affc-5a851da41d3e]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu0spxw83/ab388ecf9b194d2a95500cf4e9e8abc8.delta /opt/stack/data/nova/instances/snapshots/tmpu0spxw83/ab388ecf9b194d2a95500cf4e9e8abc8" returned: 0 in 0.878s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:29 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Snapshot extracted, beginning image upload
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b4097f8-0ad8-46e5-82d7-4955a59fc188]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuqrxNAW {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QuqrxNAW" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6ce514-ccf0-4a11-94b3-53a2f3a24426]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QuqrxNAW'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b8860f-217d-4a5f-82f1-bae1f788a7a3]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[816f1b86-e289-4d55-a7d7-691201717316]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:34:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:34:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0717c28c-93c2-4f25-88dc-11a136bc5a37]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701, portal: 172.16.0.220,3260]
Oct 20 02:34:29 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701, portal: 172.16.0.220,3260] successful.
Oct 20 02:34:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5c7b81b-7e2f-4302-94cc-77620e8e2b24]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab33d97d-d26c-4d4a-8370-bda946504569]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:34:29 user nova-compute[74242]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:34:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:34:29 user nova-compute[74242]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:34:29 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquiring lock "9b289be0-d915-4934-a9b0-5a2814e05530" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "9b289be0-d915-4934-a9b0-5a2814e05530" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6360f89-9284-4059-a43c-45620b6dc7d9]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuqrxNAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:34:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:34:30 user nova-compute[74242]: INFO nova.compute.claims [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Claim successful on node user
Oct 20 02:34:30 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.338s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:34:30 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:34:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG nova.policy [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3f2be8ad306d42fbab30806b78264173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '305f8aa83bfc4c79b2ef4cdffef3cd49', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:34:30 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Creating image(s)
Oct 20 02:34:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquiring lock "/opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "/opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "/opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.202s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23962633362376134', 'path': '/dev/sdc'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:34:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962633362376134', 'path': '/dev/sdc'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG nova.objects.instance [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'flavor' on Instance uuid d4ccd900-744b-49d8-a892-897591be031c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:34:31 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:34:31 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:34:31 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:34:31 user nova-compute[74242]:   <serial>e08be8b8-bdca-492d-a95d-4a497b160701</serial>
Oct 20 02:34:31 user nova-compute[74242]: </disk>
Oct 20 02:34:31 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.189s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk 1073741824" returned: 0 in 0.062s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Successfully created port: 5ea0570e-9f58-4338-8cff-4d66ef9a1319 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No VIF found with MAC fa:16:3e:a6:22:b6, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Cannot resize image /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Ensure instance console log exists: /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5ccadda0-ffc0-4a65-861c-b4940be662e1 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "d4ccd900-744b-49d8-a892-897591be031c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.252s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Successfully updated port: 5ea0570e-9f58-4338-8cff-4d66ef9a1319 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquiring lock "refresh_cache-9b289be0-d915-4934-a9b0-5a2814e05530" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquired lock "refresh_cache-9b289be0-d915-4934-a9b0-5a2814e05530" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG nova.compute.manager [req-08b0832e-e080-4cef-aa76-2ffd4704fd4b req-525bb078-aefa-476c-bd59-2f2bb495afc9 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Received event network-changed-5ea0570e-9f58-4338-8cff-4d66ef9a1319 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG nova.compute.manager [req-08b0832e-e080-4cef-aa76-2ffd4704fd4b req-525bb078-aefa-476c-bd59-2f2bb495afc9 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Refreshing instance network info cache due to event network-changed-5ea0570e-9f58-4338-8cff-4d66ef9a1319. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:34:31 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-08b0832e-e080-4cef-aa76-2ffd4704fd4b req-525bb078-aefa-476c-bd59-2f2bb495afc9 service nova] Acquiring lock "refresh_cache-9b289be0-d915-4934-a9b0-5a2814e05530" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.network.neutron [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Updating instance_info_cache with network_info: [{"id": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "address": "fa:16:3e:cc:17:a1", "network": {"id": "f1b5de20-519a-4a4e-ab76-dc51e3fdf70e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1148846947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "305f8aa83bfc4c79b2ef4cdffef3cd49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea0570e-9f", "ovs_interfaceid": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Releasing lock "refresh_cache-9b289be0-d915-4934-a9b0-5a2814e05530" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Instance network_info: |[{"id": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "address": "fa:16:3e:cc:17:a1", "network": {"id": "f1b5de20-519a-4a4e-ab76-dc51e3fdf70e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1148846947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "305f8aa83bfc4c79b2ef4cdffef3cd49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea0570e-9f", "ovs_interfaceid": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-08b0832e-e080-4cef-aa76-2ffd4704fd4b req-525bb078-aefa-476c-bd59-2f2bb495afc9 service nova] Acquired lock "refresh_cache-9b289be0-d915-4934-a9b0-5a2814e05530" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-08b0832e-e080-4cef-aa76-2ffd4704fd4b req-525bb078-aefa-476c-bd59-2f2bb495afc9 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Refreshing network info cache for port 5ea0570e-9f58-4338-8cff-4d66ef9a1319 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Start _get_guest_xml network_info=[{"id": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "address": "fa:16:3e:cc:17:a1", "network": {"id": "f1b5de20-519a-4a4e-ab76-dc51e3fdf70e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1148846947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "305f8aa83bfc4c79b2ef4cdffef3cd49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea0570e-9f", "ovs_interfaceid": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:34:32 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:34:32 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-716082823',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-716082823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7160828',id=46,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEUCMRx+2sDvQJbrsaNDhBjF3YE+3Q9pMqWUbg8PywdIPMV8nkK7rXbUwoV4mwvvvV0e53WVLpeh5dAE2tMLRYHzcKFnI6y422YurqiSj8LzxuQu+bUjCq6tp4o/fJevg==',key_name='tempest-keypair-1722618805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='305f8aa83bfc4c79b2ef4cdffef3cd49',ramdisk_id='',reservation_id='r-lt8kha0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-774144487',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:34:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f2be8ad306d42fbab30806b78264173',uuid=9b289be0-d915-4934-a9b0-5a2814e05530,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "address": "fa:16:3e:cc:17:a1", "network": {"id": "f1b5de20-519a-4a4e-ab76-dc51e3fdf70e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1148846947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "305f8aa83bfc4c79b2ef4cdffef3cd49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea0570e-9f", "ovs_interfaceid": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Converting VIF {"id": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "address": "fa:16:3e:cc:17:a1", "network": {"id": "f1b5de20-519a-4a4e-ab76-dc51e3fdf70e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1148846947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "305f8aa83bfc4c79b2ef4cdffef3cd49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea0570e-9f", "ovs_interfaceid": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:17:a1,bridge_name='br-int',has_traffic_filtering=True,id=5ea0570e-9f58-4338-8cff-4d66ef9a1319,network=Network(f1b5de20-519a-4a4e-ab76-dc51e3fdf70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea0570e-9f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.objects.instance [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lazy-loading 'pci_devices' on Instance uuid 9b289be0-d915-4934-a9b0-5a2814e05530 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:34:32 user nova-compute[74242]:   <uuid>9b289be0-d915-4934-a9b0-5a2814e05530</uuid>
Oct 20 02:34:32 user nova-compute[74242]:   <name>instance-0000002e</name>
Oct 20 02:34:32 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:34:32 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:34:32 user nova-compute[74242]:   <metadata>
Oct 20 02:34:32 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:34:32 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:34:32 user nova-compute[74242]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-716082823</nova:name>
Oct 20 02:34:32 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:34:32</nova:creationTime>
Oct 20 02:34:32 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:34:32 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:34:32 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:34:32 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:34:32 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:34:32 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:34:32 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:34:32 user nova-compute[74242]:       <nova:owner>
Oct 20 02:34:32 user nova-compute[74242]:         <nova:user uuid="3f2be8ad306d42fbab30806b78264173">tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member</nova:user>
Oct 20 02:34:32 user nova-compute[74242]:         <nova:project uuid="305f8aa83bfc4c79b2ef4cdffef3cd49">tempest-TestServerVolumeAttachScenarioOldVersion-774144487</nova:project>
Oct 20 02:34:32 user nova-compute[74242]:       </nova:owner>
Oct 20 02:34:32 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:34:32 user nova-compute[74242]:       <nova:ports>
Oct 20 02:34:32 user nova-compute[74242]:         <nova:port uuid="5ea0570e-9f58-4338-8cff-4d66ef9a1319">
Oct 20 02:34:32 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 02:34:32 user nova-compute[74242]:         </nova:port>
Oct 20 02:34:32 user nova-compute[74242]:       </nova:ports>
Oct 20 02:34:32 user nova-compute[74242]:     </nova:instance>
Oct 20 02:34:32 user nova-compute[74242]:   </metadata>
Oct 20 02:34:32 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:34:32 user nova-compute[74242]:     <system>
Oct 20 02:34:32 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:34:32 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:34:32 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:34:32 user nova-compute[74242]:       <entry name="serial">9b289be0-d915-4934-a9b0-5a2814e05530</entry>
Oct 20 02:34:32 user nova-compute[74242]:       <entry name="uuid">9b289be0-d915-4934-a9b0-5a2814e05530</entry>
Oct 20 02:34:32 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:34:32 user nova-compute[74242]:     </system>
Oct 20 02:34:32 user nova-compute[74242]:   </sysinfo>
Oct 20 02:34:32 user nova-compute[74242]:   <os>
Oct 20 02:34:32 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:34:32 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:34:32 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:34:32 user nova-compute[74242]:   </os>
Oct 20 02:34:32 user nova-compute[74242]:   <features>
Oct 20 02:34:32 user nova-compute[74242]:     <acpi/>
Oct 20 02:34:32 user nova-compute[74242]:     <apic/>
Oct 20 02:34:32 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:34:32 user nova-compute[74242]:   </features>
Oct 20 02:34:32 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:34:32 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:34:32 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:34:32 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:34:32 user nova-compute[74242]:   </clock>
Oct 20 02:34:32 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:34:32 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:34:32 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:34:32 user nova-compute[74242]:   </cpu>
Oct 20 02:34:32 user nova-compute[74242]:   <devices>
Oct 20 02:34:32 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:34:32 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:34:32 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk"/>
Oct 20 02:34:32 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:34:32 user nova-compute[74242]:     </disk>
Oct 20 02:34:32 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:34:32 user nova-compute[74242]:       <mac address="fa:16:3e:cc:17:a1"/>
Oct 20 02:34:32 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:34:32 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:34:32 user nova-compute[74242]:       <target dev="tap5ea0570e-9f"/>
Oct 20 02:34:32 user nova-compute[74242]:     </interface>
Oct 20 02:34:32 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:34:32 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/console.log" append="off"/>
Oct 20 02:34:32 user nova-compute[74242]:     </serial>
Oct 20 02:34:32 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:34:32 user nova-compute[74242]:     <video>
Oct 20 02:34:32 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:34:32 user nova-compute[74242]:     </video>
Oct 20 02:34:32 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:34:32 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:34:32 user nova-compute[74242]:     </rng>
Oct 20 02:34:32 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:34:32 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:34:32 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:34:32 user nova-compute[74242]:     </memballoon>
Oct 20 02:34:32 user nova-compute[74242]:   </devices>
Oct 20 02:34:32 user nova-compute[74242]: </domain>
Oct 20 02:34:32 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-716082823',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-716082823',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7160828',id=46,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEUCMRx+2sDvQJbrsaNDhBjF3YE+3Q9pMqWUbg8PywdIPMV8nkK7rXbUwoV4mwvvvV0e53WVLpeh5dAE2tMLRYHzcKFnI6y422YurqiSj8LzxuQu+bUjCq6tp4o/fJevg==',key_name='tempest-keypair-1722618805',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='305f8aa83bfc4c79b2ef4cdffef3cd49',ramdisk_id='',reservation_id='r-lt8kha0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-774144487',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:34:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f2be8ad306d42fbab30806b78264173',uuid=9b289be0-d915-4934-a9b0-5a2814e05530,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "address": "fa:16:3e:cc:17:a1", "network": {"id": "f1b5de20-519a-4a4e-ab76-dc51e3fdf70e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1148846947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "305f8aa83bfc4c79b2ef4cdffef3cd49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea0570e-9f", "ovs_interfaceid": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Converting VIF {"id": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "address": "fa:16:3e:cc:17:a1", "network": {"id": "f1b5de20-519a-4a4e-ab76-dc51e3fdf70e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1148846947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "305f8aa83bfc4c79b2ef4cdffef3cd49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea0570e-9f", "ovs_interfaceid": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:17:a1,bridge_name='br-int',has_traffic_filtering=True,id=5ea0570e-9f58-4338-8cff-4d66ef9a1319,network=Network(f1b5de20-519a-4a4e-ab76-dc51e3fdf70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea0570e-9f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG os_vif [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:17:a1,bridge_name='br-int',has_traffic_filtering=True,id=5ea0570e-9f58-4338-8cff-4d66ef9a1319,network=Network(f1b5de20-519a-4a4e-ab76-dc51e3fdf70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea0570e-9f') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1424574d-ad73-59b3-a840-a9a424d04823', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5ea0570e-9f, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5ea0570e-9f, col_values=(('qos', UUID('7f133f13-41ff-4544-8899-a3b7f8bb06e9')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5ea0570e-9f, col_values=(('external_ids', {'iface-id': '5ea0570e-9f58-4338-8cff-4d66ef9a1319', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:17:a1', 'vm-uuid': '9b289be0-d915-4934-a9b0-5a2814e05530'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:32 user nova-compute[74242]: INFO os_vif [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:17:a1,bridge_name='br-int',has_traffic_filtering=True,id=5ea0570e-9f58-4338-8cff-4d66ef9a1319,network=Network(f1b5de20-519a-4a4e-ab76-dc51e3fdf70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea0570e-9f')
Oct 20 02:34:32 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Snapshot image upload complete
Oct 20 02:34:32 user nova-compute[74242]: INFO nova.compute.manager [None req-d3cc881d-8417-48a2-b687-60f83f7413c5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Took 5.58 seconds to snapshot the instance on the hypervisor.
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] No VIF found with MAC fa:16:3e:cc:17:a1, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:34:32 user nova-compute[74242]: INFO nova.compute.manager [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Rescuing
Oct 20 02:34:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquired lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.network.neutron [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-08b0832e-e080-4cef-aa76-2ffd4704fd4b req-525bb078-aefa-476c-bd59-2f2bb495afc9 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Updated VIF entry in instance network info cache for port 5ea0570e-9f58-4338-8cff-4d66ef9a1319. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.network.neutron [req-08b0832e-e080-4cef-aa76-2ffd4704fd4b req-525bb078-aefa-476c-bd59-2f2bb495afc9 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Updating instance_info_cache with network_info: [{"id": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "address": "fa:16:3e:cc:17:a1", "network": {"id": "f1b5de20-519a-4a4e-ab76-dc51e3fdf70e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1148846947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "305f8aa83bfc4c79b2ef4cdffef3cd49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea0570e-9f", "ovs_interfaceid": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-08b0832e-e080-4cef-aa76-2ffd4704fd4b req-525bb078-aefa-476c-bd59-2f2bb495afc9 service nova] Releasing lock "refresh_cache-9b289be0-d915-4934-a9b0-5a2814e05530" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG nova.network.neutron [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updating instance_info_cache with network_info: [{"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:34:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Releasing lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:34:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-930eee33-a9f5-44de-aef1-3e6d70e085c8 req-4c830bb4-b9ca-4c9c-a68c-5686efe1e522 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Received event network-vif-plugged-5ea0570e-9f58-4338-8cff-4d66ef9a1319 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-930eee33-a9f5-44de-aef1-3e6d70e085c8 req-4c830bb4-b9ca-4c9c-a68c-5686efe1e522 service nova] Acquiring lock "9b289be0-d915-4934-a9b0-5a2814e05530-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-930eee33-a9f5-44de-aef1-3e6d70e085c8 req-4c830bb4-b9ca-4c9c-a68c-5686efe1e522 service nova] Lock "9b289be0-d915-4934-a9b0-5a2814e05530-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-930eee33-a9f5-44de-aef1-3e6d70e085c8 req-4c830bb4-b9ca-4c9c-a68c-5686efe1e522 service nova] Lock "9b289be0-d915-4934-a9b0-5a2814e05530-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-930eee33-a9f5-44de-aef1-3e6d70e085c8 req-4c830bb4-b9ca-4c9c-a68c-5686efe1e522 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] No waiting events found dispatching network-vif-plugged-5ea0570e-9f58-4338-8cff-4d66ef9a1319 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:34:34 user nova-compute[74242]: WARNING nova.compute.manager [req-930eee33-a9f5-44de-aef1-3e6d70e085c8 req-4c830bb4-b9ca-4c9c-a68c-5686efe1e522 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Received unexpected event network-vif-plugged-5ea0570e-9f58-4338-8cff-4d66ef9a1319 for instance with vm_state building and task_state spawning.
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-9bc1300b-c884-4f41-9b58-d0d9a553bae9 req-9eefeb8d-fd5e-45a8-82a3-8beb168aa356 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-vif-unplugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9bc1300b-c884-4f41-9b58-d0d9a553bae9 req-9eefeb8d-fd5e-45a8-82a3-8beb168aa356 service nova] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9bc1300b-c884-4f41-9b58-d0d9a553bae9 req-9eefeb8d-fd5e-45a8-82a3-8beb168aa356 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9bc1300b-c884-4f41-9b58-d0d9a553bae9 req-9eefeb8d-fd5e-45a8-82a3-8beb168aa356 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.compute.manager [req-9bc1300b-c884-4f41-9b58-d0d9a553bae9 req-9eefeb8d-fd5e-45a8-82a3-8beb168aa356 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] No waiting events found dispatching network-vif-unplugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:34:34 user nova-compute[74242]: WARNING nova.compute.manager [req-9bc1300b-c884-4f41-9b58-d0d9a553bae9 req-9eefeb8d-fd5e-45a8-82a3-8beb168aa356 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received unexpected event network-vif-unplugged-7e3b7bad-876a-447a-85da-4e5f501f7870 for instance with vm_state active and task_state rescuing.
Oct 20 02:34:34 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: d4ccd900-744b-49d8-a892-897591be031c] Instance destroyed successfully.
Oct 20 02:34:34 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Attempting rescue
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74242) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Instance directory exists: not creating {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 20 02:34:34 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Creating image(s)
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "/opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "/opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "/opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.objects.instance [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'trusted_certs' on Instance uuid d4ccd900-744b-49d8-a892-897591be031c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.210s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.rescue {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "0b0cb76b-1382-4296-8d33-a353a5f55b51" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.rescue" returned: 0 in 0.060s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.objects.instance [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'migration_context' on Instance uuid d4ccd900-744b-49d8-a892-897591be031c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.compute.manager [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.objects.base [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Object Instance<d4ccd900-744b-49d8-a892-897591be031c> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Start _get_guest_xml network_info=[{"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "vif_mac": "fa:16:3e:a6:22:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.objects.instance [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'resources' on Instance uuid d4ccd900-744b-49d8-a892-897591be031c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.objects.base [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Object Instance<d4ccd900-744b-49d8-a892-897591be031c> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.objects.instance [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'numa_topology' on Instance uuid d4ccd900-744b-49d8-a892-897591be031c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.objects.base [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Object Instance<d4ccd900-744b-49d8-a892-897591be031c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:34:34 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:34:34 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.objects.instance [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'vcpu_model' on Instance uuid d4ccd900-744b-49d8-a892-897591be031c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.objects.base [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Object Instance<d4ccd900-744b-49d8-a892-897591be031c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-152224677',display_name='tempest-ServerRescueNegativeTestJSON-server-152224677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-152224677',id=45,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9Mtlxvqlj1pE6vYvPdL1UdNCYZPX0lT8au15a5bX8mGhRxSjUvSnM8xuUjtjZDzFHL1AQVy9cO5NTiAIkYEV8cAWKKCHrUdE3NaT8luGUIzQMGdmnKDEEYl1FHNnaQHw==',key_name='tempest-keypair-62369157',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:32:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80fa40dfb2c84a84b3399b643fcde4c5',ramdisk_id='',reservation_id='r-ka1vb9ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-630282540',owner_user_name='tempest-ServerRescueNegativeTestJSON-630282540-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:32:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7a7db373740428d89dcda898a04410c',uuid=d4ccd900-744b-49d8-a892-897591be031c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "vif_mac": "fa:16:3e:a6:22:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converting VIF {"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "vif_mac": "fa:16:3e:a6:22:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:22:b6,bridge_name='br-int',has_traffic_filtering=True,id=7e3b7bad-876a-447a-85da-4e5f501f7870,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3b7bad-87') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.objects.instance [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'pci_devices' on Instance uuid d4ccd900-744b-49d8-a892-897591be031c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.objects.base [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Object Instance<d4ccd900-744b-49d8-a892-897591be031c> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:34:34 user nova-compute[74242]:   <uuid>d4ccd900-744b-49d8-a892-897591be031c</uuid>
Oct 20 02:34:34 user nova-compute[74242]:   <name>instance-0000002d</name>
Oct 20 02:34:34 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:34:34 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:34:34 user nova-compute[74242]:   <metadata>
Oct 20 02:34:34 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:34:34 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:34:34 user nova-compute[74242]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-152224677</nova:name>
Oct 20 02:34:34 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:34:34</nova:creationTime>
Oct 20 02:34:34 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:34:34 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:34:34 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:34:34 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:34:34 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:34:34 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:34:34 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:34:34 user nova-compute[74242]:       <nova:owner>
Oct 20 02:34:34 user nova-compute[74242]:         <nova:user uuid="c7a7db373740428d89dcda898a04410c">tempest-ServerRescueNegativeTestJSON-630282540-project-member</nova:user>
Oct 20 02:34:34 user nova-compute[74242]:         <nova:project uuid="80fa40dfb2c84a84b3399b643fcde4c5">tempest-ServerRescueNegativeTestJSON-630282540</nova:project>
Oct 20 02:34:34 user nova-compute[74242]:       </nova:owner>
Oct 20 02:34:34 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:34:34 user nova-compute[74242]:       <nova:ports>
Oct 20 02:34:34 user nova-compute[74242]:         <nova:port uuid="7e3b7bad-876a-447a-85da-4e5f501f7870">
Oct 20 02:34:34 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 20 02:34:34 user nova-compute[74242]:         </nova:port>
Oct 20 02:34:34 user nova-compute[74242]:       </nova:ports>
Oct 20 02:34:34 user nova-compute[74242]:     </nova:instance>
Oct 20 02:34:34 user nova-compute[74242]:   </metadata>
Oct 20 02:34:34 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:34:34 user nova-compute[74242]:     <system>
Oct 20 02:34:34 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:34:34 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:34:34 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:34:34 user nova-compute[74242]:       <entry name="serial">d4ccd900-744b-49d8-a892-897591be031c</entry>
Oct 20 02:34:34 user nova-compute[74242]:       <entry name="uuid">d4ccd900-744b-49d8-a892-897591be031c</entry>
Oct 20 02:34:34 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:34:34 user nova-compute[74242]:     </system>
Oct 20 02:34:34 user nova-compute[74242]:   </sysinfo>
Oct 20 02:34:34 user nova-compute[74242]:   <os>
Oct 20 02:34:34 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:34:34 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:34:34 user nova-compute[74242]:   </os>
Oct 20 02:34:34 user nova-compute[74242]:   <features>
Oct 20 02:34:34 user nova-compute[74242]:     <acpi/>
Oct 20 02:34:34 user nova-compute[74242]:     <apic/>
Oct 20 02:34:34 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:34:34 user nova-compute[74242]:   </features>
Oct 20 02:34:34 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:34:34 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:34:34 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:34:34 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:34:34 user nova-compute[74242]:   </clock>
Oct 20 02:34:34 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:34:34 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:34:34 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:34:34 user nova-compute[74242]:   </cpu>
Oct 20 02:34:34 user nova-compute[74242]:   <devices>
Oct 20 02:34:34 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:34:34 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:34:34 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.rescue"/>
Oct 20 02:34:34 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:34:34 user nova-compute[74242]:     </disk>
Oct 20 02:34:34 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:34:34 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:34:34 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk"/>
Oct 20 02:34:34 user nova-compute[74242]:       <target dev="vdb" bus="virtio"/>
Oct 20 02:34:34 user nova-compute[74242]:     </disk>
Oct 20 02:34:34 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:34:34 user nova-compute[74242]:       <mac address="fa:16:3e:a6:22:b6"/>
Oct 20 02:34:34 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:34:34 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:34:34 user nova-compute[74242]:       <target dev="tap7e3b7bad-87"/>
Oct 20 02:34:34 user nova-compute[74242]:     </interface>
Oct 20 02:34:34 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:34:34 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/console.log" append="off"/>
Oct 20 02:34:34 user nova-compute[74242]:     </serial>
Oct 20 02:34:34 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:34:34 user nova-compute[74242]:     <video>
Oct 20 02:34:34 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:34:34 user nova-compute[74242]:     </video>
Oct 20 02:34:34 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:34:34 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:34:34 user nova-compute[74242]:     </rng>
Oct 20 02:34:34 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:34:34 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:34:34 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:34:34 user nova-compute[74242]:     </memballoon>
Oct 20 02:34:34 user nova-compute[74242]:   </devices>
Oct 20 02:34:34 user nova-compute[74242]: </domain>
Oct 20 02:34:34 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:34:34 user nova-compute[74242]: INFO nova.compute.claims [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Claim successful on node user
Oct 20 02:34:34 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: d4ccd900-744b-49d8-a892-897591be031c] Instance destroyed successfully.
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] No VIF found with MAC fa:16:3e:a6:22:b6, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:34:34 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:34:35 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:34:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.349s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:34:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:34:35 user nova-compute[74242]: DEBUG nova.network.neutron [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:34:35 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:34:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:34:35 user nova-compute[74242]: DEBUG nova.policy [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ebacf16af7234540acea291a74a1b68d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2982c9c65e548478739144ba83306ea', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:34:35 user nova-compute[74242]: DEBUG nova.compute.manager [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:34:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:34:35 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Creating image(s)
Oct 20 02:34:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "/opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "/opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "7f972163cc34eb9c3fddfaf56a9c7638888491c9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:35 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "7f972163cc34eb9c3fddfaf56a9c7638888491c9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9.part --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.network.neutron [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Successfully created port: bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.compute.manager [req-f20334bc-af2a-4e29-8e8d-7b1a504f7001 req-2696ba92-6496-4d32-974d-dab1f90b979d service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Received event network-vif-plugged-5ea0570e-9f58-4338-8cff-4d66ef9a1319 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f20334bc-af2a-4e29-8e8d-7b1a504f7001 req-2696ba92-6496-4d32-974d-dab1f90b979d service nova] Acquiring lock "9b289be0-d915-4934-a9b0-5a2814e05530-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f20334bc-af2a-4e29-8e8d-7b1a504f7001 req-2696ba92-6496-4d32-974d-dab1f90b979d service nova] Lock "9b289be0-d915-4934-a9b0-5a2814e05530-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f20334bc-af2a-4e29-8e8d-7b1a504f7001 req-2696ba92-6496-4d32-974d-dab1f90b979d service nova] Lock "9b289be0-d915-4934-a9b0-5a2814e05530-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.compute.manager [req-f20334bc-af2a-4e29-8e8d-7b1a504f7001 req-2696ba92-6496-4d32-974d-dab1f90b979d service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] No waiting events found dispatching network-vif-plugged-5ea0570e-9f58-4338-8cff-4d66ef9a1319 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:34:36 user nova-compute[74242]: WARNING nova.compute.manager [req-f20334bc-af2a-4e29-8e8d-7b1a504f7001 req-2696ba92-6496-4d32-974d-dab1f90b979d service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Received unexpected event network-vif-plugged-5ea0570e-9f58-4338-8cff-4d66ef9a1319 for instance with vm_state building and task_state spawning.
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.compute.manager [req-a35ecf74-3c9a-4c1a-837a-b96f81977d49 req-0381b64a-f865-4223-8322-f08d8eb854e0 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a35ecf74-3c9a-4c1a-837a-b96f81977d49 req-0381b64a-f865-4223-8322-f08d8eb854e0 service nova] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a35ecf74-3c9a-4c1a-837a-b96f81977d49 req-0381b64a-f865-4223-8322-f08d8eb854e0 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a35ecf74-3c9a-4c1a-837a-b96f81977d49 req-0381b64a-f865-4223-8322-f08d8eb854e0 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.compute.manager [req-a35ecf74-3c9a-4c1a-837a-b96f81977d49 req-0381b64a-f865-4223-8322-f08d8eb854e0 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] No waiting events found dispatching network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:34:36 user nova-compute[74242]: WARNING nova.compute.manager [req-a35ecf74-3c9a-4c1a-837a-b96f81977d49 req-0381b64a-f865-4223-8322-f08d8eb854e0 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received unexpected event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 for instance with vm_state active and task_state rescuing.
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:34:36 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Instance spawned successfully.
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9.part --force-share --output=json" returned: 0 in 0.227s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.virt.images [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] 51f0f534-7c96-4aa7-8ffa-a707e5d6a924 was qcow2, converting to raw {{(pid=74242) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.privsep.utils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74242) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 20 02:34:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9.part /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9.converted {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:36 user nova-compute[74242]: INFO nova.compute.manager [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Took 6.26 seconds to spawn the instance on the hypervisor.
Oct 20 02:34:36 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:34:37 user nova-compute[74242]: INFO nova.compute.manager [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Took 7.12 seconds to build instance.
Oct 20 02:34:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e4d26a0a-3354-4c02-ba21-3c393513b353 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "9b289be0-d915-4934-a9b0-5a2814e05530" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.240s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9.part /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9.converted" returned: 0 in 0.684s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9.converted --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Successfully updated port: bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-a50f2676-230d-49aa-a1aa-c0baa8a4f339 req-d729a438-d1c0-408a-9ca3-028bafd596ac service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Received event network-changed-bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG nova.compute.manager [req-a50f2676-230d-49aa-a1aa-c0baa8a4f339 req-d729a438-d1c0-408a-9ca3-028bafd596ac service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Refreshing instance network info cache due to event network-changed-bbb75831-ae21-43b4-899f-de0f8da0a162. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a50f2676-230d-49aa-a1aa-c0baa8a4f339 req-d729a438-d1c0-408a-9ca3-028bafd596ac service nova] Acquiring lock "refresh_cache-0b0cb76b-1382-4296-8d33-a353a5f55b51" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a50f2676-230d-49aa-a1aa-c0baa8a4f339 req-d729a438-d1c0-408a-9ca3-028bafd596ac service nova] Acquired lock "refresh_cache-0b0cb76b-1382-4296-8d33-a353a5f55b51" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG nova.network.neutron [req-a50f2676-230d-49aa-a1aa-c0baa8a4f339 req-d729a438-d1c0-408a-9ca3-028bafd596ac service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Refreshing network info cache for port bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "refresh_cache-0b0cb76b-1382-4296-8d33-a353a5f55b51" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG nova.network.neutron [req-a50f2676-230d-49aa-a1aa-c0baa8a4f339 req-d729a438-d1c0-408a-9ca3-028bafd596ac service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9.converted --force-share --output=json" returned: 0 in 0.226s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "7f972163cc34eb9c3fddfaf56a9c7638888491c9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.441s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG nova.network.neutron [req-a50f2676-230d-49aa-a1aa-c0baa8a4f339 req-d729a438-d1c0-408a-9ca3-028bafd596ac service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a50f2676-230d-49aa-a1aa-c0baa8a4f339 req-d729a438-d1c0-408a-9ca3-028bafd596ac service nova] Releasing lock "refresh_cache-0b0cb76b-1382-4296-8d33-a353a5f55b51" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquired lock "refresh_cache-0b0cb76b-1382-4296-8d33-a353a5f55b51" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG nova.network.neutron [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9 --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "7f972163cc34eb9c3fddfaf56a9c7638888491c9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "7f972163cc34eb9c3fddfaf56a9c7638888491c9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:37 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9 --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9,backing_fmt=raw /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9,backing_fmt=raw /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk 1073741824" returned: 0 in 0.062s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "7f972163cc34eb9c3fddfaf56a9c7638888491c9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.network.neutron [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Updating instance_info_cache with network_info: [{"id": "bbb75831-ae21-43b4-899f-de0f8da0a162", "address": "fa:16:3e:ad:65:01", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbb75831-ae", "ovs_interfaceid": "bbb75831-ae21-43b4-899f-de0f8da0a162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-dd3908e5-9b1a-4e2f-8dab-fca2f88008a9 req-d86bed68-8e35-4eac-93d7-26590f1adb07 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dd3908e5-9b1a-4e2f-8dab-fca2f88008a9 req-d86bed68-8e35-4eac-93d7-26590f1adb07 service nova] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dd3908e5-9b1a-4e2f-8dab-fca2f88008a9 req-d86bed68-8e35-4eac-93d7-26590f1adb07 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dd3908e5-9b1a-4e2f-8dab-fca2f88008a9 req-d86bed68-8e35-4eac-93d7-26590f1adb07 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-dd3908e5-9b1a-4e2f-8dab-fca2f88008a9 req-d86bed68-8e35-4eac-93d7-26590f1adb07 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] No waiting events found dispatching network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:34:38 user nova-compute[74242]: WARNING nova.compute.manager [req-dd3908e5-9b1a-4e2f-8dab-fca2f88008a9 req-d86bed68-8e35-4eac-93d7-26590f1adb07 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received unexpected event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 for instance with vm_state active and task_state rescuing.
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-dd3908e5-9b1a-4e2f-8dab-fca2f88008a9 req-d86bed68-8e35-4eac-93d7-26590f1adb07 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dd3908e5-9b1a-4e2f-8dab-fca2f88008a9 req-d86bed68-8e35-4eac-93d7-26590f1adb07 service nova] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dd3908e5-9b1a-4e2f-8dab-fca2f88008a9 req-d86bed68-8e35-4eac-93d7-26590f1adb07 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dd3908e5-9b1a-4e2f-8dab-fca2f88008a9 req-d86bed68-8e35-4eac-93d7-26590f1adb07 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-dd3908e5-9b1a-4e2f-8dab-fca2f88008a9 req-d86bed68-8e35-4eac-93d7-26590f1adb07 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] No waiting events found dispatching network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:34:38 user nova-compute[74242]: WARNING nova.compute.manager [req-dd3908e5-9b1a-4e2f-8dab-fca2f88008a9 req-d86bed68-8e35-4eac-93d7-26590f1adb07 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received unexpected event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 for instance with vm_state active and task_state rescuing.
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Releasing lock "refresh_cache-0b0cb76b-1382-4296-8d33-a353a5f55b51" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Instance network_info: |[{"id": "bbb75831-ae21-43b4-899f-de0f8da0a162", "address": "fa:16:3e:ad:65:01", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbb75831-ae", "ovs_interfaceid": "bbb75831-ae21-43b4-899f-de0f8da0a162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9 --force-share --output=json" returned: 0 in 0.189s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Ensure instance console log exists: /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Start _get_guest_xml network_info=[{"id": "bbb75831-ae21-43b4-899f-de0f8da0a162", "address": "fa:16:3e:ad:65:01", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbb75831-ae", "ovs_interfaceid": "bbb75831-ae21-43b4-899f-de0f8da0a162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='9deefdc31e73d951a4a8857a64b0bdb5',container_format='bare',created_at=2023-10-20T02:34:26Z,direct_url=<?>,disk_format='qcow2',id=51f0f534-7c96-4aa7-8ffa-a707e5d6a924,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2018824680',owner='d2982c9c65e548478739144ba83306ea',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T02:34:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '51f0f534-7c96-4aa7-8ffa-a707e5d6a924'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:34:38 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:34:38 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='9deefdc31e73d951a4a8857a64b0bdb5',container_format='bare',created_at=2023-10-20T02:34:26Z,direct_url=<?>,disk_format='qcow2',id=51f0f534-7c96-4aa7-8ffa-a707e5d6a924,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-2018824680',owner='d2982c9c65e548478739144ba83306ea',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-20T02:34:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1341322404',display_name='tempest-TestStampPattern-server-1341322404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1341322404',id=47,image_ref='51f0f534-7c96-4aa7-8ffa-a707e5d6a924',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYGIAL3BPbNRP/f8TTaaS+fRSqiqmwNAp8S9LYWbQcGSs8gpOlmyAN8s6c1MVpMgmvgEs1210r1izyM79vKpMSRksL+RI4OA1L+LaWwUc2PcO3Orr5NlrQNvhE5JyjJpg==',key_name='tempest-TestStampPattern-200219955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2982c9c65e548478739144ba83306ea',ramdisk_id='',reservation_id='r-5ez7ti4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='67575ff4-ecf0-493a-b07d-0e808f209b23',image_min_disk='1',image_min_ram='0',image_owner_id='d2982c9c65e548478739144ba83306ea',image_owner_project_name='tempest-TestStampPattern-1416614973',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1416614973-project-member',image_user_id='ebacf16af7234540acea291a74a1b68d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1416614973',owner_user_name='tempest-TestStampPattern-1416614973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:34:35Z,user_data=None,user_id='ebacf16af7234540acea291a74a1b68d',uuid=0b0cb76b-1382-4296-8d33-a353a5f55b51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbb75831-ae21-43b4-899f-de0f8da0a162", "address": "fa:16:3e:ad:65:01", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbb75831-ae", "ovs_interfaceid": "bbb75831-ae21-43b4-899f-de0f8da0a162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Converting VIF {"id": "bbb75831-ae21-43b4-899f-de0f8da0a162", "address": "fa:16:3e:ad:65:01", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbb75831-ae", "ovs_interfaceid": "bbb75831-ae21-43b4-899f-de0f8da0a162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:65:01,bridge_name='br-int',has_traffic_filtering=True,id=bbb75831-ae21-43b4-899f-de0f8da0a162,network=Network(4bfd9e0b-6a72-45b3-9618-8c8b91bb3604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbb75831-ae') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.objects.instance [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b0cb76b-1382-4296-8d33-a353a5f55b51 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:34:38 user nova-compute[74242]:   <uuid>0b0cb76b-1382-4296-8d33-a353a5f55b51</uuid>
Oct 20 02:34:38 user nova-compute[74242]:   <name>instance-0000002f</name>
Oct 20 02:34:38 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:34:38 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:34:38 user nova-compute[74242]:   <metadata>
Oct 20 02:34:38 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:34:38 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:34:38 user nova-compute[74242]:       <nova:name>tempest-TestStampPattern-server-1341322404</nova:name>
Oct 20 02:34:38 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:34:38</nova:creationTime>
Oct 20 02:34:38 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:34:38 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:34:38 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:34:38 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:34:38 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:34:38 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:34:38 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:34:38 user nova-compute[74242]:       <nova:owner>
Oct 20 02:34:38 user nova-compute[74242]:         <nova:user uuid="ebacf16af7234540acea291a74a1b68d">tempest-TestStampPattern-1416614973-project-member</nova:user>
Oct 20 02:34:38 user nova-compute[74242]:         <nova:project uuid="d2982c9c65e548478739144ba83306ea">tempest-TestStampPattern-1416614973</nova:project>
Oct 20 02:34:38 user nova-compute[74242]:       </nova:owner>
Oct 20 02:34:38 user nova-compute[74242]:       <nova:root type="image" uuid="51f0f534-7c96-4aa7-8ffa-a707e5d6a924"/>
Oct 20 02:34:38 user nova-compute[74242]:       <nova:ports>
Oct 20 02:34:38 user nova-compute[74242]:         <nova:port uuid="bbb75831-ae21-43b4-899f-de0f8da0a162">
Oct 20 02:34:38 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 02:34:38 user nova-compute[74242]:         </nova:port>
Oct 20 02:34:38 user nova-compute[74242]:       </nova:ports>
Oct 20 02:34:38 user nova-compute[74242]:     </nova:instance>
Oct 20 02:34:38 user nova-compute[74242]:   </metadata>
Oct 20 02:34:38 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:34:38 user nova-compute[74242]:     <system>
Oct 20 02:34:38 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:34:38 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:34:38 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:34:38 user nova-compute[74242]:       <entry name="serial">0b0cb76b-1382-4296-8d33-a353a5f55b51</entry>
Oct 20 02:34:38 user nova-compute[74242]:       <entry name="uuid">0b0cb76b-1382-4296-8d33-a353a5f55b51</entry>
Oct 20 02:34:38 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:34:38 user nova-compute[74242]:     </system>
Oct 20 02:34:38 user nova-compute[74242]:   </sysinfo>
Oct 20 02:34:38 user nova-compute[74242]:   <os>
Oct 20 02:34:38 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:34:38 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:34:38 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:34:38 user nova-compute[74242]:   </os>
Oct 20 02:34:38 user nova-compute[74242]:   <features>
Oct 20 02:34:38 user nova-compute[74242]:     <acpi/>
Oct 20 02:34:38 user nova-compute[74242]:     <apic/>
Oct 20 02:34:38 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:34:38 user nova-compute[74242]:   </features>
Oct 20 02:34:38 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:34:38 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:34:38 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:34:38 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:34:38 user nova-compute[74242]:   </clock>
Oct 20 02:34:38 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:34:38 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:34:38 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:34:38 user nova-compute[74242]:   </cpu>
Oct 20 02:34:38 user nova-compute[74242]:   <devices>
Oct 20 02:34:38 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:34:38 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:34:38 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk"/>
Oct 20 02:34:38 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:34:38 user nova-compute[74242]:     </disk>
Oct 20 02:34:38 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:34:38 user nova-compute[74242]:       <mac address="fa:16:3e:ad:65:01"/>
Oct 20 02:34:38 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:34:38 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:34:38 user nova-compute[74242]:       <target dev="tapbbb75831-ae"/>
Oct 20 02:34:38 user nova-compute[74242]:     </interface>
Oct 20 02:34:38 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:34:38 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/console.log" append="off"/>
Oct 20 02:34:38 user nova-compute[74242]:     </serial>
Oct 20 02:34:38 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:34:38 user nova-compute[74242]:     <video>
Oct 20 02:34:38 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:34:38 user nova-compute[74242]:     </video>
Oct 20 02:34:38 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:34:38 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:34:38 user nova-compute[74242]:     </rng>
Oct 20 02:34:38 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:34:38 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:34:38 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:34:38 user nova-compute[74242]:     </memballoon>
Oct 20 02:34:38 user nova-compute[74242]:   </devices>
Oct 20 02:34:38 user nova-compute[74242]: </domain>
Oct 20 02:34:38 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1341322404',display_name='tempest-TestStampPattern-server-1341322404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1341322404',id=47,image_ref='51f0f534-7c96-4aa7-8ffa-a707e5d6a924',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYGIAL3BPbNRP/f8TTaaS+fRSqiqmwNAp8S9LYWbQcGSs8gpOlmyAN8s6c1MVpMgmvgEs1210r1izyM79vKpMSRksL+RI4OA1L+LaWwUc2PcO3Orr5NlrQNvhE5JyjJpg==',key_name='tempest-TestStampPattern-200219955',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d2982c9c65e548478739144ba83306ea',ramdisk_id='',reservation_id='r-5ez7ti4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='67575ff4-ecf0-493a-b07d-0e808f209b23',image_min_disk='1',image_min_ram='0',image_owner_id='d2982c9c65e548478739144ba83306ea',image_owner_project_name='tempest-TestStampPattern-1416614973',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1416614973-project-member',image_user_id='ebacf16af7234540acea291a74a1b68d',network_allocated='True',owner_project_name='tempest-TestStampPattern-1416614973',owner_user_name='tempest-TestStampPattern-1416614973-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:34:35Z,user_data=None,user_id='ebacf16af7234540acea291a74a1b68d',uuid=0b0cb76b-1382-4296-8d33-a353a5f55b51,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bbb75831-ae21-43b4-899f-de0f8da0a162", "address": "fa:16:3e:ad:65:01", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbb75831-ae", "ovs_interfaceid": "bbb75831-ae21-43b4-899f-de0f8da0a162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Converting VIF {"id": "bbb75831-ae21-43b4-899f-de0f8da0a162", "address": "fa:16:3e:ad:65:01", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbb75831-ae", "ovs_interfaceid": "bbb75831-ae21-43b4-899f-de0f8da0a162", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:65:01,bridge_name='br-int',has_traffic_filtering=True,id=bbb75831-ae21-43b4-899f-de0f8da0a162,network=Network(4bfd9e0b-6a72-45b3-9618-8c8b91bb3604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbb75831-ae') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG os_vif [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:65:01,bridge_name='br-int',has_traffic_filtering=True,id=bbb75831-ae21-43b4-899f-de0f8da0a162,network=Network(4bfd9e0b-6a72-45b3-9618-8c8b91bb3604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbb75831-ae') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0aa25038-abd4-5ea5-b3c1-fdcebacca4b2', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbbb75831-ae, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbbb75831-ae, col_values=(('qos', UUID('3cc07c63-c8f8-4323-9250-41e998081576')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbbb75831-ae, col_values=(('external_ids', {'iface-id': 'bbb75831-ae21-43b4-899f-de0f8da0a162', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:65:01', 'vm-uuid': '0b0cb76b-1382-4296-8d33-a353a5f55b51'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:38 user nova-compute[74242]: INFO os_vif [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:65:01,bridge_name='br-int',has_traffic_filtering=True,id=bbb75831-ae21-43b4-899f-de0f8da0a162,network=Network(4bfd9e0b-6a72-45b3-9618-8c8b91bb3604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbb75831-ae')
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] No VIF found with MAC fa:16:3e:ad:65:01, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:34:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-2dd8648b-34ed-4c11-abf6-448fb52f1136 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:34:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-9b4aff27-5100-4361-bd92-588d3f5df589 req-cc500529-2e1d-479f-bbe0-da9e9f6ecfdc service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Received event network-vif-plugged-bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:34:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9b4aff27-5100-4361-bd92-588d3f5df589 req-cc500529-2e1d-479f-bbe0-da9e9f6ecfdc service nova] Acquiring lock "0b0cb76b-1382-4296-8d33-a353a5f55b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9b4aff27-5100-4361-bd92-588d3f5df589 req-cc500529-2e1d-479f-bbe0-da9e9f6ecfdc service nova] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9b4aff27-5100-4361-bd92-588d3f5df589 req-cc500529-2e1d-479f-bbe0-da9e9f6ecfdc service nova] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-9b4aff27-5100-4361-bd92-588d3f5df589 req-cc500529-2e1d-479f-bbe0-da9e9f6ecfdc service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] No waiting events found dispatching network-vif-plugged-bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:34:40 user nova-compute[74242]: WARNING nova.compute.manager [req-9b4aff27-5100-4361-bd92-588d3f5df589 req-cc500529-2e1d-479f-bbe0-da9e9f6ecfdc service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Received unexpected event network-vif-plugged-bbb75831-ae21-43b4-899f-de0f8da0a162 for instance with vm_state building and task_state spawning.
Oct 20 02:34:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-4453030e-9fb3-4c49-852a-bbe8e105c381 req-4e5ef22b-f722-4df6-970c-6b79e205268f service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Received event network-vif-plugged-bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:34:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4453030e-9fb3-4c49-852a-bbe8e105c381 req-4e5ef22b-f722-4df6-970c-6b79e205268f service nova] Acquiring lock "0b0cb76b-1382-4296-8d33-a353a5f55b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:34:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4453030e-9fb3-4c49-852a-bbe8e105c381 req-4e5ef22b-f722-4df6-970c-6b79e205268f service nova] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:34:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4453030e-9fb3-4c49-852a-bbe8e105c381 req-4e5ef22b-f722-4df6-970c-6b79e205268f service nova] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-4453030e-9fb3-4c49-852a-bbe8e105c381 req-4e5ef22b-f722-4df6-970c-6b79e205268f service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] No waiting events found dispatching network-vif-plugged-bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:34:42 user nova-compute[74242]: WARNING nova.compute.manager [req-4453030e-9fb3-4c49-852a-bbe8e105c381 req-4e5ef22b-f722-4df6-970c-6b79e205268f service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Received unexpected event network-vif-plugged-bbb75831-ae21-43b4-899f-de0f8da0a162 for instance with vm_state building and task_state spawning.
Oct 20 02:34:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:34:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:34:42 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Instance spawned successfully.
Oct 20 02:34:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:34:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:34:42 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:34:42 user nova-compute[74242]: INFO nova.compute.manager [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Took 7.68 seconds to spawn the instance on the hypervisor.
Oct 20 02:34:42 user nova-compute[74242]: DEBUG nova.compute.manager [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:34:43 user nova-compute[74242]: INFO nova.compute.manager [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Took 8.43 seconds to build instance.
Oct 20 02:34:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-3d2909cb-d40d-4fdd-b172-8b050c696984 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.582s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:34:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:46 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:34:48 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:34:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:51 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:34:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:34:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:34:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:34:51 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:34:51 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Updating instance_info_cache with network_info: [{"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:34:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:34:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:34:52 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:34:52 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:34:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:57 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:34:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:34:59 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:35:00 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:35:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:35:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:35:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:35:00 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:35:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:00 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG nova.objects.instance [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'flavor' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquired lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG nova.network.neutron [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG nova.objects.instance [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'info_cache' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG nova.objects.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Object Instance<3d6b9529-656c-45f3-b2de-3d1462751bf1> lazy-loaded attributes: flavor,info_cache {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.network.neutron [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Updating instance_info_cache with network_info: [{"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Releasing lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:35:02 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Instance destroyed successfully.
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.objects.instance [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'resources' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.objects.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Object Instance<3d6b9529-656c-45f3-b2de-3d1462751bf1> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:30:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-907928236',display_name='tempest-AttachVolumeTestJSON-server-907928236',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-907928236',id=43,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+0C/EZq6BwMh+3wZbZgOw2m/JxCkcxWd9X6nujGwGDyr2EQvBu4YlJy6mRVBvBdc8CsjVHXkTNJTlT3+WS0iTSYuJCsZzoNxpr4cYb9sE8zXfgoepdKDpiPTJ/nXqUhw==',key_name='tempest-keypair-788125581',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:30:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='86bf4c560c2a4a078d0f43aae70d4fd3',ramdisk_id='',reservation_id='r-30ipsrv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-47724960',owner_user_name='tempest-AttachVolumeTestJSON-47724960-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:33:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61536bdce5184c989843cc225dd547a0',uuid=3d6b9529-656c-45f3-b2de-3d1462751bf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converting VIF {"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_vif [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap957c2a1b-2b, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99f8efab-3a4e-455b-b765-2347cc7f0ca3) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:02 user nova-compute[74242]: INFO os_vif [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b')
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lURfmLcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:35:02 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15730be-2d92-42f8-abfb-997f0baff30e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:35:02 user nova-compute[74242]: No targets found.
Oct 20 02:35:02 user nova-compute[74242]: iSNS:
Oct 20 02:35:02 user nova-compute[74242]: No targets found.
Oct 20 02:35:02 user nova-compute[74242]: STATIC:
Oct 20 02:35:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701
Oct 20 02:35:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:35:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:35:02 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0
Oct 20 02:35:02 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:35:02 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:35:02 user nova-compute[74242]: FIRMWARE:
Oct 20 02:35:02 user nova-compute[74242]: No targets found.
Oct 20 02:35:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:35:02 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:35:02 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee7715e-02cc-4125-9378-45d3722029cb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b318cd-916b-4376-af22-2ce874198239]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:35:02 user nova-compute[74242]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:35:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:35:02 user nova-compute[74242]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:35:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b82e4940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0'): ({'sdb'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Removing single pathed devices sdb {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6296e5ce-d0dd-47c3-9fe1-93e787ba24d8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e777621-785c-43f5-96d3-60d4fc49b11f]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Flushing IO for device /dev/sdb {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac91415-9d4e-4cba-bb10-cce367125119]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.046s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5485ec0-d7ab-44af-82fe-81f1ff90eb79]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac290c40-532a-456f-a0f2-fa8469d551c3]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4387c1e7-e3aa-4822-a092-9d924ad06431]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260]
Oct 20 02:35:02 user nova-compute[74242]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260] successful.
Oct 20 02:35:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1174c9b0-2f5c-41fe-9429-4e356ffff8a7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] <== disconnect_volume: return (342ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Start _get_guest_xml network_info=[{"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [{'boot_index': None, 'delete_on_termination': False, 'device_type': 'disk', 'mount_device': '/dev/vdb', 'disk_bus': 'virtio', 'attachment_id': 'd64f46e0-782a-44e3-ad77-92fe21f2bbae', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lURfmLcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '3d6b9529-656c-45f3-b2de-3d1462751bf1', 'attached_at': '', 'detached_at': '', 'volume_id': '4daf3c70-6911-47b4-bc0d-9840e04ae0c0', 'serial': '4daf3c70-6911-47b4-bc0d-9840e04ae0c0'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.objects.instance [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'numa_topology' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.objects.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Object Instance<3d6b9529-656c-45f3-b2de-3d1462751bf1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:35:02 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:35:02 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.objects.instance [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.objects.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Object Instance<3d6b9529-656c-45f3-b2de-3d1462751bf1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lURfmLcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:35:02 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:35:02 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:35:02 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c06c7a-73ca-4f69-9c17-bf94aa4817bd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:35:02 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6253f22f-afb4-432e-a173-5af8dc5604aa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0] added
Oct 20 02:35:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[085e0b31-18ce-4baf-aaf5-d9a655772219]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d8e7b30-08b8-4f24-8c5e-26f9980a31bd]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lURfmLcI {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lURfmLcI" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[998efba8-159b-49a6-8526-8eda1d721925]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lURfmLcI'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e197515-ff4d-43b0-a7ec-0ef83022dd4c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f4efcc-7a5d-4144-ba88-e84dc6708a63]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:35:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:35:02 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:35:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[06975a13-044f-4d2f-9b30-b9f0a5cf0aec]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260]
Oct 20 02:35:03 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260] successful.
Oct 20 02:35:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5605e6a8-0ea4-4071-84a7-5772780f3e9c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a62ae3-16a6-4a1c-a150-f7d191e2b677]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:35:03 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:35:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:35:03 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:35:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5922ecdf-c52e-4bdc-a68f-205337bd2cb2]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.188s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:03 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:35:03 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:35:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8088MB free_disk=24.706161499023438GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 67575ff4-ecf0-493a-b07d-0e808f209b23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d4ccd900-744b-49d8-a892-897591be031c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 9b289be0-d915-4934-a9b0-5a2814e05530 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0b0cb76b-1382-4296-8d33-a353a5f55b51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:35:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lURfmLcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.364s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] <== connect_volume: return (1365ms) {'type': 'block', 'scsi_wwn': '23035346633633833', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035346633633833', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:30:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-907928236',display_name='tempest-AttachVolumeTestJSON-server-907928236',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-907928236',id=43,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+0C/EZq6BwMh+3wZbZgOw2m/JxCkcxWd9X6nujGwGDyr2EQvBu4YlJy6mRVBvBdc8CsjVHXkTNJTlT3+WS0iTSYuJCsZzoNxpr4cYb9sE8zXfgoepdKDpiPTJ/nXqUhw==',key_name='tempest-keypair-788125581',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:30:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='86bf4c560c2a4a078d0f43aae70d4fd3',ramdisk_id='',reservation_id='r-30ipsrv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-47724960',owner_user_name='tempest-AttachVolumeTestJSON-47724960-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:33:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61536bdce5184c989843cc225dd547a0',uuid=3d6b9529-656c-45f3-b2de-3d1462751bf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converting VIF {"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.objects.instance [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.objects.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Object Instance<3d6b9529-656c-45f3-b2de-3d1462751bf1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:35:04 user nova-compute[74242]:   <uuid>3d6b9529-656c-45f3-b2de-3d1462751bf1</uuid>
Oct 20 02:35:04 user nova-compute[74242]:   <name>instance-0000002b</name>
Oct 20 02:35:04 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:35:04 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:35:04 user nova-compute[74242]:   <metadata>
Oct 20 02:35:04 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:35:04 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:35:04 user nova-compute[74242]:       <nova:name>tempest-AttachVolumeTestJSON-server-907928236</nova:name>
Oct 20 02:35:04 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:35:02</nova:creationTime>
Oct 20 02:35:04 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:35:04 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:35:04 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:35:04 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:35:04 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:35:04 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:35:04 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:35:04 user nova-compute[74242]:       <nova:owner>
Oct 20 02:35:04 user nova-compute[74242]:         <nova:user uuid="61536bdce5184c989843cc225dd547a0">tempest-AttachVolumeTestJSON-47724960-project-member</nova:user>
Oct 20 02:35:04 user nova-compute[74242]:         <nova:project uuid="86bf4c560c2a4a078d0f43aae70d4fd3">tempest-AttachVolumeTestJSON-47724960</nova:project>
Oct 20 02:35:04 user nova-compute[74242]:       </nova:owner>
Oct 20 02:35:04 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:35:04 user nova-compute[74242]:       <nova:ports>
Oct 20 02:35:04 user nova-compute[74242]:         <nova:port uuid="957c2a1b-2b78-47c9-8e79-fc8ce92755ec">
Oct 20 02:35:04 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 02:35:04 user nova-compute[74242]:         </nova:port>
Oct 20 02:35:04 user nova-compute[74242]:       </nova:ports>
Oct 20 02:35:04 user nova-compute[74242]:     </nova:instance>
Oct 20 02:35:04 user nova-compute[74242]:   </metadata>
Oct 20 02:35:04 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:35:04 user nova-compute[74242]:     <system>
Oct 20 02:35:04 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:35:04 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:35:04 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:35:04 user nova-compute[74242]:       <entry name="serial">3d6b9529-656c-45f3-b2de-3d1462751bf1</entry>
Oct 20 02:35:04 user nova-compute[74242]:       <entry name="uuid">3d6b9529-656c-45f3-b2de-3d1462751bf1</entry>
Oct 20 02:35:04 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:35:04 user nova-compute[74242]:     </system>
Oct 20 02:35:04 user nova-compute[74242]:   </sysinfo>
Oct 20 02:35:04 user nova-compute[74242]:   <os>
Oct 20 02:35:04 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:35:04 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:35:04 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:35:04 user nova-compute[74242]:   </os>
Oct 20 02:35:04 user nova-compute[74242]:   <features>
Oct 20 02:35:04 user nova-compute[74242]:     <acpi/>
Oct 20 02:35:04 user nova-compute[74242]:     <apic/>
Oct 20 02:35:04 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:35:04 user nova-compute[74242]:   </features>
Oct 20 02:35:04 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:35:04 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:35:04 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:35:04 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:35:04 user nova-compute[74242]:   </clock>
Oct 20 02:35:04 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:35:04 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:35:04 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:35:04 user nova-compute[74242]:   </cpu>
Oct 20 02:35:04 user nova-compute[74242]:   <devices>
Oct 20 02:35:04 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:35:04 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:35:04 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk"/>
Oct 20 02:35:04 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:35:04 user nova-compute[74242]:     </disk>
Oct 20 02:35:04 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:35:04 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:35:04 user nova-compute[74242]:       <source dev="/dev/sdb"/>
Oct 20 02:35:04 user nova-compute[74242]:       <target dev="vdb" bus="virtio"/>
Oct 20 02:35:04 user nova-compute[74242]:       <serial>4daf3c70-6911-47b4-bc0d-9840e04ae0c0</serial>
Oct 20 02:35:04 user nova-compute[74242]:     </disk>
Oct 20 02:35:04 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:35:04 user nova-compute[74242]:       <mac address="fa:16:3e:87:ef:3f"/>
Oct 20 02:35:04 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:35:04 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:35:04 user nova-compute[74242]:       <target dev="tap957c2a1b-2b"/>
Oct 20 02:35:04 user nova-compute[74242]:     </interface>
Oct 20 02:35:04 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:35:04 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/console.log" append="off"/>
Oct 20 02:35:04 user nova-compute[74242]:     </serial>
Oct 20 02:35:04 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:35:04 user nova-compute[74242]:     <video>
Oct 20 02:35:04 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:35:04 user nova-compute[74242]:     </video>
Oct 20 02:35:04 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:35:04 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:35:04 user nova-compute[74242]:     </rng>
Oct 20 02:35:04 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:35:04 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:35:04 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:35:04 user nova-compute[74242]:     </memballoon>
Oct 20 02:35:04 user nova-compute[74242]:   </devices>
Oct 20 02:35:04 user nova-compute[74242]: </domain>
Oct 20 02:35:04 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.428s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.objects.instance [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.objects.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Object Instance<3d6b9529-656c-45f3-b2de-3d1462751bf1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.178s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Cannot resize image /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.objects.instance [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'migration_context' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.objects.base [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Object Instance<3d6b9529-656c-45f3-b2de-3d1462751bf1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:30:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-907928236',display_name='tempest-AttachVolumeTestJSON-server-907928236',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-907928236',id=43,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+0C/EZq6BwMh+3wZbZgOw2m/JxCkcxWd9X6nujGwGDyr2EQvBu4YlJy6mRVBvBdc8CsjVHXkTNJTlT3+WS0iTSYuJCsZzoNxpr4cYb9sE8zXfgoepdKDpiPTJ/nXqUhw==',key_name='tempest-keypair-788125581',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:30:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='86bf4c560c2a4a078d0f43aae70d4fd3',ramdisk_id='',reservation_id='r-30ipsrv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-47724960',owner_user_name='tempest-AttachVolumeTestJSON-47724960-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:33:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61536bdce5184c989843cc225dd547a0',uuid=3d6b9529-656c-45f3-b2de-3d1462751bf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converting VIF {"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG os_vif [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddbdf184-6f1c-5709-b95b-4ab3b01f1226', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap957c2a1b-2b, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap957c2a1b-2b, col_values=(('qos', UUID('21011dc5-29b7-4643-9332-2c70e8f98f75')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap957c2a1b-2b, col_values=(('external_ids', {'iface-id': '957c2a1b-2b78-47c9-8e79-fc8ce92755ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:ef:3f', 'vm-uuid': '3d6b9529-656c-45f3-b2de-3d1462751bf1'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:35:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:04 user nova-compute[74242]: INFO os_vif [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b')
Oct 20 02:35:05 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:35:05 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:35:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-1aa2793e-c6b8-47c5-9432-23eee5cd848b req-02f4e813-b05a-4b21-b826-76fd6f41d245 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:35:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1aa2793e-c6b8-47c5-9432-23eee5cd848b req-02f4e813-b05a-4b21-b826-76fd6f41d245 service nova] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:35:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1aa2793e-c6b8-47c5-9432-23eee5cd848b req-02f4e813-b05a-4b21-b826-76fd6f41d245 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:35:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1aa2793e-c6b8-47c5-9432-23eee5cd848b req-02f4e813-b05a-4b21-b826-76fd6f41d245 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:35:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-1aa2793e-c6b8-47c5-9432-23eee5cd848b req-02f4e813-b05a-4b21-b826-76fd6f41d245 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] No waiting events found dispatching network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:35:06 user nova-compute[74242]: WARNING nova.compute.manager [req-1aa2793e-c6b8-47c5-9432-23eee5cd848b req-02f4e813-b05a-4b21-b826-76fd6f41d245 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received unexpected event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec for instance with vm_state stopped and task_state powering-on.
Oct 20 02:35:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:07 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:35:08 user nova-compute[74242]: DEBUG nova.compute.manager [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:35:08 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Instance rebooted successfully.
Oct 20 02:35:08 user nova-compute[74242]: DEBUG nova.compute.manager [None req-07b841d0-69ca-4cca-af5f-4286f6f10619 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:35:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-299d2138-5dcc-4940-a4e3-775196771402 req-b9c3e0ae-5d9d-476f-82ba-213dfc8b66e9 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:35:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-299d2138-5dcc-4940-a4e3-775196771402 req-b9c3e0ae-5d9d-476f-82ba-213dfc8b66e9 service nova] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:35:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-299d2138-5dcc-4940-a4e3-775196771402 req-b9c3e0ae-5d9d-476f-82ba-213dfc8b66e9 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:35:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-299d2138-5dcc-4940-a4e3-775196771402 req-b9c3e0ae-5d9d-476f-82ba-213dfc8b66e9 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:35:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-299d2138-5dcc-4940-a4e3-775196771402 req-b9c3e0ae-5d9d-476f-82ba-213dfc8b66e9 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] No waiting events found dispatching network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:35:08 user nova-compute[74242]: WARNING nova.compute.manager [req-299d2138-5dcc-4940-a4e3-775196771402 req-b9c3e0ae-5d9d-476f-82ba-213dfc8b66e9 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received unexpected event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec for instance with vm_state active and task_state None.
Oct 20 02:35:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:35:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:35:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:47 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:35:49 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:35:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:35:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:35:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:35:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:35:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:35:51 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:35:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:35:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-67575ff4-ecf0-493a-b07d-0e808f209b23" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:35:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-67575ff4-ecf0-493a-b07d-0e808f209b23" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:35:51 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:35:51 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Updating instance_info_cache with network_info: [{"id": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "address": "fa:16:3e:75:e6:79", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea2f019-ba", "ovs_interfaceid": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:35:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-67575ff4-ecf0-493a-b07d-0e808f209b23" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:35:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:35:52 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:35:52 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:35:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:35:58 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:35:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:36:00 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:36:01 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:36:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:36:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:36:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:36:01 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:36:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:02 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:36:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:36:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:04 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:36:04 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:36:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8100MB free_disk=24.70260238647461GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:36:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:36:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:36:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:36:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:36:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:36:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:36:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 67575ff4-ecf0-493a-b07d-0e808f209b23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:36:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d4ccd900-744b-49d8-a892-897591be031c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:36:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 9b289be0-d915-4934-a9b0-5a2814e05530 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:36:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0b0cb76b-1382-4296-8d33-a353a5f55b51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:36:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:36:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:36:05 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:36:05 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:36:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:36:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.457s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:36:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:36:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:36:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:36:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:36:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:36:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:36:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:36:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:36:21 user nova-compute[74242]: DEBUG nova.compute.manager [req-e31d2357-1941-4ad4-aa54-a4dc240916e2 req-cf631482-6484-4f98-a07c-a10c0b24bef3 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Received event network-changed-5ea0570e-9f58-4338-8cff-4d66ef9a1319 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:36:21 user nova-compute[74242]: DEBUG nova.compute.manager [req-e31d2357-1941-4ad4-aa54-a4dc240916e2 req-cf631482-6484-4f98-a07c-a10c0b24bef3 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Refreshing instance network info cache due to event network-changed-5ea0570e-9f58-4338-8cff-4d66ef9a1319. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:36:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e31d2357-1941-4ad4-aa54-a4dc240916e2 req-cf631482-6484-4f98-a07c-a10c0b24bef3 service nova] Acquiring lock "refresh_cache-9b289be0-d915-4934-a9b0-5a2814e05530" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:36:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e31d2357-1941-4ad4-aa54-a4dc240916e2 req-cf631482-6484-4f98-a07c-a10c0b24bef3 service nova] Acquired lock "refresh_cache-9b289be0-d915-4934-a9b0-5a2814e05530" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:36:21 user nova-compute[74242]: DEBUG nova.network.neutron [req-e31d2357-1941-4ad4-aa54-a4dc240916e2 req-cf631482-6484-4f98-a07c-a10c0b24bef3 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Refreshing network info cache for port 5ea0570e-9f58-4338-8cff-4d66ef9a1319 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:36:21 user nova-compute[74242]: DEBUG nova.network.neutron [req-e31d2357-1941-4ad4-aa54-a4dc240916e2 req-cf631482-6484-4f98-a07c-a10c0b24bef3 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Updated VIF entry in instance network info cache for port 5ea0570e-9f58-4338-8cff-4d66ef9a1319. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:36:21 user nova-compute[74242]: DEBUG nova.network.neutron [req-e31d2357-1941-4ad4-aa54-a4dc240916e2 req-cf631482-6484-4f98-a07c-a10c0b24bef3 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Updating instance_info_cache with network_info: [{"id": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "address": "fa:16:3e:cc:17:a1", "network": {"id": "f1b5de20-519a-4a4e-ab76-dc51e3fdf70e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1148846947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "305f8aa83bfc4c79b2ef4cdffef3cd49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea0570e-9f", "ovs_interfaceid": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:36:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e31d2357-1941-4ad4-aa54-a4dc240916e2 req-cf631482-6484-4f98-a07c-a10c0b24bef3 service nova] Releasing lock "refresh_cache-9b289be0-d915-4934-a9b0-5a2814e05530" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:36:23 user nova-compute[74242]: INFO nova.compute.manager [None req-9fe09de1-cb21-4c44-b1a2-d2b372b13a26 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Unrescuing
Oct 20 02:36:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9fe09de1-cb21-4c44-b1a2-d2b372b13a26 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:36:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9fe09de1-cb21-4c44-b1a2-d2b372b13a26 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquired lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:36:23 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9fe09de1-cb21-4c44-b1a2-d2b372b13a26 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:36:23 user nova-compute[74242]: DEBUG nova.network.neutron [None req-9fe09de1-cb21-4c44-b1a2-d2b372b13a26 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updating instance_info_cache with network_info: [{"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:36:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9fe09de1-cb21-4c44-b1a2-d2b372b13a26 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Releasing lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:36:23 user nova-compute[74242]: DEBUG nova.objects.instance [None req-9fe09de1-cb21-4c44-b1a2-d2b372b13a26 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'flavor' on Instance uuid d4ccd900-744b-49d8-a892-897591be031c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:36:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-e5a42490-004d-4a5e-9918-4bb089fc9d96 req-0168d400-114d-4bcd-8d30-b6fcdb2c2366 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-vif-unplugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:36:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e5a42490-004d-4a5e-9918-4bb089fc9d96 req-0168d400-114d-4bcd-8d30-b6fcdb2c2366 service nova] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:36:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e5a42490-004d-4a5e-9918-4bb089fc9d96 req-0168d400-114d-4bcd-8d30-b6fcdb2c2366 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:36:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e5a42490-004d-4a5e-9918-4bb089fc9d96 req-0168d400-114d-4bcd-8d30-b6fcdb2c2366 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:36:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-e5a42490-004d-4a5e-9918-4bb089fc9d96 req-0168d400-114d-4bcd-8d30-b6fcdb2c2366 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] No waiting events found dispatching network-vif-unplugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:36:24 user nova-compute[74242]: WARNING nova.compute.manager [req-e5a42490-004d-4a5e-9918-4bb089fc9d96 req-0168d400-114d-4bcd-8d30-b6fcdb2c2366 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received unexpected event network-vif-unplugged-7e3b7bad-876a-447a-85da-4e5f501f7870 for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:36:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:24 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: d4ccd900-744b-49d8-a892-897591be031c] Instance destroyed successfully.
Oct 20 02:36:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:25 user nova-compute[74242]: DEBUG nova.compute.manager [req-1cb9de9c-b526-41cb-9b4b-9a4c63c41988 req-784bff00-52e8-4b55-bc25-afb6a03dbf9e service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Received event network-changed-bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:36:25 user nova-compute[74242]: DEBUG nova.compute.manager [req-1cb9de9c-b526-41cb-9b4b-9a4c63c41988 req-784bff00-52e8-4b55-bc25-afb6a03dbf9e service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Refreshing instance network info cache due to event network-changed-bbb75831-ae21-43b4-899f-de0f8da0a162. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:36:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1cb9de9c-b526-41cb-9b4b-9a4c63c41988 req-784bff00-52e8-4b55-bc25-afb6a03dbf9e service nova] Acquiring lock "refresh_cache-0b0cb76b-1382-4296-8d33-a353a5f55b51" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:36:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1cb9de9c-b526-41cb-9b4b-9a4c63c41988 req-784bff00-52e8-4b55-bc25-afb6a03dbf9e service nova] Acquired lock "refresh_cache-0b0cb76b-1382-4296-8d33-a353a5f55b51" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:36:25 user nova-compute[74242]: DEBUG nova.network.neutron [req-1cb9de9c-b526-41cb-9b4b-9a4c63c41988 req-784bff00-52e8-4b55-bc25-afb6a03dbf9e service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Refreshing network info cache for port bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] No waiting events found dispatching network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:36:26 user nova-compute[74242]: WARNING nova.compute.manager [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received unexpected event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:36:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] No waiting events found dispatching network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:36:26 user nova-compute[74242]: WARNING nova.compute.manager [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received unexpected event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:36:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG nova.compute.manager [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] No waiting events found dispatching network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:36:26 user nova-compute[74242]: WARNING nova.compute.manager [req-3e89589c-4ca3-42c4-a4c7-572aec268ccd req-b7e9243f-85a7-4037-bb07-733ed36180d0 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received unexpected event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 for instance with vm_state rescued and task_state unrescuing.
Oct 20 02:36:26 user nova-compute[74242]: DEBUG nova.network.neutron [req-1cb9de9c-b526-41cb-9b4b-9a4c63c41988 req-784bff00-52e8-4b55-bc25-afb6a03dbf9e service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Updated VIF entry in instance network info cache for port bbb75831-ae21-43b4-899f-de0f8da0a162. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG nova.network.neutron [req-1cb9de9c-b526-41cb-9b4b-9a4c63c41988 req-784bff00-52e8-4b55-bc25-afb6a03dbf9e service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Updating instance_info_cache with network_info: [{"id": "bbb75831-ae21-43b4-899f-de0f8da0a162", "address": "fa:16:3e:ad:65:01", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbb75831-ae", "ovs_interfaceid": "bbb75831-ae21-43b4-899f-de0f8da0a162", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1cb9de9c-b526-41cb-9b4b-9a4c63c41988 req-784bff00-52e8-4b55-bc25-afb6a03dbf9e service nova] Releasing lock "refresh_cache-0b0cb76b-1382-4296-8d33-a353a5f55b51" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquiring lock "9b289be0-d915-4934-a9b0-5a2814e05530" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "9b289be0-d915-4934-a9b0-5a2814e05530" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG nova.objects.instance [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lazy-loading 'flavor' on Instance uuid 9b289be0-d915-4934-a9b0-5a2814e05530 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "9b289be0-d915-4934-a9b0-5a2814e05530" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "0b0cb76b-1382-4296-8d33-a353a5f55b51" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG nova.objects.instance [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lazy-loading 'flavor' on Instance uuid 0b0cb76b-1382-4296-8d33-a353a5f55b51 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquiring lock "9b289be0-d915-4934-a9b0-5a2814e05530" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "9b289be0-d915-4934-a9b0-5a2814e05530" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:36:26 user nova-compute[74242]: INFO nova.compute.manager [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Attaching volume 59959661-d2f2-4530-a27f-f4aa17c8a178 to /dev/vdb
Oct 20 02:36:26 user nova-compute[74242]: DEBUG os_brick.utils [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "0b0cb76b-1382-4296-8d33-a353a5f55b51" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:36:26 user nova-compute[74242]: INFO nova.compute.manager [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Attaching volume 3ec5ee98-31cd-483b-8c18-924ea4b14fbc to /dev/vdb
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a034e0f9-7894-485c-9b86-1e6a52e7e94c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4976d95-5295-4e98-b031-b886e2954217]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f343d0-a500-479a-b3a7-fc99740e65c3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b975db9c-725f-4936-93c0-3ccbfbd1066f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG os_brick.utils [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf2adb27-091d-4092-8fc2-4bc8ea8a2c8f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:36:26 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e241c0-5351-4555-a0da-c04df058f559]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG os_brick.utils [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Updating existing volume attachment record: 1982994c-dfd8-496e-a9b7-82fa828f9320 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[400399a2-483d-433d-8d6e-621efcfa8433]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a1f810-c8e2-40e8-89c2-2188f8050d71]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[56f7381a-e620-4d62-81af-e75386ae0cd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:36:26 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:36:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae58026-629c-4ee4-a48f-88e58625380f]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG os_brick.utils [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:36:26 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Updating existing volume attachment record: 4ab37e05-9589-4836-93d8-520da994317c {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:36:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-9fe09de1-cb21-4c44-b1a2-d2b372b13a26 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:36:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKaxnDiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:36:43 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:36:43 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:36:43 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:36:43 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:36:43 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:36:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[85333fae-bd89-430a-b55f-ee00aaebf0e0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:36:43 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[856c2151-3f8d-4fb2-b707-1b5773b3b339]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc] added
Oct 20 02:36:43 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[25fa084f-8516-4fbb-9593-75a7bfb1068b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b00187a7-efcf-4646-b6b2-1be8abfe34a7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKaxnDiG {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NKaxnDiG" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f1ff5e-bc87-4375-88a6-e7f5ae0cdffd]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:43 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NKaxnDiG'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e385860c-84f3-4bf8-abce-0f8aab3645ba]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7399cca-c7ec-44ec-ac55-a24d3d2ce370]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:36:44 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:36:44 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:36:44 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:36:44 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7f9307-bbc5-4eef-a63e-033331cef0df]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc, portal: 172.16.0.220,3260]
Oct 20 02:36:44 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc, portal: 172.16.0.220,3260] successful.
Oct 20 02:36:44 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[862d5820-f85a-4aef-aebf-7b3b0471e702]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[92aabf3b-3c8c-4487-974c-ccc0fd24810c]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:36:44 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:36:44 user nova-compute[74242]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc (non-flash)
Oct 20 02:36:44 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:36:44 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:36:44 user nova-compute[74242]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc (non-flash)
Oct 20 02:36:44 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] HCTL ('35', '-', '-', 0) found on session 55 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d8f329-26b4-4579-a8fd-742e0581c097]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JSEIyVYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:36:44 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:36:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:36:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Searching for a device in session 55 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKaxnDiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '23136303063643465', 'path': '/dev/sdd'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136303063643465', 'path': '/dev/sdd'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.929s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:36:45 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:36:45 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG nova.objects.instance [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lazy-loading 'flavor' on Instance uuid 0b0cb76b-1382-4296-8d33-a353a5f55b51 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c17502fe-4268-4003-85d3-b3cdbbbf3575]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:36:45 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:36:45 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:36:45 user nova-compute[74242]:   <source dev="/dev/sdd"/>
Oct 20 02:36:45 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:36:45 user nova-compute[74242]:   <serial>3ec5ee98-31cd-483b-8c18-924ea4b14fbc</serial>
Oct 20 02:36:45 user nova-compute[74242]: </disk>
Oct 20 02:36:45 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe31cbf-ca90-4219-8584-14566f8c47c3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178] added
Oct 20 02:36:45 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8ee00c9-e10f-4beb-8fc0-e66faca333b9]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b633e3b3-83b8-4f63-9d0b-9fe25446240f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JSEIyVYq {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JSEIyVYq" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bf7c3d-9b1a-4a92-9007-ee4a19c3affb]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JSEIyVYq'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25cee26-0b4b-4479-918f-d49c730ffd28]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6a69fc-29df-4a5f-8619-b21f3346516f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:36:45 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:36:45 user nova-compute[74242]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc (non-flash)
Oct 20 02:36:45 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:36:45 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:36:45 user nova-compute[74242]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc (non-flash)
Oct 20 02:36:45 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[25716603-1688-4089-8c43-4732626e79ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178, portal: 172.16.0.220,3260]
Oct 20 02:36:45 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178, portal: 172.16.0.220,3260] successful.
Oct 20 02:36:45 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe5cb83-ffdf-4d66-a09e-1f09eb765bbf]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d76f2d6-cefa-4507-894f-5a887a056b33]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:36:45 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:36:45 user nova-compute[74242]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc (non-flash)
Oct 20 02:36:45 user nova-compute[74242]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 (non-flash)
Oct 20 02:36:45 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:36:45 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:36:45 user nova-compute[74242]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc (non-flash)
Oct 20 02:36:45 user nova-compute[74242]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 (non-flash)
Oct 20 02:36:45 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.282s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] HCTL ('36', '-', '-', 0) found on session 56 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba51a047-c22a-48ba-8bc1-90b5ca60e0e0]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] No VIF found with MAC fa:16:3e:ad:65:01, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:36:45 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-7055e2be-551c-47c1-b9a4-d7327ff3c225 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.059s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:36:46 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Searching for a device in session 56 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:36:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JSEIyVYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:36:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:36:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] <== connect_volume: return (2246ms) {'type': 'block', 'scsi_wwn': '26265313932633231', 'path': '/dev/sde'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:36:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265313932633231', 'path': '/dev/sde'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:36:46 user nova-compute[74242]: DEBUG nova.objects.instance [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lazy-loading 'flavor' on Instance uuid 9b289be0-d915-4934-a9b0-5a2814e05530 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:36:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:36:46 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:36:46 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:36:46 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:36:46 user nova-compute[74242]:   <serial>59959661-d2f2-4530-a27f-f4aa17c8a178</serial>
Oct 20 02:36:46 user nova-compute[74242]: </disk>
Oct 20 02:36:46 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:36:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:36:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:36:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] No VIF found with MAC fa:16:3e:cc:17:a1, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:36:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5a9055a6-c6d4-41ac-a53b-bd4ccb238fc5 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "9b289be0-d915-4934-a9b0-5a2814e05530" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.458s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:36:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "0b0cb76b-1382-4296-8d33-a353a5f55b51" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:36:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:36:47 user nova-compute[74242]: INFO nova.compute.manager [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Detaching volume 3ec5ee98-31cd-483b-8c18-924ea4b14fbc
Oct 20 02:36:47 user nova-compute[74242]: INFO nova.virt.block_device [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Attempting to driver detach volume 3ec5ee98-31cd-483b-8c18-924ea4b14fbc from mountpoint /dev/vdb
Oct 20 02:36:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Attempting to detach device vdb from instance 0b0cb76b-1382-4296-8d33-a353a5f55b51 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:36:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:36:47 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:36:47 user nova-compute[74242]:   <source dev="/dev/sdd"/>
Oct 20 02:36:47 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:36:47 user nova-compute[74242]:   <serial>3ec5ee98-31cd-483b-8c18-924ea4b14fbc</serial>
Oct 20 02:36:47 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:36:47 user nova-compute[74242]: </disk>
Oct 20 02:36:47 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:36:47 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Successfully detached device vdb from instance 0b0cb76b-1382-4296-8d33-a353a5f55b51 from the persistent domain config.
Oct 20 02:36:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0b0cb76b-1382-4296-8d33-a353a5f55b51 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:36:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:36:47 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:36:47 user nova-compute[74242]:   <source dev="/dev/sdd"/>
Oct 20 02:36:47 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:36:47 user nova-compute[74242]:   <serial>3ec5ee98-31cd-483b-8c18-924ea4b14fbc</serial>
Oct 20 02:36:47 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:36:47 user nova-compute[74242]: </disk>
Oct 20 02:36:47 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:36:47 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0b0cb76b-1382-4296-8d33-a353a5f55b51 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:36:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquiring lock "9b289be0-d915-4934-a9b0-5a2814e05530" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:36:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "9b289be0-d915-4934-a9b0-5a2814e05530" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:36:49 user nova-compute[74242]: INFO nova.compute.manager [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Detaching volume 59959661-d2f2-4530-a27f-f4aa17c8a178
Oct 20 02:36:49 user nova-compute[74242]: INFO nova.virt.block_device [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Attempting to driver detach volume 59959661-d2f2-4530-a27f-f4aa17c8a178 from mountpoint /dev/vdb
Oct 20 02:36:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Attempting to detach device vdb from instance 9b289be0-d915-4934-a9b0-5a2814e05530 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:36:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:36:49 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:36:49 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:36:49 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:36:49 user nova-compute[74242]:   <serial>59959661-d2f2-4530-a27f-f4aa17c8a178</serial>
Oct 20 02:36:49 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:36:49 user nova-compute[74242]: </disk>
Oct 20 02:36:49 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:36:49 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Successfully detached device vdb from instance 9b289be0-d915-4934-a9b0-5a2814e05530 from the persistent domain config.
Oct 20 02:36:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9b289be0-d915-4934-a9b0-5a2814e05530 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:36:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:36:49 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:36:49 user nova-compute[74242]:   <source dev="/dev/sde"/>
Oct 20 02:36:49 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:36:49 user nova-compute[74242]:   <serial>59959661-d2f2-4530-a27f-f4aa17c8a178</serial>
Oct 20 02:36:49 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:36:49 user nova-compute[74242]: </disk>
Oct 20 02:36:49 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:36:49 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:36:49 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9b289be0-d915-4934-a9b0-5a2814e05530 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:36:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:51 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:36:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:36:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:36:52 user nova-compute[74242]: INFO nova.compute.manager [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Detaching volume 4daf3c70-6911-47b4-bc0d-9840e04ae0c0
Oct 20 02:36:52 user nova-compute[74242]: INFO nova.virt.block_device [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Attempting to driver detach volume 4daf3c70-6911-47b4-bc0d-9840e04ae0c0 from mountpoint /dev/vdb
Oct 20 02:36:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Attempting to detach device vdb from instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:36:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:36:52 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:36:52 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:36:52 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:36:52 user nova-compute[74242]:   <serial>4daf3c70-6911-47b4-bc0d-9840e04ae0c0</serial>
Oct 20 02:36:52 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 02:36:52 user nova-compute[74242]: </disk>
Oct 20 02:36:52 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:36:52 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Successfully detached device vdb from instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 from the persistent domain config.
Oct 20 02:36:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:36:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:36:52 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:36:52 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:36:52 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:36:52 user nova-compute[74242]:   <serial>4daf3c70-6911-47b4-bc0d-9840e04ae0c0</serial>
Oct 20 02:36:52 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 20 02:36:52 user nova-compute[74242]: </disk>
Oct 20 02:36:52 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:36:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:36:53 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:36:53 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:36:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:36:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:36:53 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: d4ccd900-744b-49d8-a892-897591be031c] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:36:53 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updating instance_info_cache with network_info: [{"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:36:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:36:53 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:36:53 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:36:53 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:36:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:36:58 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:36:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:01 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:37:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:37:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:37:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:01 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:37:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:01 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:37:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:04 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:37:04 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:37:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8160MB free_disk=24.700088500976562GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 67575ff4-ecf0-493a-b07d-0e808f209b23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d4ccd900-744b-49d8-a892-897591be031c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 9b289be0-d915-4934-a9b0-5a2814e05530 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 0b0cb76b-1382-4296-8d33-a353a5f55b51 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:37:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:37:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:05 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:37:05 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:37:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:37:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.379s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:37:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:37:07 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0b0cb76b-1382-4296-8d33-a353a5f55b51 is timed out.
Oct 20 02:37:07 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Successfully detached device vdb from instance 0b0cb76b-1382-4296-8d33-a353a5f55b51 from the live domain config.
Oct 20 02:37:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NKaxnDiG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:37:07 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc6b72c-8277-48d4-9497-6f0d05244a4a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:37:07 user nova-compute[74242]: No targets found.
Oct 20 02:37:07 user nova-compute[74242]: iSNS:
Oct 20 02:37:07 user nova-compute[74242]: No targets found.
Oct 20 02:37:07 user nova-compute[74242]: STATIC:
Oct 20 02:37:07 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178
Oct 20 02:37:07 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:37:07 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:37:07 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701
Oct 20 02:37:07 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:37:07 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:37:07 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0
Oct 20 02:37:07 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:37:07 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:37:07 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc
Oct 20 02:37:07 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:37:07 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:37:07 user nova-compute[74242]: FIRMWARE:
Oct 20 02:37:07 user nova-compute[74242]: No targets found.
Oct 20 02:37:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:37:07 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:37:07 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d73314e-6fdb-45e7-ab00-60db9f940924]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b40403-0716-415b-b09a-e3ea56c4c4f2]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:37:07 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:37:07 user nova-compute[74242]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc (non-flash)
Oct 20 02:37:07 user nova-compute[74242]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 (non-flash)
Oct 20 02:37:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:37:07 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:37:07 user nova-compute[74242]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc (non-flash)
Oct 20 02:37:07 user nova-compute[74242]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 (non-flash)
Oct 20 02:37:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8947edd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc'): ({'sdd'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Removing single pathed devices sdd {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca19c2d5-a0d2-4d39-bc6d-a72960bf4431]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12bc3e7-a784-4709-9016-df3607d110e9]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Flushing IO for device /dev/sdd {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b9a9876-0e79-462f-84dc-e3bf4f327a4b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[28dbcc37-8911-4577-b15a-b753efd350b7]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] SCSI volumes sdd have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5edcd9-472c-4944-9880-a5e7693a3082]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[65608037-6662-4fc8-9943-606e000a3701]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc, portal: 172.16.0.220,3260]
Oct 20 02:37:07 user nova-compute[74242]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc, portal: 172.16.0.220,3260] successful.
Oct 20 02:37:07 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3ec5ee98-31cd-483b-8c18-924ea4b14fbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f139f8-8d91-4b49-b9cc-561b94335ae5]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] <== disconnect_volume: return (302ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:37:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:37:08 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lazy-loading 'flavor' on Instance uuid 0b0cb76b-1382-4296-8d33-a353a5f55b51 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:37:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8c92a3bd-f158-44ee-b617-bf06777614f7 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.685s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:09 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9b289be0-d915-4934-a9b0-5a2814e05530 is timed out.
Oct 20 02:37:09 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Successfully detached device vdb from instance 9b289be0-d915-4934-a9b0-5a2814e05530 from the live domain config.
Oct 20 02:37:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JSEIyVYq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:37:09 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f39d5be8-014b-49f4-8106-29c49b7c9d39]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:37:09 user nova-compute[74242]: No targets found.
Oct 20 02:37:09 user nova-compute[74242]: iSNS:
Oct 20 02:37:09 user nova-compute[74242]: No targets found.
Oct 20 02:37:09 user nova-compute[74242]: STATIC:
Oct 20 02:37:09 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178
Oct 20 02:37:09 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:37:09 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:37:09 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701
Oct 20 02:37:09 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:37:09 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:37:09 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0
Oct 20 02:37:09 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:37:09 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:37:09 user nova-compute[74242]: FIRMWARE:
Oct 20 02:37:09 user nova-compute[74242]: No targets found.
Oct 20 02:37:09 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:37:09 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:37:09 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ba3192-a58c-45f3-aa62-9e0b9896abc0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ff9df7-0ad7-4c33-a446-241db43eb662]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:37:09 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:37:09 user nova-compute[74242]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 (non-flash)
Oct 20 02:37:09 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:37:09 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:37:09 user nova-compute[74242]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 (non-flash)
Oct 20 02:37:09 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8947ee950>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178'): ({'sde'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Removing single pathed devices sde {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5be75e08-a312-4378-8775-739e7c1eb140]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[949beac1-8f42-43c8-8d2f-57cfed419e0a]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Flushing IO for device /dev/sde {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[91befdfc-bdd1-4b41-aafc-ff44c70234b3]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.040s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cf907a-a176-497d-8498-e31be2ad77c1]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] SCSI volumes sde have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49b5e9c-d3bd-42d5-add7-1cdac9808aed]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bcb9d4a-0611-4273-baa0-349f7e4d1e39]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178, portal: 172.16.0.220,3260]
Oct 20 02:37:09 user nova-compute[74242]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178, portal: 172.16.0.220,3260] successful.
Oct 20 02:37:09 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59959661-d2f2-4530-a27f-f4aa17c8a178 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[42148742-09ec-46b1-9dd9-d582b34f9aa6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] <== disconnect_volume: return (299ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:37:09 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:37:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:37:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:37:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:37:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:37:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:10 user nova-compute[74242]: DEBUG nova.objects.instance [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lazy-loading 'flavor' on Instance uuid 9b289be0-d915-4934-a9b0-5a2814e05530 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:37:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cb697b34-00ee-414b-b010-1081570cdb36 tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "9b289be0-d915-4934-a9b0-5a2814e05530" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.707s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:12 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:37:13 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 is timed out.
Oct 20 02:37:13 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Successfully detached device vdb from instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 from the live domain config.
Oct 20 02:37:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lURfmLcI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:37:13 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[556a400e-4a81-4592-a0d5-0cca8f400402]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:37:13 user nova-compute[74242]: No targets found.
Oct 20 02:37:13 user nova-compute[74242]: iSNS:
Oct 20 02:37:13 user nova-compute[74242]: No targets found.
Oct 20 02:37:13 user nova-compute[74242]: STATIC:
Oct 20 02:37:13 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701
Oct 20 02:37:13 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:37:13 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:37:13 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0
Oct 20 02:37:13 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:37:13 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:37:13 user nova-compute[74242]: FIRMWARE:
Oct 20 02:37:13 user nova-compute[74242]: No targets found.
Oct 20 02:37:13 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:37:13 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:37:13 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34193f6-3a56-4fc2-b8a2-bdb272813139]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f89a313-8431-4da0-9c01-1a936adbefb7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:37:13 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:37:13 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:37:13 user nova-compute[74242]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 (non-flash)
Oct 20 02:37:13 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8947ec4c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0'): ({'sdb'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Removing single pathed devices sdb {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5d4946-66f2-43cd-b1a1-93190bca50b4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee8a631-3d1b-442e-b4dd-2b92a59e35db]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Flushing IO for device /dev/sdb {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[203c0a4d-3dfa-4aff-9126-e88a442ce753]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a033f58-5719-42f2-8767-b2bebf1d9fe9]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6152aac-510f-4701-bd08-4e85449e0b97]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[224f0c7d-7764-4486-926e-34e5359afdc0]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260]
Oct 20 02:37:13 user nova-compute[74242]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0, portal: 172.16.0.220,3260] successful.
Oct 20 02:37:13 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4daf3c70-6911-47b4-bc0d-9840e04ae0c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e393f838-180b-4985-874b-563d37637668]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] <== disconnect_volume: return (322ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:37:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:37:14 user nova-compute[74242]: DEBUG nova.objects.instance [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'flavor' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:37:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-9220647b-f86e-4eab-9903-5f9dc7b6703d tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.734s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e0a123ae-9fae-49b6-a55c-72dd913b7733 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e0a123ae-9fae-49b6-a55c-72dd913b7733 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e0a123ae-9fae-49b6-a55c-72dd913b7733 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e0a123ae-9fae-49b6-a55c-72dd913b7733 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74242) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG nova.objects.instance [None req-e0a123ae-9fae-49b6-a55c-72dd913b7733 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'flavor' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-aeae90f0-2f6f-467b-a56c-a0a65ce987f4 req-13b03cf3-dba2-4fb4-b5e5-726aedc47281 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-vif-unplugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-aeae90f0-2f6f-467b-a56c-a0a65ce987f4 req-13b03cf3-dba2-4fb4-b5e5-726aedc47281 service nova] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-aeae90f0-2f6f-467b-a56c-a0a65ce987f4 req-13b03cf3-dba2-4fb4-b5e5-726aedc47281 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-aeae90f0-2f6f-467b-a56c-a0a65ce987f4 req-13b03cf3-dba2-4fb4-b5e5-726aedc47281 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-aeae90f0-2f6f-467b-a56c-a0a65ce987f4 req-13b03cf3-dba2-4fb4-b5e5-726aedc47281 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] No waiting events found dispatching network-vif-unplugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:37:15 user nova-compute[74242]: WARNING nova.compute.manager [req-aeae90f0-2f6f-467b-a56c-a0a65ce987f4 req-13b03cf3-dba2-4fb4-b5e5-726aedc47281 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received unexpected event network-vif-unplugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec for instance with vm_state active and task_state powering-off.
Oct 20 02:37:15 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Instance destroyed successfully.
Oct 20 02:37:15 user nova-compute[74242]: DEBUG nova.compute.manager [None req-e0a123ae-9fae-49b6-a55c-72dd913b7733 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:37:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-e0a123ae-9fae-49b6-a55c-72dd913b7733 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.848s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:17 user nova-compute[74242]: DEBUG nova.compute.manager [req-9ce5dfff-0a06-4a8a-992e-94b6e5b51df1 req-fb033348-43c5-4bf2-82a0-5654b6046d66 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:37:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9ce5dfff-0a06-4a8a-992e-94b6e5b51df1 req-fb033348-43c5-4bf2-82a0-5654b6046d66 service nova] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:37:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9ce5dfff-0a06-4a8a-992e-94b6e5b51df1 req-fb033348-43c5-4bf2-82a0-5654b6046d66 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:37:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9ce5dfff-0a06-4a8a-992e-94b6e5b51df1 req-fb033348-43c5-4bf2-82a0-5654b6046d66 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:17 user nova-compute[74242]: DEBUG nova.compute.manager [req-9ce5dfff-0a06-4a8a-992e-94b6e5b51df1 req-fb033348-43c5-4bf2-82a0-5654b6046d66 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] No waiting events found dispatching network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:37:17 user nova-compute[74242]: WARNING nova.compute.manager [req-9ce5dfff-0a06-4a8a-992e-94b6e5b51df1 req-fb033348-43c5-4bf2-82a0-5654b6046d66 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received unexpected event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec for instance with vm_state stopped and task_state None.
Oct 20 02:37:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:37:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:37:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-08f0f438-33fc-4124-845a-3971d42d978a req-a965f7c7-88b3-42d0-9f8c-b052dc63a15e service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Received event network-changed-bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-08f0f438-33fc-4124-845a-3971d42d978a req-a965f7c7-88b3-42d0-9f8c-b052dc63a15e service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Refreshing instance network info cache due to event network-changed-bbb75831-ae21-43b4-899f-de0f8da0a162. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-08f0f438-33fc-4124-845a-3971d42d978a req-a965f7c7-88b3-42d0-9f8c-b052dc63a15e service nova] Acquiring lock "refresh_cache-0b0cb76b-1382-4296-8d33-a353a5f55b51" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-08f0f438-33fc-4124-845a-3971d42d978a req-a965f7c7-88b3-42d0-9f8c-b052dc63a15e service nova] Acquired lock "refresh_cache-0b0cb76b-1382-4296-8d33-a353a5f55b51" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG nova.network.neutron [req-08f0f438-33fc-4124-845a-3971d42d978a req-a965f7c7-88b3-42d0-9f8c-b052dc63a15e service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Refreshing network info cache for port bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "0b0cb76b-1382-4296-8d33-a353a5f55b51" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "0b0cb76b-1382-4296-8d33-a353a5f55b51-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:38 user nova-compute[74242]: INFO nova.compute.manager [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Terminating instance
Oct 20 02:37:38 user nova-compute[74242]: DEBUG nova.compute.manager [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7b7152c-6cb9-4bfb-a8b4-6e82e5f25014 req-5c96e430-efb3-4cf7-aac7-28306dec4b6e service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Received event network-vif-unplugged-bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7b7152c-6cb9-4bfb-a8b4-6e82e5f25014 req-5c96e430-efb3-4cf7-aac7-28306dec4b6e service nova] Acquiring lock "0b0cb76b-1382-4296-8d33-a353a5f55b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7b7152c-6cb9-4bfb-a8b4-6e82e5f25014 req-5c96e430-efb3-4cf7-aac7-28306dec4b6e service nova] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d7b7152c-6cb9-4bfb-a8b4-6e82e5f25014 req-5c96e430-efb3-4cf7-aac7-28306dec4b6e service nova] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7b7152c-6cb9-4bfb-a8b4-6e82e5f25014 req-5c96e430-efb3-4cf7-aac7-28306dec4b6e service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] No waiting events found dispatching network-vif-unplugged-bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG nova.compute.manager [req-d7b7152c-6cb9-4bfb-a8b4-6e82e5f25014 req-5c96e430-efb3-4cf7-aac7-28306dec4b6e service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Received event network-vif-unplugged-bbb75831-ae21-43b4-899f-de0f8da0a162 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG nova.network.neutron [req-08f0f438-33fc-4124-845a-3971d42d978a req-a965f7c7-88b3-42d0-9f8c-b052dc63a15e service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Updated VIF entry in instance network info cache for port bbb75831-ae21-43b4-899f-de0f8da0a162. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG nova.network.neutron [req-08f0f438-33fc-4124-845a-3971d42d978a req-a965f7c7-88b3-42d0-9f8c-b052dc63a15e service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Updating instance_info_cache with network_info: [{"id": "bbb75831-ae21-43b4-899f-de0f8da0a162", "address": "fa:16:3e:ad:65:01", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbb75831-ae", "ovs_interfaceid": "bbb75831-ae21-43b4-899f-de0f8da0a162", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-08f0f438-33fc-4124-845a-3971d42d978a req-a965f7c7-88b3-42d0-9f8c-b052dc63a15e service nova] Releasing lock "refresh_cache-0b0cb76b-1382-4296-8d33-a353a5f55b51" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:37:38 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Instance destroyed successfully.
Oct 20 02:37:38 user nova-compute[74242]: DEBUG nova.objects.instance [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lazy-loading 'resources' on Instance uuid 0b0cb76b-1382-4296-8d33-a353a5f55b51 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:34:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1341322404',display_name='tempest-TestStampPattern-server-1341322404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1341322404',id=47,image_ref='51f0f534-7c96-4aa7-8ffa-a707e5d6a924',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYGIAL3BPbNRP/f8TTaaS+fRSqiqmwNAp8S9LYWbQcGSs8gpOlmyAN8s6c1MVpMgmvgEs1210r1izyM79vKpMSRksL+RI4OA1L+LaWwUc2PcO3Orr5NlrQNvhE5JyjJpg==',key_name='tempest-TestStampPattern-200219955',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:34:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2982c9c65e548478739144ba83306ea',ramdisk_id='',reservation_id='r-5ez7ti4y',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='67575ff4-ecf0-493a-b07d-0e808f209b23',image_min_disk='1',image_min_ram='0',image_owner_id='d2982c9c65e548478739144ba83306ea',image_owner_project_name='tempest-TestStampPattern-1416614973',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1416614973-project-member',image_user_id='ebacf16af7234540acea291a74a1b68d',owner_project_name='tempest-TestStampPattern-1416614973',owner_user_name='tempest-TestStampPattern-1416614973-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:34:43Z,user_data=None,user_id='ebacf16af7234540acea291a74a1b68d',uuid=0b0cb76b-1382-4296-8d33-a353a5f55b51,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bbb75831-ae21-43b4-899f-de0f8da0a162", "address": "fa:16:3e:ad:65:01", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbb75831-ae", "ovs_interfaceid": "bbb75831-ae21-43b4-899f-de0f8da0a162", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Converting VIF {"id": "bbb75831-ae21-43b4-899f-de0f8da0a162", "address": "fa:16:3e:ad:65:01", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbbb75831-ae", "ovs_interfaceid": "bbb75831-ae21-43b4-899f-de0f8da0a162", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:65:01,bridge_name='br-int',has_traffic_filtering=True,id=bbb75831-ae21-43b4-899f-de0f8da0a162,network=Network(4bfd9e0b-6a72-45b3-9618-8c8b91bb3604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbb75831-ae') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG os_vif [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:65:01,bridge_name='br-int',has_traffic_filtering=True,id=bbb75831-ae21-43b4-899f-de0f8da0a162,network=Network(4bfd9e0b-6a72-45b3-9618-8c8b91bb3604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbb75831-ae') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbbb75831-ae, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3cc07c63-c8f8-4323-9250-41e998081576) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:37:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:38 user nova-compute[74242]: INFO os_vif [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:65:01,bridge_name='br-int',has_traffic_filtering=True,id=bbb75831-ae21-43b4-899f-de0f8da0a162,network=Network(4bfd9e0b-6a72-45b3-9618-8c8b91bb3604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbbb75831-ae')
Oct 20 02:37:38 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Deleting instance files /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51_del
Oct 20 02:37:38 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Deletion of /opt/stack/data/nova/instances/0b0cb76b-1382-4296-8d33-a353a5f55b51_del complete
Oct 20 02:37:39 user nova-compute[74242]: INFO nova.compute.manager [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 20 02:37:39 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:37:39 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:37:39 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:37:39 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:37:39 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Took 0.70 seconds to deallocate network for instance.
Oct 20 02:37:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-8edad5f3-0951-44b2-beaf-b9548c9f7b8d req-3d463ec4-bfb9-48c8-91c6-435fa02bd9e5 service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Received event network-vif-deleted-bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:37:39 user nova-compute[74242]: INFO nova.compute.manager [req-8edad5f3-0951-44b2-beaf-b9548c9f7b8d req-3d463ec4-bfb9-48c8-91c6-435fa02bd9e5 service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Neutron deleted interface bbb75831-ae21-43b4-899f-de0f8da0a162; detaching it from the instance and deleting it from the info cache
Oct 20 02:37:39 user nova-compute[74242]: DEBUG nova.network.neutron [req-8edad5f3-0951-44b2-beaf-b9548c9f7b8d req-3d463ec4-bfb9-48c8-91c6-435fa02bd9e5 service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:37:39 user nova-compute[74242]: DEBUG nova.compute.manager [req-8edad5f3-0951-44b2-beaf-b9548c9f7b8d req-3d463ec4-bfb9-48c8-91c6-435fa02bd9e5 service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Detach interface failed, port_id=bbb75831-ae21-43b4-899f-de0f8da0a162, reason: Instance 0b0cb76b-1382-4296-8d33-a353a5f55b51 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:37:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:37:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:37:39 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:37:39 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:37:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.255s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:40 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Deleted allocations for instance 0b0cb76b-1382-4296-8d33-a353a5f55b51
Oct 20 02:37:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-ae881fda-ffa6-4089-98a3-534ae4f686b5 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.991s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-08c46fdc-446b-43bf-8811-9503db84f0f6 req-4376bd09-fd5d-41b8-9a12-e129c86bc1e0 service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Received event network-vif-plugged-bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:37:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-08c46fdc-446b-43bf-8811-9503db84f0f6 req-4376bd09-fd5d-41b8-9a12-e129c86bc1e0 service nova] Acquiring lock "0b0cb76b-1382-4296-8d33-a353a5f55b51-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:37:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-08c46fdc-446b-43bf-8811-9503db84f0f6 req-4376bd09-fd5d-41b8-9a12-e129c86bc1e0 service nova] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:37:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-08c46fdc-446b-43bf-8811-9503db84f0f6 req-4376bd09-fd5d-41b8-9a12-e129c86bc1e0 service nova] Lock "0b0cb76b-1382-4296-8d33-a353a5f55b51-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:40 user nova-compute[74242]: DEBUG nova.compute.manager [req-08c46fdc-446b-43bf-8811-9503db84f0f6 req-4376bd09-fd5d-41b8-9a12-e129c86bc1e0 service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] No waiting events found dispatching network-vif-plugged-bbb75831-ae21-43b4-899f-de0f8da0a162 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:37:40 user nova-compute[74242]: WARNING nova.compute.manager [req-08c46fdc-446b-43bf-8811-9503db84f0f6 req-4376bd09-fd5d-41b8-9a12-e129c86bc1e0 service nova] [instance: 0b0cb76b-1382-4296-8d33-a353a5f55b51] Received unexpected event network-vif-plugged-bbb75831-ae21-43b4-899f-de0f8da0a162 for instance with vm_state deleted and task_state None.
Oct 20 02:37:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquiring lock "9b289be0-d915-4934-a9b0-5a2814e05530" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "9b289be0-d915-4934-a9b0-5a2814e05530" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquiring lock "9b289be0-d915-4934-a9b0-5a2814e05530-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "9b289be0-d915-4934-a9b0-5a2814e05530-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "9b289be0-d915-4934-a9b0-5a2814e05530-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:48 user nova-compute[74242]: INFO nova.compute.manager [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Terminating instance
Oct 20 02:37:48 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-67a8d285-9339-47fe-9d50-929aed09cf0d req-8c7e5e6b-5481-4e14-b928-3a4455a6e53c service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Received event network-vif-unplugged-5ea0570e-9f58-4338-8cff-4d66ef9a1319 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-67a8d285-9339-47fe-9d50-929aed09cf0d req-8c7e5e6b-5481-4e14-b928-3a4455a6e53c service nova] Acquiring lock "9b289be0-d915-4934-a9b0-5a2814e05530-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-67a8d285-9339-47fe-9d50-929aed09cf0d req-8c7e5e6b-5481-4e14-b928-3a4455a6e53c service nova] Lock "9b289be0-d915-4934-a9b0-5a2814e05530-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-67a8d285-9339-47fe-9d50-929aed09cf0d req-8c7e5e6b-5481-4e14-b928-3a4455a6e53c service nova] Lock "9b289be0-d915-4934-a9b0-5a2814e05530-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-67a8d285-9339-47fe-9d50-929aed09cf0d req-8c7e5e6b-5481-4e14-b928-3a4455a6e53c service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] No waiting events found dispatching network-vif-unplugged-5ea0570e-9f58-4338-8cff-4d66ef9a1319 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-67a8d285-9339-47fe-9d50-929aed09cf0d req-8c7e5e6b-5481-4e14-b928-3a4455a6e53c service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Received event network-vif-unplugged-5ea0570e-9f58-4338-8cff-4d66ef9a1319 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:37:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Instance destroyed successfully.
Oct 20 02:37:48 user nova-compute[74242]: DEBUG nova.objects.instance [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lazy-loading 'resources' on Instance uuid 9b289be0-d915-4934-a9b0-5a2814e05530 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:34:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-716082823',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-716082823',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7160828',id=46,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAEUCMRx+2sDvQJbrsaNDhBjF3YE+3Q9pMqWUbg8PywdIPMV8nkK7rXbUwoV4mwvvvV0e53WVLpeh5dAE2tMLRYHzcKFnI6y422YurqiSj8LzxuQu+bUjCq6tp4o/fJevg==',key_name='tempest-keypair-1722618805',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:34:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='305f8aa83bfc4c79b2ef4cdffef3cd49',ramdisk_id='',reservation_id='r-lt8kha0u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-774144487',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:34:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3f2be8ad306d42fbab30806b78264173',uuid=9b289be0-d915-4934-a9b0-5a2814e05530,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "address": "fa:16:3e:cc:17:a1", "network": {"id": "f1b5de20-519a-4a4e-ab76-dc51e3fdf70e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1148846947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "305f8aa83bfc4c79b2ef4cdffef3cd49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea0570e-9f", "ovs_interfaceid": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Converting VIF {"id": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "address": "fa:16:3e:cc:17:a1", "network": {"id": "f1b5de20-519a-4a4e-ab76-dc51e3fdf70e", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1148846947-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.62", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "305f8aa83bfc4c79b2ef4cdffef3cd49", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5ea0570e-9f", "ovs_interfaceid": "5ea0570e-9f58-4338-8cff-4d66ef9a1319", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:17:a1,bridge_name='br-int',has_traffic_filtering=True,id=5ea0570e-9f58-4338-8cff-4d66ef9a1319,network=Network(f1b5de20-519a-4a4e-ab76-dc51e3fdf70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea0570e-9f') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG os_vif [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:17:a1,bridge_name='br-int',has_traffic_filtering=True,id=5ea0570e-9f58-4338-8cff-4d66ef9a1319,network=Network(f1b5de20-519a-4a4e-ab76-dc51e3fdf70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea0570e-9f') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5ea0570e-9f, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7f133f13-41ff-4544-8899-a3b7f8bb06e9) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:48 user nova-compute[74242]: INFO os_vif [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:17:a1,bridge_name='br-int',has_traffic_filtering=True,id=5ea0570e-9f58-4338-8cff-4d66ef9a1319,network=Network(f1b5de20-519a-4a4e-ab76-dc51e3fdf70e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5ea0570e-9f')
Oct 20 02:37:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Deleting instance files /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530_del
Oct 20 02:37:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Deletion of /opt/stack/data/nova/instances/9b289be0-d915-4934-a9b0-5a2814e05530_del complete
Oct 20 02:37:48 user nova-compute[74242]: INFO nova.compute.manager [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 20 02:37:48 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:37:48 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:37:49 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:37:49 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:37:49 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Took 0.67 seconds to deallocate network for instance.
Oct 20 02:37:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-3e539930-d559-424d-870c-511c65f6bd8b req-6174ec76-cf0e-4fbd-9bfc-3c6eb69488ba service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Received event network-vif-deleted-5ea0570e-9f58-4338-8cff-4d66ef9a1319 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:37:49 user nova-compute[74242]: INFO nova.compute.manager [req-3e539930-d559-424d-870c-511c65f6bd8b req-6174ec76-cf0e-4fbd-9bfc-3c6eb69488ba service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Neutron deleted interface 5ea0570e-9f58-4338-8cff-4d66ef9a1319; detaching it from the instance and deleting it from the info cache
Oct 20 02:37:49 user nova-compute[74242]: DEBUG nova.network.neutron [req-3e539930-d559-424d-870c-511c65f6bd8b req-6174ec76-cf0e-4fbd-9bfc-3c6eb69488ba service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:37:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-3e539930-d559-424d-870c-511c65f6bd8b req-6174ec76-cf0e-4fbd-9bfc-3c6eb69488ba service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Detach interface failed, port_id=5ea0570e-9f58-4338-8cff-4d66ef9a1319, reason: Instance 9b289be0-d915-4934-a9b0-5a2814e05530 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:37:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:37:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:37:49 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:37:49 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:37:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:49 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Deleted allocations for instance 9b289be0-d915-4934-a9b0-5a2814e05530
Oct 20 02:37:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0cde71a9-d862-41f7-8a66-7fa5aa23092a tempest-TestServerVolumeAttachScenarioOldVersion-774144487 tempest-TestServerVolumeAttachScenarioOldVersion-774144487-project-member] Lock "9b289be0-d915-4934-a9b0-5a2814e05530" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.947s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-a0f3c60c-d4d2-49d6-a112-67026fa3bfac req-ef3ca6f0-b013-4117-bfe6-1a65eaf6ecc0 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Received event network-vif-plugged-5ea0570e-9f58-4338-8cff-4d66ef9a1319 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:37:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a0f3c60c-d4d2-49d6-a112-67026fa3bfac req-ef3ca6f0-b013-4117-bfe6-1a65eaf6ecc0 service nova] Acquiring lock "9b289be0-d915-4934-a9b0-5a2814e05530-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:37:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a0f3c60c-d4d2-49d6-a112-67026fa3bfac req-ef3ca6f0-b013-4117-bfe6-1a65eaf6ecc0 service nova] Lock "9b289be0-d915-4934-a9b0-5a2814e05530-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:37:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a0f3c60c-d4d2-49d6-a112-67026fa3bfac req-ef3ca6f0-b013-4117-bfe6-1a65eaf6ecc0 service nova] Lock "9b289be0-d915-4934-a9b0-5a2814e05530-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:37:50 user nova-compute[74242]: DEBUG nova.compute.manager [req-a0f3c60c-d4d2-49d6-a112-67026fa3bfac req-ef3ca6f0-b013-4117-bfe6-1a65eaf6ecc0 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] No waiting events found dispatching network-vif-plugged-5ea0570e-9f58-4338-8cff-4d66ef9a1319 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:37:50 user nova-compute[74242]: WARNING nova.compute.manager [req-a0f3c60c-d4d2-49d6-a112-67026fa3bfac req-ef3ca6f0-b013-4117-bfe6-1a65eaf6ecc0 service nova] [instance: 9b289be0-d915-4934-a9b0-5a2814e05530] Received unexpected event network-vif-plugged-5ea0570e-9f58-4338-8cff-4d66ef9a1319 for instance with vm_state deleted and task_state None.
Oct 20 02:37:51 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:37:53 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:37:53 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:37:53 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:37:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:37:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:37:53 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:37:53 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid 2bf62933-66ea-469e-a70e-92184f311110 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:37:53 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Updating instance_info_cache with network_info: [{"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:37:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-2bf62933-66ea-469e-a70e-92184f311110" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:37:53 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:37:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:37:54 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:37:54 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:37:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:00 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:38:02 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:38:02 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:38:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:38:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:38:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:38:02 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:38:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:38:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:38:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:05 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:38:05 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:38:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8546MB free_disk=24.72018814086914GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:38:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:38:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:38:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:38:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:38:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:38:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 67575ff4-ecf0-493a-b07d-0e808f209b23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:38:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d4ccd900-744b-49d8-a892-897591be031c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:38:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:38:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:38:05 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:38:05 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:38:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:38:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:38:08 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:38:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:09 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:38:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:38:14 user nova-compute[74242]: DEBUG nova.compute.manager [req-7b682266-a61b-4e4f-b0f3-246bbad71f5c req-98f64e8e-d687-49d2-bdf4-9d549e3d454c service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-changed-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:38:14 user nova-compute[74242]: DEBUG nova.compute.manager [req-7b682266-a61b-4e4f-b0f3-246bbad71f5c req-98f64e8e-d687-49d2-bdf4-9d549e3d454c service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Refreshing instance network info cache due to event network-changed-7e3b7bad-876a-447a-85da-4e5f501f7870. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:38:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7b682266-a61b-4e4f-b0f3-246bbad71f5c req-98f64e8e-d687-49d2-bdf4-9d549e3d454c service nova] Acquiring lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:38:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7b682266-a61b-4e4f-b0f3-246bbad71f5c req-98f64e8e-d687-49d2-bdf4-9d549e3d454c service nova] Acquired lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:38:14 user nova-compute[74242]: DEBUG nova.network.neutron [req-7b682266-a61b-4e4f-b0f3-246bbad71f5c req-98f64e8e-d687-49d2-bdf4-9d549e3d454c service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Refreshing network info cache for port 7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:38:15 user nova-compute[74242]: DEBUG nova.network.neutron [req-7b682266-a61b-4e4f-b0f3-246bbad71f5c req-98f64e8e-d687-49d2-bdf4-9d549e3d454c service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updated VIF entry in instance network info cache for port 7e3b7bad-876a-447a-85da-4e5f501f7870. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:38:15 user nova-compute[74242]: DEBUG nova.network.neutron [req-7b682266-a61b-4e4f-b0f3-246bbad71f5c req-98f64e8e-d687-49d2-bdf4-9d549e3d454c service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updating instance_info_cache with network_info: [{"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:38:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7b682266-a61b-4e4f-b0f3-246bbad71f5c req-98f64e8e-d687-49d2-bdf4-9d549e3d454c service nova] Releasing lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:38:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:38:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "d4ccd900-744b-49d8-a892-897591be031c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:38:15 user nova-compute[74242]: INFO nova.compute.manager [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Detaching volume e08be8b8-bdca-492d-a95d-4a497b160701
Oct 20 02:38:15 user nova-compute[74242]: INFO nova.virt.block_device [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Attempting to driver detach volume e08be8b8-bdca-492d-a95d-4a497b160701 from mountpoint /dev/vdb
Oct 20 02:38:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Attempting to detach device vdb from instance d4ccd900-744b-49d8-a892-897591be031c from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:38:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:38:15 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:38:15 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:38:15 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:38:15 user nova-compute[74242]:   <serial>e08be8b8-bdca-492d-a95d-4a497b160701</serial>
Oct 20 02:38:15 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:38:15 user nova-compute[74242]: </disk>
Oct 20 02:38:15 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:38:15 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Successfully detached device vdb from instance d4ccd900-744b-49d8-a892-897591be031c from the persistent domain config.
Oct 20 02:38:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance d4ccd900-744b-49d8-a892-897591be031c from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:38:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:38:15 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:38:15 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:38:15 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:38:15 user nova-compute[74242]:   <serial>e08be8b8-bdca-492d-a95d-4a497b160701</serial>
Oct 20 02:38:15 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:38:15 user nova-compute[74242]: </disk>
Oct 20 02:38:15 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:38:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance d4ccd900-744b-49d8-a892-897591be031c {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:38:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-1610f1c8-2d56-455c-a1fe-a060cc529e7f req-4f2d8556-af6c-47c9-84e8-61ecd52297ec service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-changed-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:38:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-1610f1c8-2d56-455c-a1fe-a060cc529e7f req-4f2d8556-af6c-47c9-84e8-61ecd52297ec service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Refreshing instance network info cache due to event network-changed-7e3b7bad-876a-447a-85da-4e5f501f7870. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:38:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1610f1c8-2d56-455c-a1fe-a060cc529e7f req-4f2d8556-af6c-47c9-84e8-61ecd52297ec service nova] Acquiring lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:38:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1610f1c8-2d56-455c-a1fe-a060cc529e7f req-4f2d8556-af6c-47c9-84e8-61ecd52297ec service nova] Acquired lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:38:16 user nova-compute[74242]: DEBUG nova.network.neutron [req-1610f1c8-2d56-455c-a1fe-a060cc529e7f req-4f2d8556-af6c-47c9-84e8-61ecd52297ec service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Refreshing network info cache for port 7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:38:17 user nova-compute[74242]: DEBUG nova.network.neutron [req-1610f1c8-2d56-455c-a1fe-a060cc529e7f req-4f2d8556-af6c-47c9-84e8-61ecd52297ec service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updated VIF entry in instance network info cache for port 7e3b7bad-876a-447a-85da-4e5f501f7870. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:38:17 user nova-compute[74242]: DEBUG nova.network.neutron [req-1610f1c8-2d56-455c-a1fe-a060cc529e7f req-4f2d8556-af6c-47c9-84e8-61ecd52297ec service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updating instance_info_cache with network_info: [{"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:38:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1610f1c8-2d56-455c-a1fe-a060cc529e7f req-4f2d8556-af6c-47c9-84e8-61ecd52297ec service nova] Releasing lock "refresh_cache-d4ccd900-744b-49d8-a892-897591be031c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:38:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Verify base images {{(pid=74242) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Image id 1ba817e4-0454-4c11-9ff7-3af381824874 yields fingerprint 25d16a982d5d81d323c4741bf0fbe9044ec6cec8 {{(pid=74242) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 20 02:38:20 user nova-compute[74242]: INFO nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] image 1ba817e4-0454-4c11-9ff7-3af381824874 at (/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8): checking
Oct 20 02:38:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] image 1ba817e4-0454-4c11-9ff7-3af381824874 at (/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8): image is in use {{(pid=74242) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74242) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] 67575ff4-ecf0-493a-b07d-0e808f209b23 is a valid instance name {{(pid=74242) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] 67575ff4-ecf0-493a-b07d-0e808f209b23 has a disk file {{(pid=74242) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 67575ff4-ecf0-493a-b07d-0e808f209b23 is backed by 25d16a982d5d81d323c4741bf0fbe9044ec6cec8 {{(pid=74242) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] 7b6701b3-86f5-4498-9b45-24d4f53b6e78 is a valid instance name {{(pid=74242) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] 7b6701b3-86f5-4498-9b45-24d4f53b6e78 has a disk file {{(pid=74242) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 is backed by 25d16a982d5d81d323c4741bf0fbe9044ec6cec8 {{(pid=74242) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] d4ccd900-744b-49d8-a892-897591be031c is a valid instance name {{(pid=74242) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] d4ccd900-744b-49d8-a892-897591be031c has a disk file {{(pid=74242) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d4ccd900-744b-49d8-a892-897591be031c is backed by 25d16a982d5d81d323c4741bf0fbe9044ec6cec8 {{(pid=74242) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] 3d6b9529-656c-45f3-b2de-3d1462751bf1 is a valid instance name {{(pid=74242) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] 3d6b9529-656c-45f3-b2de-3d1462751bf1 has a disk file {{(pid=74242) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 02:38:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:21 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 is backed by 25d16a982d5d81d323c4741bf0fbe9044ec6cec8 {{(pid=74242) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 02:38:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] 2bf62933-66ea-469e-a70e-92184f311110 is a valid instance name {{(pid=74242) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 20 02:38:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] 2bf62933-66ea-469e-a70e-92184f311110 has a disk file {{(pid=74242) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 20 02:38:21 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:21 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 is backed by 25d16a982d5d81d323c4741bf0fbe9044ec6cec8 {{(pid=74242) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 20 02:38:21 user nova-compute[74242]: WARNING nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3
Oct 20 02:38:21 user nova-compute[74242]: WARNING nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd
Oct 20 02:38:21 user nova-compute[74242]: WARNING nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Unknown base file: /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8
Oct 20 02:38:21 user nova-compute[74242]: WARNING nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Unknown base file: /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9
Oct 20 02:38:21 user nova-compute[74242]: WARNING nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Unknown base file: /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e
Oct 20 02:38:21 user nova-compute[74242]: WARNING nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Unknown base file: /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70
Oct 20 02:38:21 user nova-compute[74242]: WARNING nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a4428252a947b26c61e02bb1421900a8e702260f
Oct 20 02:38:21 user nova-compute[74242]: WARNING nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0f749ef091c96ff64e36feb9aff791da1d5db7ee
Oct 20 02:38:21 user nova-compute[74242]: WARNING nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141
Oct 20 02:38:21 user nova-compute[74242]: INFO nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Active base files: /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8
Oct 20 02:38:21 user nova-compute[74242]: INFO nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Removable base files: /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3 /opt/stack/data/nova/instances/_base/0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8 /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9 /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70 /opt/stack/data/nova/instances/_base/a4428252a947b26c61e02bb1421900a8e702260f /opt/stack/data/nova/instances/_base/0f749ef091c96ff64e36feb9aff791da1d5db7ee /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141
Oct 20 02:38:21 user nova-compute[74242]: INFO nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a8fb73c1717975941a7f1b33af14be6461efceb3
Oct 20 02:38:21 user nova-compute[74242]: INFO nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0225792b8c49da6ebf7ba2a526e2e64bc95a6fdd
Oct 20 02:38:21 user nova-compute[74242]: INFO nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/743671fbbbe910bc2946169c292b7ad5cab726e8
Oct 20 02:38:21 user nova-compute[74242]: INFO nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/7f972163cc34eb9c3fddfaf56a9c7638888491c9
Oct 20 02:38:21 user nova-compute[74242]: INFO nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/db50a97e3c82d405a251f3d9b8548591a890c25e
Oct 20 02:38:21 user nova-compute[74242]: INFO nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/37b8d083f2dab0a6da94aa392cdb99e42f104d70
Oct 20 02:38:21 user nova-compute[74242]: INFO nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a4428252a947b26c61e02bb1421900a8e702260f
Oct 20 02:38:21 user nova-compute[74242]: INFO nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0f749ef091c96ff64e36feb9aff791da1d5db7ee
Oct 20 02:38:21 user nova-compute[74242]: INFO nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b1aa7131b38ea7a2d0a654bdf762566b17d13141
Oct 20 02:38:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Verification complete {{(pid=74242) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 20 02:38:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Verify swap images {{(pid=74242) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 20 02:38:21 user nova-compute[74242]: DEBUG nova.virt.libvirt.imagecache [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Verify ephemeral images {{(pid=74242) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 20 02:38:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:35 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance d4ccd900-744b-49d8-a892-897591be031c is timed out.
Oct 20 02:38:35 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Successfully detached device vdb from instance d4ccd900-744b-49d8-a892-897591be031c from the live domain config.
Oct 20 02:38:35 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:38:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QuqrxNAW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:38:35 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:38:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:38:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:38:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b48a39d-2440-45a1-bce5-8c7726f28d6f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:38:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:38:35 user nova-compute[74242]: No targets found.
Oct 20 02:38:35 user nova-compute[74242]: iSNS:
Oct 20 02:38:35 user nova-compute[74242]: No targets found.
Oct 20 02:38:35 user nova-compute[74242]: STATIC:
Oct 20 02:38:35 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701
Oct 20 02:38:35 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:38:35 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:38:35 user nova-compute[74242]: FIRMWARE:
Oct 20 02:38:35 user nova-compute[74242]: No targets found.
Oct 20 02:38:35 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:38:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:38:35 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:38:35 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:38:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:38:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d41329f5-6944-4cd2-bab6-87a950b713e6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b600fcc4-5db5-46c1-b558-7205980a4023]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:38:36 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 (non-flash)
Oct 20 02:38:36 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b84d5d80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701'): ({'sdc'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Removing single pathed devices sdc {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6da4ae-624c-49da-97b7-6ee8653b3a75]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07d841d-df48-4356-8000-0d1be5bab858]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Flushing IO for device /dev/sdc {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc0f8c6-64e3-4ce3-b5da-aaf3788c3626]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f4409b6-0a62-4769-8348-82be3b6ce944]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a60f96d-01f0-4152-a9f3-cf811e7a9d8b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[35da58cf-869f-424f-99b0-93450342e2ed]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701, portal: 172.16.0.220,3260]
Oct 20 02:38:36 user nova-compute[74242]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701, portal: 172.16.0.220,3260] successful.
Oct 20 02:38:36 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e08be8b8-bdca-492d-a95d-4a497b160701 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba04c39-d518-4f45-ab47-b1091b87b0c6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] <== disconnect_volume: return (280ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:38:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:38:37 user nova-compute[74242]: DEBUG nova.objects.instance [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'flavor' on Instance uuid d4ccd900-744b-49d8-a892-897591be031c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:38:37 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-fd7e4f46-15cc-4741-a489-210d70c2b298 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "d4ccd900-744b-49d8-a892-897591be031c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.664s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:38:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-995c6984-311a-4f35-9371-7a92a6040389 req-08abe7b4-9ca9-4ddc-a773-cb35fdab747b service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Received event network-changed-7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:38:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-995c6984-311a-4f35-9371-7a92a6040389 req-08abe7b4-9ca9-4ddc-a773-cb35fdab747b service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Refreshing instance network info cache due to event network-changed-7ea2f019-bafe-4b3a-a937-17d367233bc6. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:38:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-995c6984-311a-4f35-9371-7a92a6040389 req-08abe7b4-9ca9-4ddc-a773-cb35fdab747b service nova] Acquiring lock "refresh_cache-67575ff4-ecf0-493a-b07d-0e808f209b23" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:38:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-995c6984-311a-4f35-9371-7a92a6040389 req-08abe7b4-9ca9-4ddc-a773-cb35fdab747b service nova] Acquired lock "refresh_cache-67575ff4-ecf0-493a-b07d-0e808f209b23" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:38:47 user nova-compute[74242]: DEBUG nova.network.neutron [req-995c6984-311a-4f35-9371-7a92a6040389 req-08abe7b4-9ca9-4ddc-a773-cb35fdab747b service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Refreshing network info cache for port 7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:38:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "67575ff4-ecf0-493a-b07d-0e808f209b23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:38:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:38:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "67575ff4-ecf0-493a-b07d-0e808f209b23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:38:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:38:47 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:38:47 user nova-compute[74242]: INFO nova.compute.manager [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Terminating instance
Oct 20 02:38:47 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:38:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Instance destroyed successfully.
Oct 20 02:38:48 user nova-compute[74242]: DEBUG nova.objects.instance [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lazy-loading 'resources' on Instance uuid 67575ff4-ecf0-493a-b07d-0e808f209b23 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:31:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-525730713',display_name='tempest-TestStampPattern-server-525730713',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-525730713',id=44,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKYGIAL3BPbNRP/f8TTaaS+fRSqiqmwNAp8S9LYWbQcGSs8gpOlmyAN8s6c1MVpMgmvgEs1210r1izyM79vKpMSRksL+RI4OA1L+LaWwUc2PcO3Orr5NlrQNvhE5JyjJpg==',key_name='tempest-TestStampPattern-200219955',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:31:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d2982c9c65e548478739144ba83306ea',ramdisk_id='',reservation_id='r-nxukjbk5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1416614973',owner_user_name='tempest-TestStampPattern-1416614973-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:34:32Z,user_data=None,user_id='ebacf16af7234540acea291a74a1b68d',uuid=67575ff4-ecf0-493a-b07d-0e808f209b23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "address": "fa:16:3e:75:e6:79", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea2f019-ba", "ovs_interfaceid": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Converting VIF {"id": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "address": "fa:16:3e:75:e6:79", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.40", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea2f019-ba", "ovs_interfaceid": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:e6:79,bridge_name='br-int',has_traffic_filtering=True,id=7ea2f019-bafe-4b3a-a937-17d367233bc6,network=Network(4bfd9e0b-6a72-45b3-9618-8c8b91bb3604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea2f019-ba') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG os_vif [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:e6:79,bridge_name='br-int',has_traffic_filtering=True,id=7ea2f019-bafe-4b3a-a937-17d367233bc6,network=Network(4bfd9e0b-6a72-45b3-9618-8c8b91bb3604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea2f019-ba') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7ea2f019-ba, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0aca9085-b205-40f0-a8c5-64f7201f3eef) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:48 user nova-compute[74242]: INFO os_vif [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:e6:79,bridge_name='br-int',has_traffic_filtering=True,id=7ea2f019-bafe-4b3a-a937-17d367233bc6,network=Network(4bfd9e0b-6a72-45b3-9618-8c8b91bb3604),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ea2f019-ba')
Oct 20 02:38:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Deleting instance files /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23_del
Oct 20 02:38:48 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Deletion of /opt/stack/data/nova/instances/67575ff4-ecf0-493a-b07d-0e808f209b23_del complete
Oct 20 02:38:48 user nova-compute[74242]: DEBUG nova.network.neutron [req-995c6984-311a-4f35-9371-7a92a6040389 req-08abe7b4-9ca9-4ddc-a773-cb35fdab747b service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Updated VIF entry in instance network info cache for port 7ea2f019-bafe-4b3a-a937-17d367233bc6. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG nova.network.neutron [req-995c6984-311a-4f35-9371-7a92a6040389 req-08abe7b4-9ca9-4ddc-a773-cb35fdab747b service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Updating instance_info_cache with network_info: [{"id": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "address": "fa:16:3e:75:e6:79", "network": {"id": "4bfd9e0b-6a72-45b3-9618-8c8b91bb3604", "bridge": "br-int", "label": "tempest-TestStampPattern-1275622150-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d2982c9c65e548478739144ba83306ea", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ea2f019-ba", "ovs_interfaceid": "7ea2f019-bafe-4b3a-a937-17d367233bc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-995c6984-311a-4f35-9371-7a92a6040389 req-08abe7b4-9ca9-4ddc-a773-cb35fdab747b service nova] Releasing lock "refresh_cache-67575ff4-ecf0-493a-b07d-0e808f209b23" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:38:48 user nova-compute[74242]: INFO nova.compute.manager [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Took 0.67 seconds to destroy the instance on the hypervisor.
Oct 20 02:38:48 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:38:48 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Took 0.47 seconds to deallocate network for instance.
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-6927d7fd-dd0f-4f76-b879-48e462656125 req-86b21917-9a27-428a-ad6f-ad2c24f9c016 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Received event network-vif-deleted-7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:38:48 user nova-compute[74242]: INFO nova.compute.manager [req-6927d7fd-dd0f-4f76-b879-48e462656125 req-86b21917-9a27-428a-ad6f-ad2c24f9c016 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Neutron deleted interface 7ea2f019-bafe-4b3a-a937-17d367233bc6; detaching it from the instance and deleting it from the info cache
Oct 20 02:38:48 user nova-compute[74242]: DEBUG nova.network.neutron [req-6927d7fd-dd0f-4f76-b879-48e462656125 req-86b21917-9a27-428a-ad6f-ad2c24f9c016 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:38:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-6927d7fd-dd0f-4f76-b879-48e462656125 req-86b21917-9a27-428a-ad6f-ad2c24f9c016 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Detach interface failed, port_id=7ea2f019-bafe-4b3a-a937-17d367233bc6, reason: Instance 67575ff4-ecf0-493a-b07d-0e808f209b23 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:38:49 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Deleted allocations for instance 67575ff4-ecf0-493a-b07d-0e808f209b23
Oct 20 02:38:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b91e58cd-998e-43ad-80d6-e8c4f701cc62 tempest-TestStampPattern-1416614973 tempest-TestStampPattern-1416614973-project-member] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.571s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-a92ac98f-5a9b-4097-9f0b-566d62affb80 req-7165ae81-8d87-4552-bbb5-873b82a20dc6 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Received event network-vif-unplugged-7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a92ac98f-5a9b-4097-9f0b-566d62affb80 req-7165ae81-8d87-4552-bbb5-873b82a20dc6 service nova] Acquiring lock "67575ff4-ecf0-493a-b07d-0e808f209b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a92ac98f-5a9b-4097-9f0b-566d62affb80 req-7165ae81-8d87-4552-bbb5-873b82a20dc6 service nova] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a92ac98f-5a9b-4097-9f0b-566d62affb80 req-7165ae81-8d87-4552-bbb5-873b82a20dc6 service nova] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-a92ac98f-5a9b-4097-9f0b-566d62affb80 req-7165ae81-8d87-4552-bbb5-873b82a20dc6 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] No waiting events found dispatching network-vif-unplugged-7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:38:49 user nova-compute[74242]: WARNING nova.compute.manager [req-a92ac98f-5a9b-4097-9f0b-566d62affb80 req-7165ae81-8d87-4552-bbb5-873b82a20dc6 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Received unexpected event network-vif-unplugged-7ea2f019-bafe-4b3a-a937-17d367233bc6 for instance with vm_state deleted and task_state None.
Oct 20 02:38:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-a92ac98f-5a9b-4097-9f0b-566d62affb80 req-7165ae81-8d87-4552-bbb5-873b82a20dc6 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Received event network-vif-plugged-7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a92ac98f-5a9b-4097-9f0b-566d62affb80 req-7165ae81-8d87-4552-bbb5-873b82a20dc6 service nova] Acquiring lock "67575ff4-ecf0-493a-b07d-0e808f209b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a92ac98f-5a9b-4097-9f0b-566d62affb80 req-7165ae81-8d87-4552-bbb5-873b82a20dc6 service nova] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a92ac98f-5a9b-4097-9f0b-566d62affb80 req-7165ae81-8d87-4552-bbb5-873b82a20dc6 service nova] Lock "67575ff4-ecf0-493a-b07d-0e808f209b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:38:49 user nova-compute[74242]: DEBUG nova.compute.manager [req-a92ac98f-5a9b-4097-9f0b-566d62affb80 req-7165ae81-8d87-4552-bbb5-873b82a20dc6 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] No waiting events found dispatching network-vif-plugged-7ea2f019-bafe-4b3a-a937-17d367233bc6 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:38:49 user nova-compute[74242]: WARNING nova.compute.manager [req-a92ac98f-5a9b-4097-9f0b-566d62affb80 req-7165ae81-8d87-4552-bbb5-873b82a20dc6 service nova] [instance: 67575ff4-ecf0-493a-b07d-0e808f209b23] Received unexpected event network-vif-plugged-7ea2f019-bafe-4b3a-a937-17d367233bc6 for instance with vm_state deleted and task_state None.
Oct 20 02:38:50 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:38:53 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:38:53 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:38:53 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:38:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:38:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:38:53 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:38:53 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Updating instance_info_cache with network_info: [{"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:38:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-7b6701b3-86f5-4498-9b45-24d4f53b6e78" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:38:53 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:38:56 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:38:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:38:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:38:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:38:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:38:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:38:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:38:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:00 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:39:02 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:39:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:39:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:39:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:39:02 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:39:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:39:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:39:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:39:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:39:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:39:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:39:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:39:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:39:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:39:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:39:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:39:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:39:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:39:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:39:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:39:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:39:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:39:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:39:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:39:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:39:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:39:04 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:39:04 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:39:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8725MB free_disk=24.843971252441406GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:39:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:39:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance d4ccd900-744b-49d8-a892-897591be031c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing inventories for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Updating ProviderTree inventory for provider 07b40460-b6ac-48c1-8447-e1778d50b26e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Updating inventory in ProviderTree for provider 07b40460-b6ac-48c1-8447-e1778d50b26e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing aggregate associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, aggregates: None {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing trait associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.689s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "d4ccd900-744b-49d8-a892-897591be031c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:39:05 user nova-compute[74242]: INFO nova.compute.manager [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Terminating instance
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.objects.instance [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'flavor' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquired lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.network.neutron [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.objects.instance [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'info_cache' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.objects.base [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Object Instance<3d6b9529-656c-45f3-b2de-3d1462751bf1> lazy-loaded attributes: flavor,info_cache {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-6dbaa7bd-76c8-4eb7-8103-94ed98630f75 req-9ca03213-359f-46c1-9371-a9443da71c70 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-vif-unplugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6dbaa7bd-76c8-4eb7-8103-94ed98630f75 req-9ca03213-359f-46c1-9371-a9443da71c70 service nova] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6dbaa7bd-76c8-4eb7-8103-94ed98630f75 req-9ca03213-359f-46c1-9371-a9443da71c70 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6dbaa7bd-76c8-4eb7-8103-94ed98630f75 req-9ca03213-359f-46c1-9371-a9443da71c70 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-6dbaa7bd-76c8-4eb7-8103-94ed98630f75 req-9ca03213-359f-46c1-9371-a9443da71c70 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] No waiting events found dispatching network-vif-unplugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:39:05 user nova-compute[74242]: DEBUG nova.compute.manager [req-6dbaa7bd-76c8-4eb7-8103-94ed98630f75 req-9ca03213-359f-46c1-9371-a9443da71c70 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-vif-unplugged-7e3b7bad-876a-447a-85da-4e5f501f7870 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.network.neutron [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Updating instance_info_cache with network_info: [{"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Releasing lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:39:06 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Instance destroyed successfully.
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.objects.instance [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'resources' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.objects.base [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Object Instance<3d6b9529-656c-45f3-b2de-3d1462751bf1> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:30:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-907928236',display_name='tempest-AttachVolumeTestJSON-server-907928236',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-907928236',id=43,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+0C/EZq6BwMh+3wZbZgOw2m/JxCkcxWd9X6nujGwGDyr2EQvBu4YlJy6mRVBvBdc8CsjVHXkTNJTlT3+WS0iTSYuJCsZzoNxpr4cYb9sE8zXfgoepdKDpiPTJ/nXqUhw==',key_name='tempest-keypair-788125581',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:30:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='86bf4c560c2a4a078d0f43aae70d4fd3',ramdisk_id='',reservation_id='r-30ipsrv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-47724960',owner_user_name='tempest-AttachVolumeTestJSON-47724960-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61536bdce5184c989843cc225dd547a0',uuid=3d6b9529-656c-45f3-b2de-3d1462751bf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converting VIF {"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG os_vif [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap957c2a1b-2b, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21011dc5-29b7-4643-9332-2c70e8f98f75) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:06 user nova-compute[74242]: INFO os_vif [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b')
Oct 20 02:39:06 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: d4ccd900-744b-49d8-a892-897591be031c] Instance destroyed successfully.
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'resources' on Instance uuid d4ccd900-744b-49d8-a892-897591be031c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Start _get_guest_xml network_info=[{"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.objects.instance [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'numa_topology' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:32:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-152224677',display_name='tempest-ServerRescueNegativeTestJSON-server-152224677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-152224677',id=45,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE9Mtlxvqlj1pE6vYvPdL1UdNCYZPX0lT8au15a5bX8mGhRxSjUvSnM8xuUjtjZDzFHL1AQVy9cO5NTiAIkYEV8cAWKKCHrUdE3NaT8luGUIzQMGdmnKDEEYl1FHNnaQHw==',key_name='tempest-keypair-62369157',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:34:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80fa40dfb2c84a84b3399b643fcde4c5',ramdisk_id='',reservation_id='r-ka1vb9ny',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-630282540',owner_user_name='tempest-ServerRescueNegativeTestJSON-630282540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:36:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c7a7db373740428d89dcda898a04410c',uuid=d4ccd900-744b-49d8-a892-897591be031c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converting VIF {"id": "7e3b7bad-876a-447a-85da-4e5f501f7870", "address": "fa:16:3e:a6:22:b6", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e3b7bad-87", "ovs_interfaceid": "7e3b7bad-876a-447a-85da-4e5f501f7870", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a6:22:b6,bridge_name='br-int',has_traffic_filtering=True,id=7e3b7bad-876a-447a-85da-4e5f501f7870,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3b7bad-87') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG os_vif [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:22:b6,bridge_name='br-int',has_traffic_filtering=True,id=7e3b7bad-876a-447a-85da-4e5f501f7870,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3b7bad-87') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.objects.base [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Object Instance<3d6b9529-656c-45f3-b2de-3d1462751bf1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e3b7bad-87, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=88b4fa43-a05c-4bf6-b9d3-11138357cc4b) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:39:06 user nova-compute[74242]: INFO os_vif [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a6:22:b6,bridge_name='br-int',has_traffic_filtering=True,id=7e3b7bad-876a-447a-85da-4e5f501f7870,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e3b7bad-87')
Oct 20 02:39:06 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Deleting instance files /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c_del
Oct 20 02:39:06 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Deletion of /opt/stack/data/nova/instances/d4ccd900-744b-49d8-a892-897591be031c_del complete
Oct 20 02:39:06 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:39:06 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.objects.instance [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.objects.base [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Object Instance<3d6b9529-656c-45f3-b2de-3d1462751bf1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:30:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-907928236',display_name='tempest-AttachVolumeTestJSON-server-907928236',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-907928236',id=43,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+0C/EZq6BwMh+3wZbZgOw2m/JxCkcxWd9X6nujGwGDyr2EQvBu4YlJy6mRVBvBdc8CsjVHXkTNJTlT3+WS0iTSYuJCsZzoNxpr4cYb9sE8zXfgoepdKDpiPTJ/nXqUhw==',key_name='tempest-keypair-788125581',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:30:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='86bf4c560c2a4a078d0f43aae70d4fd3',ramdisk_id='',reservation_id='r-30ipsrv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-47724960',owner_user_name='tempest-AttachVolumeTestJSON-47724960-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61536bdce5184c989843cc225dd547a0',uuid=3d6b9529-656c-45f3-b2de-3d1462751bf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converting VIF {"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.objects.instance [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.objects.base [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Object Instance<3d6b9529-656c-45f3-b2de-3d1462751bf1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:39:06 user nova-compute[74242]:   <uuid>3d6b9529-656c-45f3-b2de-3d1462751bf1</uuid>
Oct 20 02:39:06 user nova-compute[74242]:   <name>instance-0000002b</name>
Oct 20 02:39:06 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:39:06 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:39:06 user nova-compute[74242]:   <metadata>
Oct 20 02:39:06 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:39:06 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:39:06 user nova-compute[74242]:       <nova:name>tempest-AttachVolumeTestJSON-server-907928236</nova:name>
Oct 20 02:39:06 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:39:06</nova:creationTime>
Oct 20 02:39:06 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:39:06 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:39:06 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:39:06 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:39:06 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:39:06 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:39:06 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:39:06 user nova-compute[74242]:       <nova:owner>
Oct 20 02:39:06 user nova-compute[74242]:         <nova:user uuid="61536bdce5184c989843cc225dd547a0">tempest-AttachVolumeTestJSON-47724960-project-member</nova:user>
Oct 20 02:39:06 user nova-compute[74242]:         <nova:project uuid="86bf4c560c2a4a078d0f43aae70d4fd3">tempest-AttachVolumeTestJSON-47724960</nova:project>
Oct 20 02:39:06 user nova-compute[74242]:       </nova:owner>
Oct 20 02:39:06 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:39:06 user nova-compute[74242]:       <nova:ports>
Oct 20 02:39:06 user nova-compute[74242]:         <nova:port uuid="957c2a1b-2b78-47c9-8e79-fc8ce92755ec">
Oct 20 02:39:06 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 20 02:39:06 user nova-compute[74242]:         </nova:port>
Oct 20 02:39:06 user nova-compute[74242]:       </nova:ports>
Oct 20 02:39:06 user nova-compute[74242]:     </nova:instance>
Oct 20 02:39:06 user nova-compute[74242]:   </metadata>
Oct 20 02:39:06 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:39:06 user nova-compute[74242]:     <system>
Oct 20 02:39:06 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:39:06 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:39:06 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:39:06 user nova-compute[74242]:       <entry name="serial">3d6b9529-656c-45f3-b2de-3d1462751bf1</entry>
Oct 20 02:39:06 user nova-compute[74242]:       <entry name="uuid">3d6b9529-656c-45f3-b2de-3d1462751bf1</entry>
Oct 20 02:39:06 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:39:06 user nova-compute[74242]:     </system>
Oct 20 02:39:06 user nova-compute[74242]:   </sysinfo>
Oct 20 02:39:06 user nova-compute[74242]:   <os>
Oct 20 02:39:06 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:39:06 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:39:06 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:39:06 user nova-compute[74242]:   </os>
Oct 20 02:39:06 user nova-compute[74242]:   <features>
Oct 20 02:39:06 user nova-compute[74242]:     <acpi/>
Oct 20 02:39:06 user nova-compute[74242]:     <apic/>
Oct 20 02:39:06 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:39:06 user nova-compute[74242]:   </features>
Oct 20 02:39:06 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:39:06 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:39:06 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:39:06 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:39:06 user nova-compute[74242]:   </clock>
Oct 20 02:39:06 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:39:06 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:39:06 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:39:06 user nova-compute[74242]:   </cpu>
Oct 20 02:39:06 user nova-compute[74242]:   <devices>
Oct 20 02:39:06 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:39:06 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:39:06 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk"/>
Oct 20 02:39:06 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:39:06 user nova-compute[74242]:     </disk>
Oct 20 02:39:06 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:39:06 user nova-compute[74242]:       <mac address="fa:16:3e:87:ef:3f"/>
Oct 20 02:39:06 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:39:06 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:39:06 user nova-compute[74242]:       <target dev="tap957c2a1b-2b"/>
Oct 20 02:39:06 user nova-compute[74242]:     </interface>
Oct 20 02:39:06 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:39:06 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/console.log" append="off"/>
Oct 20 02:39:06 user nova-compute[74242]:     </serial>
Oct 20 02:39:06 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:39:06 user nova-compute[74242]:     <video>
Oct 20 02:39:06 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:39:06 user nova-compute[74242]:     </video>
Oct 20 02:39:06 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:39:06 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:39:06 user nova-compute[74242]:     </rng>
Oct 20 02:39:06 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:39:06 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:39:06 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:39:06 user nova-compute[74242]:     </memballoon>
Oct 20 02:39:06 user nova-compute[74242]:   </devices>
Oct 20 02:39:06 user nova-compute[74242]: </domain>
Oct 20 02:39:06 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:39:06 user nova-compute[74242]: INFO nova.compute.manager [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: d4ccd900-744b-49d8-a892-897591be031c] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 20 02:39:06 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: d4ccd900-744b-49d8-a892-897591be031c] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: d4ccd900-744b-49d8-a892-897591be031c] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:39:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG nova.objects.instance [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG nova.objects.base [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Object Instance<3d6b9529-656c-45f3-b2de-3d1462751bf1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.188s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-262611df-a11d-407a-8dc6-9346aba9b67a req-c5e5e3cd-99f2-4f72-bc45-43623f5d055d service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-vif-deleted-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:39:07 user nova-compute[74242]: INFO nova.compute.manager [req-262611df-a11d-407a-8dc6-9346aba9b67a req-c5e5e3cd-99f2-4f72-bc45-43623f5d055d service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Neutron deleted interface 7e3b7bad-876a-447a-85da-4e5f501f7870; detaching it from the instance and deleting it from the info cache
Oct 20 02:39:07 user nova-compute[74242]: DEBUG nova.network.neutron [req-262611df-a11d-407a-8dc6-9346aba9b67a req-c5e5e3cd-99f2-4f72-bc45-43623f5d055d service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:39:07 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: d4ccd900-744b-49d8-a892-897591be031c] Took 0.73 seconds to deallocate network for instance.
Oct 20 02:39:07 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Cannot resize image /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG nova.objects.instance [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'migration_context' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG nova.objects.base [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Object Instance<3d6b9529-656c-45f3-b2de-3d1462751bf1> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:30:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-907928236',display_name='tempest-AttachVolumeTestJSON-server-907928236',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-907928236',id=43,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+0C/EZq6BwMh+3wZbZgOw2m/JxCkcxWd9X6nujGwGDyr2EQvBu4YlJy6mRVBvBdc8CsjVHXkTNJTlT3+WS0iTSYuJCsZzoNxpr4cYb9sE8zXfgoepdKDpiPTJ/nXqUhw==',key_name='tempest-keypair-788125581',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:30:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='86bf4c560c2a4a078d0f43aae70d4fd3',ramdisk_id='',reservation_id='r-30ipsrv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-47724960',owner_user_name='tempest-AttachVolumeTestJSON-47724960-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61536bdce5184c989843cc225dd547a0',uuid=3d6b9529-656c-45f3-b2de-3d1462751bf1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converting VIF {"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG os_vif [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ddbdf184-6f1c-5709-b95b-4ab3b01f1226', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-262611df-a11d-407a-8dc6-9346aba9b67a req-c5e5e3cd-99f2-4f72-bc45-43623f5d055d service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Detach interface failed, port_id=7e3b7bad-876a-447a-85da-4e5f501f7870, reason: Instance d4ccd900-744b-49d8-a892-897591be031c could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap957c2a1b-2b, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap957c2a1b-2b, col_values=(('qos', UUID('6d89ebb9-a438-4859-a557-804f1aa0bbcc')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap957c2a1b-2b, col_values=(('external_ids', {'iface-id': '957c2a1b-2b78-47c9-8e79-fc8ce92755ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:87:ef:3f', 'vm-uuid': '3d6b9529-656c-45f3-b2de-3d1462751bf1'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:07 user nova-compute[74242]: INFO os_vif [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b')
Oct 20 02:39:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:39:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.190s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:39:07 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Deleted allocations for instance d4ccd900-744b-49d8-a892-897591be031c
Oct 20 02:39:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8e69d199-036a-4eac-abc7-c55c234f3d12 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "d4ccd900-744b-49d8-a892-897591be031c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.020s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:39:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-a808ec74-0078-44fc-ac8b-eb6fa50a07e7 req-8c592c6b-d830-464e-adea-baee213ff217 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:39:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a808ec74-0078-44fc-ac8b-eb6fa50a07e7 req-8c592c6b-d830-464e-adea-baee213ff217 service nova] Acquiring lock "d4ccd900-744b-49d8-a892-897591be031c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:39:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a808ec74-0078-44fc-ac8b-eb6fa50a07e7 req-8c592c6b-d830-464e-adea-baee213ff217 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:39:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a808ec74-0078-44fc-ac8b-eb6fa50a07e7 req-8c592c6b-d830-464e-adea-baee213ff217 service nova] Lock "d4ccd900-744b-49d8-a892-897591be031c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:39:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-a808ec74-0078-44fc-ac8b-eb6fa50a07e7 req-8c592c6b-d830-464e-adea-baee213ff217 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] No waiting events found dispatching network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:39:08 user nova-compute[74242]: WARNING nova.compute.manager [req-a808ec74-0078-44fc-ac8b-eb6fa50a07e7 req-8c592c6b-d830-464e-adea-baee213ff217 service nova] [instance: d4ccd900-744b-49d8-a892-897591be031c] Received unexpected event network-vif-plugged-7e3b7bad-876a-447a-85da-4e5f501f7870 for instance with vm_state deleted and task_state None.
Oct 20 02:39:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:09 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:39:09 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:39:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:09 user nova-compute[74242]: DEBUG nova.compute.manager [req-6820341f-6938-4607-9023-aed713c9d3d7 req-21b5483b-4b2c-4d8b-8032-a361097eba5d service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:39:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6820341f-6938-4607-9023-aed713c9d3d7 req-21b5483b-4b2c-4d8b-8032-a361097eba5d service nova] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:39:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6820341f-6938-4607-9023-aed713c9d3d7 req-21b5483b-4b2c-4d8b-8032-a361097eba5d service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:39:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6820341f-6938-4607-9023-aed713c9d3d7 req-21b5483b-4b2c-4d8b-8032-a361097eba5d service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:39:09 user nova-compute[74242]: DEBUG nova.compute.manager [req-6820341f-6938-4607-9023-aed713c9d3d7 req-21b5483b-4b2c-4d8b-8032-a361097eba5d service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] No waiting events found dispatching network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:39:09 user nova-compute[74242]: WARNING nova.compute.manager [req-6820341f-6938-4607-9023-aed713c9d3d7 req-21b5483b-4b2c-4d8b-8032-a361097eba5d service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received unexpected event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec for instance with vm_state stopped and task_state powering-on.
Oct 20 02:39:09 user nova-compute[74242]: DEBUG nova.compute.manager [req-6820341f-6938-4607-9023-aed713c9d3d7 req-21b5483b-4b2c-4d8b-8032-a361097eba5d service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:39:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6820341f-6938-4607-9023-aed713c9d3d7 req-21b5483b-4b2c-4d8b-8032-a361097eba5d service nova] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:39:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6820341f-6938-4607-9023-aed713c9d3d7 req-21b5483b-4b2c-4d8b-8032-a361097eba5d service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:39:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-6820341f-6938-4607-9023-aed713c9d3d7 req-21b5483b-4b2c-4d8b-8032-a361097eba5d service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:39:09 user nova-compute[74242]: DEBUG nova.compute.manager [req-6820341f-6938-4607-9023-aed713c9d3d7 req-21b5483b-4b2c-4d8b-8032-a361097eba5d service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] No waiting events found dispatching network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:39:09 user nova-compute[74242]: WARNING nova.compute.manager [req-6820341f-6938-4607-9023-aed713c9d3d7 req-21b5483b-4b2c-4d8b-8032-a361097eba5d service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received unexpected event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec for instance with vm_state stopped and task_state powering-on.
Oct 20 02:39:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:10 user nova-compute[74242]: DEBUG nova.compute.manager [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:39:10 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Instance rebooted successfully.
Oct 20 02:39:10 user nova-compute[74242]: DEBUG nova.compute.manager [None req-725150b7-aa47-47c1-8641-4fc318b510f4 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:39:12 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:39:12 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 02:39:12 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] There are 0 instances to clean {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 02:39:12 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:39:12 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74242) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 02:39:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:16 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:39:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:51 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:39:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:39:53 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:39:53 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:39:53 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:39:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:39:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:39:53 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:39:54 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Updating instance_info_cache with network_info: [{"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:39:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-3d6b9529-656c-45f3-b2de-3d1462751bf1" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:39:54 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:39:56 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:39:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:39:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:01 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:40:02 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:40:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:40:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:40:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:40:02 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:40:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:40:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:40:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:40:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:40:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:40:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:40:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:40:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:40:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:40:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:40:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:40:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:40:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:40:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:40:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:40:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:40:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:40:04 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:40:04 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:40:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8764MB free_disk=24.869705200195312GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:40:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:40:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:40:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:40:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:40:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 3d6b9529-656c-45f3-b2de-3d1462751bf1 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:40:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:40:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:40:04 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:40:04 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:40:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:40:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.294s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:40:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:40:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:40:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:40:10 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:40:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:40:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:40:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:40:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:40:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:40:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:40:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:40:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:40:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:40:15 user nova-compute[74242]: INFO nova.compute.manager [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Terminating instance
Oct 20 02:40:15 user nova-compute[74242]: DEBUG nova.compute.manager [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:40:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-71c985f6-de04-4b24-a701-be7d9c0c4973 req-a118235c-eb3e-476e-b538-e96ae4ab6dbd service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received event network-vif-unplugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:40:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-71c985f6-de04-4b24-a701-be7d9c0c4973 req-a118235c-eb3e-476e-b538-e96ae4ab6dbd service nova] Acquiring lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:40:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-71c985f6-de04-4b24-a701-be7d9c0c4973 req-a118235c-eb3e-476e-b538-e96ae4ab6dbd service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:40:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-71c985f6-de04-4b24-a701-be7d9c0c4973 req-a118235c-eb3e-476e-b538-e96ae4ab6dbd service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:40:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-71c985f6-de04-4b24-a701-be7d9c0c4973 req-a118235c-eb3e-476e-b538-e96ae4ab6dbd service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] No waiting events found dispatching network-vif-unplugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:40:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-71c985f6-de04-4b24-a701-be7d9c0c4973 req-a118235c-eb3e-476e-b538-e96ae4ab6dbd service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received event network-vif-unplugged-3071aff4-dceb-4a18-891e-f189d558cba7 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:40:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:16 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Instance destroyed successfully.
Oct 20 02:40:16 user nova-compute[74242]: DEBUG nova.objects.instance [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'resources' on Instance uuid 7b6701b3-86f5-4498-9b45-24d4f53b6e78 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:23:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-798886193',display_name='tempest-ServerRescueNegativeTestJSON-server-798886193',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-798886193',id=38,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:25:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80fa40dfb2c84a84b3399b643fcde4c5',ramdisk_id='',reservation_id='r-hl80a7sf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-630282540',owner_user_name='tempest-ServerRescueNegativeTestJSON-630282540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:25:40Z,user_data=None,user_id='c7a7db373740428d89dcda898a04410c',uuid=7b6701b3-86f5-4498-9b45-24d4f53b6e78,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converting VIF {"id": "3071aff4-dceb-4a18-891e-f189d558cba7", "address": "fa:16:3e:e4:a3:fd", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3071aff4-dc", "ovs_interfaceid": "3071aff4-dceb-4a18-891e-f189d558cba7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e4:a3:fd,bridge_name='br-int',has_traffic_filtering=True,id=3071aff4-dceb-4a18-891e-f189d558cba7,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3071aff4-dc') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG os_vif [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:a3:fd,bridge_name='br-int',has_traffic_filtering=True,id=3071aff4-dceb-4a18-891e-f189d558cba7,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3071aff4-dc') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3071aff4-dc, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ce08b1e-6e0e-4286-b12d-a98a6dbea3a6) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:40:16 user nova-compute[74242]: INFO os_vif [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e4:a3:fd,bridge_name='br-int',has_traffic_filtering=True,id=3071aff4-dceb-4a18-891e-f189d558cba7,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3071aff4-dc')
Oct 20 02:40:16 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Deleting instance files /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78_del
Oct 20 02:40:16 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Deletion of /opt/stack/data/nova/instances/7b6701b3-86f5-4498-9b45-24d4f53b6e78_del complete
Oct 20 02:40:16 user nova-compute[74242]: INFO nova.compute.manager [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 20 02:40:16 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:40:16 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Took 0.44 seconds to deallocate network for instance.
Oct 20 02:40:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-735c56c2-c9d0-4993-bf2e-74f6b860440a req-c56315a5-6aef-4a3c-8bca-e0d349790588 service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received event network-vif-deleted-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:40:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.157s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:40:16 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Deleted allocations for instance 7b6701b3-86f5-4498-9b45-24d4f53b6e78
Oct 20 02:40:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cdd26ede-e310-47f6-b03e-1f4355115c09 tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.700s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:40:17 user nova-compute[74242]: DEBUG nova.compute.manager [req-04f2127d-12a3-4ed6-a9d7-0352abd11733 req-7779bdae-23d5-4a4b-9080-68e1eec1066c service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received event network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:40:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-04f2127d-12a3-4ed6-a9d7-0352abd11733 req-7779bdae-23d5-4a4b-9080-68e1eec1066c service nova] Acquiring lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:40:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-04f2127d-12a3-4ed6-a9d7-0352abd11733 req-7779bdae-23d5-4a4b-9080-68e1eec1066c service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:40:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-04f2127d-12a3-4ed6-a9d7-0352abd11733 req-7779bdae-23d5-4a4b-9080-68e1eec1066c service nova] Lock "7b6701b3-86f5-4498-9b45-24d4f53b6e78-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:40:17 user nova-compute[74242]: DEBUG nova.compute.manager [req-04f2127d-12a3-4ed6-a9d7-0352abd11733 req-7779bdae-23d5-4a4b-9080-68e1eec1066c service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] No waiting events found dispatching network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:40:17 user nova-compute[74242]: WARNING nova.compute.manager [req-04f2127d-12a3-4ed6-a9d7-0352abd11733 req-7779bdae-23d5-4a4b-9080-68e1eec1066c service nova] [instance: 7b6701b3-86f5-4498-9b45-24d4f53b6e78] Received unexpected event network-vif-plugged-3071aff4-dceb-4a18-891e-f189d558cba7 for instance with vm_state deleted and task_state None.
Oct 20 02:40:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:40:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:40:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:40:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:40:41 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:40:41 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 2bf62933-66ea-469e-a70e-92184f311110 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:40:41 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:40:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:40:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "2bf62933-66ea-469e-a70e-92184f311110" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:40:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:40:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:40:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "2bf62933-66ea-469e-a70e-92184f311110" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:40:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:40:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:40:53 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:40:55 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:40:55 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:40:55 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:40:55 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Didn't find any instances for network info cache update. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 02:40:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:40:57 user nova-compute[74242]: INFO nova.compute.manager [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Terminating instance
Oct 20 02:40:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-f9fe8b7e-84d4-4a3f-b93a-eac37363cc0a req-b1c1384d-2b2a-474a-a3ff-efd2ea2622f1 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-vif-unplugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f9fe8b7e-84d4-4a3f-b93a-eac37363cc0a req-b1c1384d-2b2a-474a-a3ff-efd2ea2622f1 service nova] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f9fe8b7e-84d4-4a3f-b93a-eac37363cc0a req-b1c1384d-2b2a-474a-a3ff-efd2ea2622f1 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-f9fe8b7e-84d4-4a3f-b93a-eac37363cc0a req-b1c1384d-2b2a-474a-a3ff-efd2ea2622f1 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-f9fe8b7e-84d4-4a3f-b93a-eac37363cc0a req-b1c1384d-2b2a-474a-a3ff-efd2ea2622f1 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] No waiting events found dispatching network-vif-unplugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG nova.compute.manager [req-f9fe8b7e-84d4-4a3f-b93a-eac37363cc0a req-b1c1384d-2b2a-474a-a3ff-efd2ea2622f1 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-vif-unplugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:57 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Instance destroyed successfully.
Oct 20 02:40:57 user nova-compute[74242]: DEBUG nova.objects.instance [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'resources' on Instance uuid 3d6b9529-656c-45f3-b2de-3d1462751bf1 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:30:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-907928236',display_name='tempest-AttachVolumeTestJSON-server-907928236',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-907928236',id=43,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+0C/EZq6BwMh+3wZbZgOw2m/JxCkcxWd9X6nujGwGDyr2EQvBu4YlJy6mRVBvBdc8CsjVHXkTNJTlT3+WS0iTSYuJCsZzoNxpr4cYb9sE8zXfgoepdKDpiPTJ/nXqUhw==',key_name='tempest-keypair-788125581',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:30:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86bf4c560c2a4a078d0f43aae70d4fd3',ramdisk_id='',reservation_id='r-30ipsrv9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-47724960',owner_user_name='tempest-AttachVolumeTestJSON-47724960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:39:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61536bdce5184c989843cc225dd547a0',uuid=3d6b9529-656c-45f3-b2de-3d1462751bf1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converting VIF {"id": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "address": "fa:16:3e:87:ef:3f", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.127", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap957c2a1b-2b", "ovs_interfaceid": "957c2a1b-2b78-47c9-8e79-fc8ce92755ec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG os_vif [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap957c2a1b-2b, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6d89ebb9-a438-4859-a557-804f1aa0bbcc) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:40:57 user nova-compute[74242]: INFO os_vif [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:87:ef:3f,bridge_name='br-int',has_traffic_filtering=True,id=957c2a1b-2b78-47c9-8e79-fc8ce92755ec,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap957c2a1b-2b')
Oct 20 02:40:57 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Deleting instance files /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1_del
Oct 20 02:40:57 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Deletion of /opt/stack/data/nova/instances/3d6b9529-656c-45f3-b2de-3d1462751bf1_del complete
Oct 20 02:40:58 user nova-compute[74242]: INFO nova.compute.manager [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 20 02:40:58 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:40:58 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:40:58 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:40:58 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:40:58 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:40:58 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:40:58 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Took 0.68 seconds to deallocate network for instance.
Oct 20 02:40:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:40:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:40:58 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:40:58 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:40:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:40:58 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Deleted allocations for instance 3d6b9529-656c-45f3-b2de-3d1462751bf1
Oct 20 02:40:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-67c0dfc2-1ce2-4b31-b148-fc2df1029bdd tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.865s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:40:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-1eb4c9f9-7145-4790-819e-728df6c90a4b req-6459fe81-cd8c-40d6-af19-0079065ad6d6 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:40:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1eb4c9f9-7145-4790-819e-728df6c90a4b req-6459fe81-cd8c-40d6-af19-0079065ad6d6 service nova] Acquiring lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:40:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1eb4c9f9-7145-4790-819e-728df6c90a4b req-6459fe81-cd8c-40d6-af19-0079065ad6d6 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:40:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1eb4c9f9-7145-4790-819e-728df6c90a4b req-6459fe81-cd8c-40d6-af19-0079065ad6d6 service nova] Lock "3d6b9529-656c-45f3-b2de-3d1462751bf1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:40:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-1eb4c9f9-7145-4790-819e-728df6c90a4b req-6459fe81-cd8c-40d6-af19-0079065ad6d6 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] No waiting events found dispatching network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:40:59 user nova-compute[74242]: WARNING nova.compute.manager [req-1eb4c9f9-7145-4790-819e-728df6c90a4b req-6459fe81-cd8c-40d6-af19-0079065ad6d6 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received unexpected event network-vif-plugged-957c2a1b-2b78-47c9-8e79-fc8ce92755ec for instance with vm_state deleted and task_state None.
Oct 20 02:40:59 user nova-compute[74242]: DEBUG nova.compute.manager [req-1eb4c9f9-7145-4790-819e-728df6c90a4b req-6459fe81-cd8c-40d6-af19-0079065ad6d6 service nova] [instance: 3d6b9529-656c-45f3-b2de-3d1462751bf1] Received event network-vif-deleted-957c2a1b-2b78-47c9-8e79-fc8ce92755ec {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:41:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:01 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:41:02 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:41:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:41:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:41:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:41:02 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:41:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:41:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:41:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:41:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:41:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:03 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:41:03 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:41:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8958MB free_disk=24.925189971923828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:41:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:41:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:41:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 2bf62933-66ea-469e-a70e-92184f311110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:41:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:41:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:41:03 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:41:03 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:41:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:41:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:41:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:41:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "2bf62933-66ea-469e-a70e-92184f311110" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:41:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:41:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:41:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:41:05 user nova-compute[74242]: INFO nova.compute.manager [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Terminating instance
Oct 20 02:41:05 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-e2ff1d3f-5117-4a1b-a8c4-729f41b2a1aa req-5c6a6735-7370-4583-a75e-63ea68284b66 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received event network-vif-unplugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e2ff1d3f-5117-4a1b-a8c4-729f41b2a1aa req-5c6a6735-7370-4583-a75e-63ea68284b66 service nova] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e2ff1d3f-5117-4a1b-a8c4-729f41b2a1aa req-5c6a6735-7370-4583-a75e-63ea68284b66 service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e2ff1d3f-5117-4a1b-a8c4-729f41b2a1aa req-5c6a6735-7370-4583-a75e-63ea68284b66 service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-e2ff1d3f-5117-4a1b-a8c4-729f41b2a1aa req-5c6a6735-7370-4583-a75e-63ea68284b66 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] No waiting events found dispatching network-vif-unplugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG nova.compute.manager [req-e2ff1d3f-5117-4a1b-a8c4-729f41b2a1aa req-5c6a6735-7370-4583-a75e-63ea68284b66 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received event network-vif-unplugged-61e204b4-d498-423a-8542-af401e188691 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:41:06 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Instance destroyed successfully.
Oct 20 02:41:06 user nova-compute[74242]: DEBUG nova.objects.instance [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lazy-loading 'resources' on Instance uuid 2bf62933-66ea-469e-a70e-92184f311110 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:23:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1744055314',display_name='tempest-ServerRescueNegativeTestJSON-server-1744055314',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1744055314',id=37,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:28:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='80fa40dfb2c84a84b3399b643fcde4c5',ramdisk_id='',reservation_id='r-vlo89q17',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-630282540',owner_user_name='tempest-ServerRescueNegativeTestJSON-630282540-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:30:27Z,user_data=None,user_id='c7a7db373740428d89dcda898a04410c',uuid=2bf62933-66ea-469e-a70e-92184f311110,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converting VIF {"id": "61e204b4-d498-423a-8542-af401e188691", "address": "fa:16:3e:03:d5:bc", "network": {"id": "99c381ea-299d-4220-bef1-c3c596672919", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-595369094-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "80fa40dfb2c84a84b3399b643fcde4c5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap61e204b4-d4", "ovs_interfaceid": "61e204b4-d498-423a-8542-af401e188691", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:03:d5:bc,bridge_name='br-int',has_traffic_filtering=True,id=61e204b4-d498-423a-8542-af401e188691,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e204b4-d4') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG os_vif [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:d5:bc,bridge_name='br-int',has_traffic_filtering=True,id=61e204b4-d498-423a-8542-af401e188691,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e204b4-d4') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap61e204b4-d4, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3389489e-ee0a-4130-a807-6e3caba35969) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:41:06 user nova-compute[74242]: INFO os_vif [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:03:d5:bc,bridge_name='br-int',has_traffic_filtering=True,id=61e204b4-d498-423a-8542-af401e188691,network=Network(99c381ea-299d-4220-bef1-c3c596672919),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap61e204b4-d4')
Oct 20 02:41:06 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Deleting instance files /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110_del
Oct 20 02:41:06 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Deletion of /opt/stack/data/nova/instances/2bf62933-66ea-469e-a70e-92184f311110_del complete
Oct 20 02:41:06 user nova-compute[74242]: INFO nova.compute.manager [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 20 02:41:06 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:41:06 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 2bf62933-66ea-469e-a70e-92184f311110] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:41:07 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:41:07 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Took 0.39 seconds to deallocate network for instance.
Oct 20 02:41:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-953a3933-9a8d-4447-9c5d-4c451863df0d req-ee2b3899-e200-4d88-a83d-52c2e89c6bcd service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received event network-vif-deleted-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:41:07 user nova-compute[74242]: INFO nova.compute.manager [req-953a3933-9a8d-4447-9c5d-4c451863df0d req-ee2b3899-e200-4d88-a83d-52c2e89c6bcd service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Neutron deleted interface 61e204b4-d498-423a-8542-af401e188691; detaching it from the instance and deleting it from the info cache
Oct 20 02:41:07 user nova-compute[74242]: DEBUG nova.network.neutron [req-953a3933-9a8d-4447-9c5d-4c451863df0d req-ee2b3899-e200-4d88-a83d-52c2e89c6bcd service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:41:07 user nova-compute[74242]: DEBUG nova.compute.manager [req-953a3933-9a8d-4447-9c5d-4c451863df0d req-ee2b3899-e200-4d88-a83d-52c2e89c6bcd service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Detach interface failed, port_id=61e204b4-d498-423a-8542-af401e188691, reason: Instance 2bf62933-66ea-469e-a70e-92184f311110 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:41:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:41:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:41:07 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:41:07 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:41:07 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:41:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:41:07 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Deleted allocations for instance 2bf62933-66ea-469e-a70e-92184f311110
Oct 20 02:41:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b02784ed-c505-47f2-a3c5-ed43fde78c3b tempest-ServerRescueNegativeTestJSON-630282540 tempest-ServerRescueNegativeTestJSON-630282540-project-member] Lock "2bf62933-66ea-469e-a70e-92184f311110" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.529s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:41:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-1c3d923a-a8d1-45ee-ab00-ada95d7e7797 req-5bfe6c5b-39e8-4de8-8540-c9aa8a4c4102 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:41:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1c3d923a-a8d1-45ee-ab00-ada95d7e7797 req-5bfe6c5b-39e8-4de8-8540-c9aa8a4c4102 service nova] Acquiring lock "2bf62933-66ea-469e-a70e-92184f311110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:41:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1c3d923a-a8d1-45ee-ab00-ada95d7e7797 req-5bfe6c5b-39e8-4de8-8540-c9aa8a4c4102 service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:41:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-1c3d923a-a8d1-45ee-ab00-ada95d7e7797 req-5bfe6c5b-39e8-4de8-8540-c9aa8a4c4102 service nova] Lock "2bf62933-66ea-469e-a70e-92184f311110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:41:08 user nova-compute[74242]: DEBUG nova.compute.manager [req-1c3d923a-a8d1-45ee-ab00-ada95d7e7797 req-5bfe6c5b-39e8-4de8-8540-c9aa8a4c4102 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] No waiting events found dispatching network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:41:08 user nova-compute[74242]: WARNING nova.compute.manager [req-1c3d923a-a8d1-45ee-ab00-ada95d7e7797 req-5bfe6c5b-39e8-4de8-8540-c9aa8a4c4102 service nova] [instance: 2bf62933-66ea-469e-a70e-92184f311110] Received unexpected event network-vif-plugged-61e204b4-d498-423a-8542-af401e188691 for instance with vm_state deleted and task_state None.
Oct 20 02:41:08 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:41:11 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:41:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:41:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:41:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "c06ea651-c372-496b-9500-2570af45c654" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:41:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:41:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:41:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:41:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:41:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:41:50 user nova-compute[74242]: INFO nova.compute.claims [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Claim successful on node user
Oct 20 02:41:50 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:41:50 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.367s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG nova.network.neutron [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:41:51 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:41:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:41:51 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Creating image(s)
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "/opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "/opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "/opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG nova.policy [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61536bdce5184c989843cc225dd547a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '86bf4c560c2a4a078d0f43aae70d4fd3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.176s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.170s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk 1073741824" returned: 0 in 0.048s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.178s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:41:51 user nova-compute[74242]: DEBUG nova.network.neutron [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Successfully created port: 2636e767-6bcb-4d05-8fa4-1361c8aeb592 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Cannot resize image /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Ensure instance console log exists: /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.network.neutron [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Successfully updated port: 2636e767-6bcb-4d05-8fa4-1361c8aeb592 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "refresh_cache-c06ea651-c372-496b-9500-2570af45c654" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquired lock "refresh_cache-c06ea651-c372-496b-9500-2570af45c654" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.network.neutron [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-c7d7d2a2-083c-4941-b37b-19694c103df2 req-065bff6e-241a-4d36-ba8c-949b3d00cfc3 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Received event network-changed-2636e767-6bcb-4d05-8fa4-1361c8aeb592 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-c7d7d2a2-083c-4941-b37b-19694c103df2 req-065bff6e-241a-4d36-ba8c-949b3d00cfc3 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Refreshing instance network info cache due to event network-changed-2636e767-6bcb-4d05-8fa4-1361c8aeb592. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c7d7d2a2-083c-4941-b37b-19694c103df2 req-065bff6e-241a-4d36-ba8c-949b3d00cfc3 service nova] Acquiring lock "refresh_cache-c06ea651-c372-496b-9500-2570af45c654" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.network.neutron [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.network.neutron [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Updating instance_info_cache with network_info: [{"id": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "address": "fa:16:3e:d8:66:ec", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2636e767-6b", "ovs_interfaceid": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Releasing lock "refresh_cache-c06ea651-c372-496b-9500-2570af45c654" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Instance network_info: |[{"id": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "address": "fa:16:3e:d8:66:ec", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2636e767-6b", "ovs_interfaceid": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c7d7d2a2-083c-4941-b37b-19694c103df2 req-065bff6e-241a-4d36-ba8c-949b3d00cfc3 service nova] Acquired lock "refresh_cache-c06ea651-c372-496b-9500-2570af45c654" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.network.neutron [req-c7d7d2a2-083c-4941-b37b-19694c103df2 req-065bff6e-241a-4d36-ba8c-949b3d00cfc3 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Refreshing network info cache for port 2636e767-6bcb-4d05-8fa4-1361c8aeb592 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Start _get_guest_xml network_info=[{"id": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "address": "fa:16:3e:d8:66:ec", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2636e767-6b", "ovs_interfaceid": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:41:52 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:41:52 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1279419196',display_name='tempest-AttachVolumeTestJSON-server-1279419196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1279419196',id=48,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRm7Qi1H6jYXEQpoHY/Jl/vV1mC2fWKPucm/W0k/tUZ/WhLepKaSrIOCQpYBqx6TSB8CpM1gXD+LeJuUfnohrTNBABFiQKcuAfGzHHQASwfeC6CBEdX7RlxxjqhSGF2/w==',key_name='tempest-keypair-506134978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86bf4c560c2a4a078d0f43aae70d4fd3',ramdisk_id='',reservation_id='r-193mlgtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-47724960',owner_user_name='tempest-AttachVolumeTestJSON-47724960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61536bdce5184c989843cc225dd547a0',uuid=c06ea651-c372-496b-9500-2570af45c654,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "address": "fa:16:3e:d8:66:ec", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2636e767-6b", "ovs_interfaceid": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converting VIF {"id": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "address": "fa:16:3e:d8:66:ec", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2636e767-6b", "ovs_interfaceid": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:66:ec,bridge_name='br-int',has_traffic_filtering=True,id=2636e767-6bcb-4d05-8fa4-1361c8aeb592,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2636e767-6b') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.objects.instance [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'pci_devices' on Instance uuid c06ea651-c372-496b-9500-2570af45c654 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:41:52 user nova-compute[74242]:   <uuid>c06ea651-c372-496b-9500-2570af45c654</uuid>
Oct 20 02:41:52 user nova-compute[74242]:   <name>instance-00000030</name>
Oct 20 02:41:52 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:41:52 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:41:52 user nova-compute[74242]:   <metadata>
Oct 20 02:41:52 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:41:52 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:41:52 user nova-compute[74242]:       <nova:name>tempest-AttachVolumeTestJSON-server-1279419196</nova:name>
Oct 20 02:41:52 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:41:52</nova:creationTime>
Oct 20 02:41:52 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:41:52 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:41:52 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:41:52 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:41:52 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:41:52 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:41:52 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:41:52 user nova-compute[74242]:       <nova:owner>
Oct 20 02:41:52 user nova-compute[74242]:         <nova:user uuid="61536bdce5184c989843cc225dd547a0">tempest-AttachVolumeTestJSON-47724960-project-member</nova:user>
Oct 20 02:41:52 user nova-compute[74242]:         <nova:project uuid="86bf4c560c2a4a078d0f43aae70d4fd3">tempest-AttachVolumeTestJSON-47724960</nova:project>
Oct 20 02:41:52 user nova-compute[74242]:       </nova:owner>
Oct 20 02:41:52 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:41:52 user nova-compute[74242]:       <nova:ports>
Oct 20 02:41:52 user nova-compute[74242]:         <nova:port uuid="2636e767-6bcb-4d05-8fa4-1361c8aeb592">
Oct 20 02:41:52 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 02:41:52 user nova-compute[74242]:         </nova:port>
Oct 20 02:41:52 user nova-compute[74242]:       </nova:ports>
Oct 20 02:41:52 user nova-compute[74242]:     </nova:instance>
Oct 20 02:41:52 user nova-compute[74242]:   </metadata>
Oct 20 02:41:52 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:41:52 user nova-compute[74242]:     <system>
Oct 20 02:41:52 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:41:52 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:41:52 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:41:52 user nova-compute[74242]:       <entry name="serial">c06ea651-c372-496b-9500-2570af45c654</entry>
Oct 20 02:41:52 user nova-compute[74242]:       <entry name="uuid">c06ea651-c372-496b-9500-2570af45c654</entry>
Oct 20 02:41:52 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:41:52 user nova-compute[74242]:     </system>
Oct 20 02:41:52 user nova-compute[74242]:   </sysinfo>
Oct 20 02:41:52 user nova-compute[74242]:   <os>
Oct 20 02:41:52 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:41:52 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:41:52 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:41:52 user nova-compute[74242]:   </os>
Oct 20 02:41:52 user nova-compute[74242]:   <features>
Oct 20 02:41:52 user nova-compute[74242]:     <acpi/>
Oct 20 02:41:52 user nova-compute[74242]:     <apic/>
Oct 20 02:41:52 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:41:52 user nova-compute[74242]:   </features>
Oct 20 02:41:52 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:41:52 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:41:52 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:41:52 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:41:52 user nova-compute[74242]:   </clock>
Oct 20 02:41:52 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:41:52 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:41:52 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:41:52 user nova-compute[74242]:   </cpu>
Oct 20 02:41:52 user nova-compute[74242]:   <devices>
Oct 20 02:41:52 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:41:52 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:41:52 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk"/>
Oct 20 02:41:52 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:41:52 user nova-compute[74242]:     </disk>
Oct 20 02:41:52 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:41:52 user nova-compute[74242]:       <mac address="fa:16:3e:d8:66:ec"/>
Oct 20 02:41:52 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:41:52 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:41:52 user nova-compute[74242]:       <target dev="tap2636e767-6b"/>
Oct 20 02:41:52 user nova-compute[74242]:     </interface>
Oct 20 02:41:52 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:41:52 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/console.log" append="off"/>
Oct 20 02:41:52 user nova-compute[74242]:     </serial>
Oct 20 02:41:52 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:41:52 user nova-compute[74242]:     <video>
Oct 20 02:41:52 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:41:52 user nova-compute[74242]:     </video>
Oct 20 02:41:52 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:41:52 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:41:52 user nova-compute[74242]:     </rng>
Oct 20 02:41:52 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:41:52 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:41:52 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:41:52 user nova-compute[74242]:     </memballoon>
Oct 20 02:41:52 user nova-compute[74242]:   </devices>
Oct 20 02:41:52 user nova-compute[74242]: </domain>
Oct 20 02:41:52 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1279419196',display_name='tempest-AttachVolumeTestJSON-server-1279419196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1279419196',id=48,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRm7Qi1H6jYXEQpoHY/Jl/vV1mC2fWKPucm/W0k/tUZ/WhLepKaSrIOCQpYBqx6TSB8CpM1gXD+LeJuUfnohrTNBABFiQKcuAfGzHHQASwfeC6CBEdX7RlxxjqhSGF2/w==',key_name='tempest-keypair-506134978',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='86bf4c560c2a4a078d0f43aae70d4fd3',ramdisk_id='',reservation_id='r-193mlgtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-47724960',owner_user_name='tempest-AttachVolumeTestJSON-47724960-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61536bdce5184c989843cc225dd547a0',uuid=c06ea651-c372-496b-9500-2570af45c654,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "address": "fa:16:3e:d8:66:ec", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2636e767-6b", "ovs_interfaceid": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converting VIF {"id": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "address": "fa:16:3e:d8:66:ec", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2636e767-6b", "ovs_interfaceid": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:66:ec,bridge_name='br-int',has_traffic_filtering=True,id=2636e767-6bcb-4d05-8fa4-1361c8aeb592,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2636e767-6b') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG os_vif [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:66:ec,bridge_name='br-int',has_traffic_filtering=True,id=2636e767-6bcb-4d05-8fa4-1361c8aeb592,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2636e767-6b') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1baf4be1-36e2-56b6-8d0c-8701e47e5954', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2636e767-6b, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2636e767-6b, col_values=(('qos', UUID('d38a5951-1e92-481f-aaf9-9aa98f7dcc2c')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2636e767-6b, col_values=(('external_ids', {'iface-id': '2636e767-6bcb-4d05-8fa4-1361c8aeb592', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:66:ec', 'vm-uuid': 'c06ea651-c372-496b-9500-2570af45c654'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:52 user nova-compute[74242]: INFO os_vif [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:66:ec,bridge_name='br-int',has_traffic_filtering=True,id=2636e767-6bcb-4d05-8fa4-1361c8aeb592,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2636e767-6b')
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:41:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] No VIF found with MAC fa:16:3e:d8:66:ec, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:41:53 user nova-compute[74242]: DEBUG nova.network.neutron [req-c7d7d2a2-083c-4941-b37b-19694c103df2 req-065bff6e-241a-4d36-ba8c-949b3d00cfc3 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Updated VIF entry in instance network info cache for port 2636e767-6bcb-4d05-8fa4-1361c8aeb592. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:41:53 user nova-compute[74242]: DEBUG nova.network.neutron [req-c7d7d2a2-083c-4941-b37b-19694c103df2 req-065bff6e-241a-4d36-ba8c-949b3d00cfc3 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Updating instance_info_cache with network_info: [{"id": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "address": "fa:16:3e:d8:66:ec", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2636e767-6b", "ovs_interfaceid": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:41:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-c7d7d2a2-083c-4941-b37b-19694c103df2 req-065bff6e-241a-4d36-ba8c-949b3d00cfc3 service nova] Releasing lock "refresh_cache-c06ea651-c372-496b-9500-2570af45c654" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:41:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:54 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:41:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-9aaccb0a-1a87-4fc0-b445-ac414620e022 req-6abf3ed5-b360-4090-b8f4-f960a9b54bdd service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Received event network-vif-plugged-2636e767-6bcb-4d05-8fa4-1361c8aeb592 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:41:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9aaccb0a-1a87-4fc0-b445-ac414620e022 req-6abf3ed5-b360-4090-b8f4-f960a9b54bdd service nova] Acquiring lock "c06ea651-c372-496b-9500-2570af45c654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:41:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9aaccb0a-1a87-4fc0-b445-ac414620e022 req-6abf3ed5-b360-4090-b8f4-f960a9b54bdd service nova] Lock "c06ea651-c372-496b-9500-2570af45c654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:41:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9aaccb0a-1a87-4fc0-b445-ac414620e022 req-6abf3ed5-b360-4090-b8f4-f960a9b54bdd service nova] Lock "c06ea651-c372-496b-9500-2570af45c654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:41:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-9aaccb0a-1a87-4fc0-b445-ac414620e022 req-6abf3ed5-b360-4090-b8f4-f960a9b54bdd service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] No waiting events found dispatching network-vif-plugged-2636e767-6bcb-4d05-8fa4-1361c8aeb592 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:41:54 user nova-compute[74242]: WARNING nova.compute.manager [req-9aaccb0a-1a87-4fc0-b445-ac414620e022 req-6abf3ed5-b360-4090-b8f4-f960a9b54bdd service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Received unexpected event network-vif-plugged-2636e767-6bcb-4d05-8fa4-1361c8aeb592 for instance with vm_state building and task_state spawning.
Oct 20 02:41:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:55 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:41:55 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:41:55 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:41:55 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c06ea651-c372-496b-9500-2570af45c654] Skipping network cache update for instance because it is Building. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 20 02:41:55 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Didn't find any instances for network info cache update. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 02:41:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:41:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:41:56 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c06ea651-c372-496b-9500-2570af45c654] Instance spawned successfully.
Oct 20 02:41:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:41:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:41:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:41:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:41:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:41:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:41:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:41:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-e63053cd-9993-4179-b086-f62a08053697 req-dbb5b8ae-a70a-4d4d-ad80-fbf7b4d35a6b service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Received event network-vif-plugged-2636e767-6bcb-4d05-8fa4-1361c8aeb592 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:41:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e63053cd-9993-4179-b086-f62a08053697 req-dbb5b8ae-a70a-4d4d-ad80-fbf7b4d35a6b service nova] Acquiring lock "c06ea651-c372-496b-9500-2570af45c654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:41:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e63053cd-9993-4179-b086-f62a08053697 req-dbb5b8ae-a70a-4d4d-ad80-fbf7b4d35a6b service nova] Lock "c06ea651-c372-496b-9500-2570af45c654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:41:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e63053cd-9993-4179-b086-f62a08053697 req-dbb5b8ae-a70a-4d4d-ad80-fbf7b4d35a6b service nova] Lock "c06ea651-c372-496b-9500-2570af45c654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:41:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-e63053cd-9993-4179-b086-f62a08053697 req-dbb5b8ae-a70a-4d4d-ad80-fbf7b4d35a6b service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] No waiting events found dispatching network-vif-plugged-2636e767-6bcb-4d05-8fa4-1361c8aeb592 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:41:56 user nova-compute[74242]: WARNING nova.compute.manager [req-e63053cd-9993-4179-b086-f62a08053697 req-dbb5b8ae-a70a-4d4d-ad80-fbf7b4d35a6b service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Received unexpected event network-vif-plugged-2636e767-6bcb-4d05-8fa4-1361c8aeb592 for instance with vm_state building and task_state spawning.
Oct 20 02:41:56 user nova-compute[74242]: INFO nova.compute.manager [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Took 5.28 seconds to spawn the instance on the hypervisor.
Oct 20 02:41:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:41:56 user nova-compute[74242]: INFO nova.compute.manager [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Took 5.96 seconds to build instance.
Oct 20 02:41:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b408932a-c7c1-4161-a91f-9967b9a6b83c tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.058s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:41:57 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:41:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:41:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:42:00 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:42:00 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:42:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:42:02 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:42:02 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:42:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:42:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:42:02 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:42:02 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:42:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:42:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:42:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:42:02 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:42:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:42:03 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:42:03 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:42:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=9024MB free_disk=24.950992584228516GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:42:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:42:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:42:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c06ea651-c372-496b-9500-2570af45c654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:42:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:42:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:42:03 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:42:03 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:42:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:42:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:42:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:42:09 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:42:09 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:42:12 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:42:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:42:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:42:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:42:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:42:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:42:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:42:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:42:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:42:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:42:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:42:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:42:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:42:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:42:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:42:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:42:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:42:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:42:54 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:42:56 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:42:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:42:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:42:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-c06ea651-c372-496b-9500-2570af45c654" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:42:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-c06ea651-c372-496b-9500-2570af45c654" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:42:56 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c06ea651-c372-496b-9500-2570af45c654] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:42:56 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid c06ea651-c372-496b-9500-2570af45c654 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:42:56 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c06ea651-c372-496b-9500-2570af45c654] Updating instance_info_cache with network_info: [{"id": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "address": "fa:16:3e:d8:66:ec", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2636e767-6b", "ovs_interfaceid": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:42:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-c06ea651-c372-496b-9500-2570af45c654" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:42:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c06ea651-c372-496b-9500-2570af45c654] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:42:57 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:42:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:42:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:42:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:42:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:42:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:42:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:01 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:43:01 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:43:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:03 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:43:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:43:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:43:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:43:03 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:43:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:43:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:43:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:43:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:43:04 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:43:04 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:43:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8957MB free_disk=24.92171859741211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:43:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:43:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:43:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c06ea651-c372-496b-9500-2570af45c654 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:43:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:43:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:43:04 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:43:04 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:43:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:43:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:43:05 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:43:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:43:09 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:43:10 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:43:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:43:13 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:43:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:43:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:43:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:43:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:43:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:43:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:43:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:43:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:43:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:25 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:43:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:43:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:43:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:43:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:43:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:43:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-9096c559-a901-472d-9c51-592c2f7a1976 req-af440f0f-eaf9-4020-a35b-4847a799e772 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Received event network-changed-2636e767-6bcb-4d05-8fa4-1361c8aeb592 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:43:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-9096c559-a901-472d-9c51-592c2f7a1976 req-af440f0f-eaf9-4020-a35b-4847a799e772 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Refreshing instance network info cache due to event network-changed-2636e767-6bcb-4d05-8fa4-1361c8aeb592. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:43:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9096c559-a901-472d-9c51-592c2f7a1976 req-af440f0f-eaf9-4020-a35b-4847a799e772 service nova] Acquiring lock "refresh_cache-c06ea651-c372-496b-9500-2570af45c654" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:43:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9096c559-a901-472d-9c51-592c2f7a1976 req-af440f0f-eaf9-4020-a35b-4847a799e772 service nova] Acquired lock "refresh_cache-c06ea651-c372-496b-9500-2570af45c654" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:43:41 user nova-compute[74242]: DEBUG nova.network.neutron [req-9096c559-a901-472d-9c51-592c2f7a1976 req-af440f0f-eaf9-4020-a35b-4847a799e772 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Refreshing network info cache for port 2636e767-6bcb-4d05-8fa4-1361c8aeb592 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:43:42 user nova-compute[74242]: DEBUG nova.network.neutron [req-9096c559-a901-472d-9c51-592c2f7a1976 req-af440f0f-eaf9-4020-a35b-4847a799e772 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Updated VIF entry in instance network info cache for port 2636e767-6bcb-4d05-8fa4-1361c8aeb592. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:43:42 user nova-compute[74242]: DEBUG nova.network.neutron [req-9096c559-a901-472d-9c51-592c2f7a1976 req-af440f0f-eaf9-4020-a35b-4847a799e772 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Updating instance_info_cache with network_info: [{"id": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "address": "fa:16:3e:d8:66:ec", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2636e767-6b", "ovs_interfaceid": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:43:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-9096c559-a901-472d-9c51-592c2f7a1976 req-af440f0f-eaf9-4020-a35b-4847a799e772 service nova] Releasing lock "refresh_cache-c06ea651-c372-496b-9500-2570af45c654" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:43:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:43:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:43:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:43:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:43:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:43:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "c06ea651-c372-496b-9500-2570af45c654" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG nova.objects.instance [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'flavor' on Instance uuid c06ea651-c372-496b-9500-2570af45c654 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "c06ea651-c372-496b-9500-2570af45c654" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:43:46 user nova-compute[74242]: INFO nova.compute.manager [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Attaching volume 35ac1144-f0a1-41f0-aa6b-b24c056d71c0 to /dev/vdb
Oct 20 02:43:46 user nova-compute[74242]: DEBUG os_brick.utils [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fffdfea-f511-455f-880b-bfe524a6dac3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f3ea28-e733-43ae-83c4-48261f6e8e1b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c594098-b548-4a55-ae5b-cfc0f64981c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[69583039-be86-4f33-9987-c4ccb19a271f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:43:46 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:43:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[daae095b-018d-48b8-babe-eb0c42e2f90d]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG os_brick.utils [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:43:46 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Updating existing volume attachment record: 80c6880a-ac94-4f7e-9af0-46803fa15cad {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:43:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:43:51 user nova-compute[74242]: INFO nova.compute.claims [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Claim successful on node user
Oct 20 02:43:51 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.241s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:43:51 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:43:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG nova.policy [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '417d4230c6c94c3c93cd0b2f251b7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060e30702e08441b981009a6f2f17007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:43:51 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Creating image(s)
Oct 20 02:43:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "/opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "/opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "/opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:43:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk 1073741824" returned: 0 in 0.052s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Successfully created port: 037e3efc-59df-4b8a-a9bd-568421684fa4 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.183s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Cannot resize image /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Ensure instance console log exists: /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Successfully updated port: 037e3efc-59df-4b8a-a9bd-568421684fa4 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "refresh_cache-34b108c8-3029-4a2b-b2d0-15aae1b222b5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquired lock "refresh_cache-34b108c8-3029-4a2b-b2d0-15aae1b222b5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-dc10be96-2fbb-45a0-a70b-f6510f5bc263 req-3cd2c0a9-d25f-4f1a-aba1-f5fb589b7250 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Received event network-changed-037e3efc-59df-4b8a-a9bd-568421684fa4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG nova.compute.manager [req-dc10be96-2fbb-45a0-a70b-f6510f5bc263 req-3cd2c0a9-d25f-4f1a-aba1-f5fb589b7250 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Refreshing instance network info cache due to event network-changed-037e3efc-59df-4b8a-a9bd-568421684fa4. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dc10be96-2fbb-45a0-a70b-f6510f5bc263 req-3cd2c0a9-d25f-4f1a-aba1-f5fb589b7250 service nova] Acquiring lock "refresh_cache-34b108c8-3029-4a2b-b2d0-15aae1b222b5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:43:52 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.network.neutron [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Updating instance_info_cache with network_info: [{"id": "037e3efc-59df-4b8a-a9bd-568421684fa4", "address": "fa:16:3e:d9:07:b9", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e3efc-59", "ovs_interfaceid": "037e3efc-59df-4b8a-a9bd-568421684fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Releasing lock "refresh_cache-34b108c8-3029-4a2b-b2d0-15aae1b222b5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Instance network_info: |[{"id": "037e3efc-59df-4b8a-a9bd-568421684fa4", "address": "fa:16:3e:d9:07:b9", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e3efc-59", "ovs_interfaceid": "037e3efc-59df-4b8a-a9bd-568421684fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dc10be96-2fbb-45a0-a70b-f6510f5bc263 req-3cd2c0a9-d25f-4f1a-aba1-f5fb589b7250 service nova] Acquired lock "refresh_cache-34b108c8-3029-4a2b-b2d0-15aae1b222b5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.network.neutron [req-dc10be96-2fbb-45a0-a70b-f6510f5bc263 req-3cd2c0a9-d25f-4f1a-aba1-f5fb589b7250 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Refreshing network info cache for port 037e3efc-59df-4b8a-a9bd-568421684fa4 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Start _get_guest_xml network_info=[{"id": "037e3efc-59df-4b8a-a9bd-568421684fa4", "address": "fa:16:3e:d9:07:b9", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e3efc-59", "ovs_interfaceid": "037e3efc-59df-4b8a-a9bd-568421684fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:43:53 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:43:53 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1341229109',display_name='tempest-VolumesSnapshotTestJSON-instance-1341229109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1341229109',id=49,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3fo4/oaBu/gVGHt1NOwTYzI3ZXHBcyxb6eSMDPs7VPmsyHCfZfo5AuS0mla0VN+OQTQzeJ2CgvXFov2KR/K7mhBIup0Wi9iA+7x+gdG5L/0QQVcTUfH+WTs6EBNr/OaQ==',key_name='tempest-keypair-533725408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='060e30702e08441b981009a6f2f17007',ramdisk_id='',reservation_id='r-if0t47x3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-553194039',owner_user_name='tempest-VolumesSnapshotTestJSON-553194039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:43:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='417d4230c6c94c3c93cd0b2f251b7212',uuid=34b108c8-3029-4a2b-b2d0-15aae1b222b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "037e3efc-59df-4b8a-a9bd-568421684fa4", "address": "fa:16:3e:d9:07:b9", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e3efc-59", "ovs_interfaceid": "037e3efc-59df-4b8a-a9bd-568421684fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Converting VIF {"id": "037e3efc-59df-4b8a-a9bd-568421684fa4", "address": "fa:16:3e:d9:07:b9", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e3efc-59", "ovs_interfaceid": "037e3efc-59df-4b8a-a9bd-568421684fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:07:b9,bridge_name='br-int',has_traffic_filtering=True,id=037e3efc-59df-4b8a-a9bd-568421684fa4,network=Network(516bdc21-bbb8-4415-b700-903042bd794a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037e3efc-59') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.objects.instance [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lazy-loading 'pci_devices' on Instance uuid 34b108c8-3029-4a2b-b2d0-15aae1b222b5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:43:53 user nova-compute[74242]:   <uuid>34b108c8-3029-4a2b-b2d0-15aae1b222b5</uuid>
Oct 20 02:43:53 user nova-compute[74242]:   <name>instance-00000031</name>
Oct 20 02:43:53 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:43:53 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:43:53 user nova-compute[74242]:   <metadata>
Oct 20 02:43:53 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:43:53 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:43:53 user nova-compute[74242]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1341229109</nova:name>
Oct 20 02:43:53 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:43:53</nova:creationTime>
Oct 20 02:43:53 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:43:53 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:43:53 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:43:53 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:43:53 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:43:53 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:43:53 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:43:53 user nova-compute[74242]:       <nova:owner>
Oct 20 02:43:53 user nova-compute[74242]:         <nova:user uuid="417d4230c6c94c3c93cd0b2f251b7212">tempest-VolumesSnapshotTestJSON-553194039-project-member</nova:user>
Oct 20 02:43:53 user nova-compute[74242]:         <nova:project uuid="060e30702e08441b981009a6f2f17007">tempest-VolumesSnapshotTestJSON-553194039</nova:project>
Oct 20 02:43:53 user nova-compute[74242]:       </nova:owner>
Oct 20 02:43:53 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:43:53 user nova-compute[74242]:       <nova:ports>
Oct 20 02:43:53 user nova-compute[74242]:         <nova:port uuid="037e3efc-59df-4b8a-a9bd-568421684fa4">
Oct 20 02:43:53 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 20 02:43:53 user nova-compute[74242]:         </nova:port>
Oct 20 02:43:53 user nova-compute[74242]:       </nova:ports>
Oct 20 02:43:53 user nova-compute[74242]:     </nova:instance>
Oct 20 02:43:53 user nova-compute[74242]:   </metadata>
Oct 20 02:43:53 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:43:53 user nova-compute[74242]:     <system>
Oct 20 02:43:53 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:43:53 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:43:53 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:43:53 user nova-compute[74242]:       <entry name="serial">34b108c8-3029-4a2b-b2d0-15aae1b222b5</entry>
Oct 20 02:43:53 user nova-compute[74242]:       <entry name="uuid">34b108c8-3029-4a2b-b2d0-15aae1b222b5</entry>
Oct 20 02:43:53 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:43:53 user nova-compute[74242]:     </system>
Oct 20 02:43:53 user nova-compute[74242]:   </sysinfo>
Oct 20 02:43:53 user nova-compute[74242]:   <os>
Oct 20 02:43:53 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:43:53 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:43:53 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:43:53 user nova-compute[74242]:   </os>
Oct 20 02:43:53 user nova-compute[74242]:   <features>
Oct 20 02:43:53 user nova-compute[74242]:     <acpi/>
Oct 20 02:43:53 user nova-compute[74242]:     <apic/>
Oct 20 02:43:53 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:43:53 user nova-compute[74242]:   </features>
Oct 20 02:43:53 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:43:53 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:43:53 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:43:53 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:43:53 user nova-compute[74242]:   </clock>
Oct 20 02:43:53 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:43:53 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:43:53 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:43:53 user nova-compute[74242]:   </cpu>
Oct 20 02:43:53 user nova-compute[74242]:   <devices>
Oct 20 02:43:53 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:43:53 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:43:53 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk"/>
Oct 20 02:43:53 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:43:53 user nova-compute[74242]:     </disk>
Oct 20 02:43:53 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:43:53 user nova-compute[74242]:       <mac address="fa:16:3e:d9:07:b9"/>
Oct 20 02:43:53 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:43:53 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:43:53 user nova-compute[74242]:       <target dev="tap037e3efc-59"/>
Oct 20 02:43:53 user nova-compute[74242]:     </interface>
Oct 20 02:43:53 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:43:53 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/console.log" append="off"/>
Oct 20 02:43:53 user nova-compute[74242]:     </serial>
Oct 20 02:43:53 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:43:53 user nova-compute[74242]:     <video>
Oct 20 02:43:53 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:43:53 user nova-compute[74242]:     </video>
Oct 20 02:43:53 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:43:53 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:43:53 user nova-compute[74242]:     </rng>
Oct 20 02:43:53 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:43:53 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:43:53 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:43:53 user nova-compute[74242]:     </memballoon>
Oct 20 02:43:53 user nova-compute[74242]:   </devices>
Oct 20 02:43:53 user nova-compute[74242]: </domain>
Oct 20 02:43:53 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1341229109',display_name='tempest-VolumesSnapshotTestJSON-instance-1341229109',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1341229109',id=49,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3fo4/oaBu/gVGHt1NOwTYzI3ZXHBcyxb6eSMDPs7VPmsyHCfZfo5AuS0mla0VN+OQTQzeJ2CgvXFov2KR/K7mhBIup0Wi9iA+7x+gdG5L/0QQVcTUfH+WTs6EBNr/OaQ==',key_name='tempest-keypair-533725408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='060e30702e08441b981009a6f2f17007',ramdisk_id='',reservation_id='r-if0t47x3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-553194039',owner_user_name='tempest-VolumesSnapshotTestJSON-553194039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:43:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='417d4230c6c94c3c93cd0b2f251b7212',uuid=34b108c8-3029-4a2b-b2d0-15aae1b222b5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "037e3efc-59df-4b8a-a9bd-568421684fa4", "address": "fa:16:3e:d9:07:b9", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e3efc-59", "ovs_interfaceid": "037e3efc-59df-4b8a-a9bd-568421684fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Converting VIF {"id": "037e3efc-59df-4b8a-a9bd-568421684fa4", "address": "fa:16:3e:d9:07:b9", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e3efc-59", "ovs_interfaceid": "037e3efc-59df-4b8a-a9bd-568421684fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:07:b9,bridge_name='br-int',has_traffic_filtering=True,id=037e3efc-59df-4b8a-a9bd-568421684fa4,network=Network(516bdc21-bbb8-4415-b700-903042bd794a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037e3efc-59') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG os_vif [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:07:b9,bridge_name='br-int',has_traffic_filtering=True,id=037e3efc-59df-4b8a-a9bd-568421684fa4,network=Network(516bdc21-bbb8-4415-b700-903042bd794a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037e3efc-59') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '719e641a-5171-5e58-b461-b8bc08d1ff3f', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap037e3efc-59, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap037e3efc-59, col_values=(('qos', UUID('58e8a7bf-2c31-4d45-b7fc-5b0ebf1cb394')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap037e3efc-59, col_values=(('external_ids', {'iface-id': '037e3efc-59df-4b8a-a9bd-568421684fa4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:07:b9', 'vm-uuid': '34b108c8-3029-4a2b-b2d0-15aae1b222b5'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:53 user nova-compute[74242]: INFO os_vif [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:07:b9,bridge_name='br-int',has_traffic_filtering=True,id=037e3efc-59df-4b8a-a9bd-568421684fa4,network=Network(516bdc21-bbb8-4415-b700-903042bd794a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037e3efc-59')
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] No VIF found with MAC fa:16:3e:d9:07:b9, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.network.neutron [req-dc10be96-2fbb-45a0-a70b-f6510f5bc263 req-3cd2c0a9-d25f-4f1a-aba1-f5fb589b7250 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Updated VIF entry in instance network info cache for port 037e3efc-59df-4b8a-a9bd-568421684fa4. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG nova.network.neutron [req-dc10be96-2fbb-45a0-a70b-f6510f5bc263 req-3cd2c0a9-d25f-4f1a-aba1-f5fb589b7250 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Updating instance_info_cache with network_info: [{"id": "037e3efc-59df-4b8a-a9bd-568421684fa4", "address": "fa:16:3e:d9:07:b9", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e3efc-59", "ovs_interfaceid": "037e3efc-59df-4b8a-a9bd-568421684fa4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:43:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-dc10be96-2fbb-45a0-a70b-f6510f5bc263 req-3cd2c0a9-d25f-4f1a-aba1-f5fb589b7250 service nova] Releasing lock "refresh_cache-34b108c8-3029-4a2b-b2d0-15aae1b222b5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:43:54 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:43:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-bfe001e2-e833-4b1b-94ac-659bd41a1ab5 req-fda4240d-686b-4db3-aa20-317bba3bc022 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Received event network-vif-plugged-037e3efc-59df-4b8a-a9bd-568421684fa4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:43:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bfe001e2-e833-4b1b-94ac-659bd41a1ab5 req-fda4240d-686b-4db3-aa20-317bba3bc022 service nova] Acquiring lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:43:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bfe001e2-e833-4b1b-94ac-659bd41a1ab5 req-fda4240d-686b-4db3-aa20-317bba3bc022 service nova] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:43:54 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-bfe001e2-e833-4b1b-94ac-659bd41a1ab5 req-fda4240d-686b-4db3-aa20-317bba3bc022 service nova] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:43:54 user nova-compute[74242]: DEBUG nova.compute.manager [req-bfe001e2-e833-4b1b-94ac-659bd41a1ab5 req-fda4240d-686b-4db3-aa20-317bba3bc022 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] No waiting events found dispatching network-vif-plugged-037e3efc-59df-4b8a-a9bd-568421684fa4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:43:54 user nova-compute[74242]: WARNING nova.compute.manager [req-bfe001e2-e833-4b1b-94ac-659bd41a1ab5 req-fda4240d-686b-4db3-aa20-317bba3bc022 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Received unexpected event network-vif-plugged-037e3efc-59df-4b8a-a9bd-568421684fa4 for instance with vm_state building and task_state spawning.
Oct 20 02:43:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:43:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:43:56 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Instance spawned successfully.
Oct 20 02:43:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:43:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:43:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:43:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:43:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:43:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:43:56 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:43:56 user nova-compute[74242]: INFO nova.compute.manager [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Took 5.15 seconds to spawn the instance on the hypervisor.
Oct 20 02:43:56 user nova-compute[74242]: DEBUG nova.compute.manager [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:43:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-4ab12f97-841c-401b-838a-d64d2ec920f7 req-01b4ecba-bfb1-4669-9d9f-1fc12cbf1db2 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Received event network-vif-plugged-037e3efc-59df-4b8a-a9bd-568421684fa4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:43:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4ab12f97-841c-401b-838a-d64d2ec920f7 req-01b4ecba-bfb1-4669-9d9f-1fc12cbf1db2 service nova] Acquiring lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:43:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4ab12f97-841c-401b-838a-d64d2ec920f7 req-01b4ecba-bfb1-4669-9d9f-1fc12cbf1db2 service nova] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:43:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-4ab12f97-841c-401b-838a-d64d2ec920f7 req-01b4ecba-bfb1-4669-9d9f-1fc12cbf1db2 service nova] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:43:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-4ab12f97-841c-401b-838a-d64d2ec920f7 req-01b4ecba-bfb1-4669-9d9f-1fc12cbf1db2 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] No waiting events found dispatching network-vif-plugged-037e3efc-59df-4b8a-a9bd-568421684fa4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:43:56 user nova-compute[74242]: WARNING nova.compute.manager [req-4ab12f97-841c-401b-838a-d64d2ec920f7 req-01b4ecba-bfb1-4669-9d9f-1fc12cbf1db2 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Received unexpected event network-vif-plugged-037e3efc-59df-4b8a-a9bd-568421684fa4 for instance with vm_state building and task_state spawning.
Oct 20 02:43:56 user nova-compute[74242]: INFO nova.compute.manager [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Took 5.71 seconds to build instance.
Oct 20 02:43:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-8db5d3a6-a4a0-41c3-bc54-25b43f6bc18e tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.804s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:43:57 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:43:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:43:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:43:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-c06ea651-c372-496b-9500-2570af45c654" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:43:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-c06ea651-c372-496b-9500-2570af45c654" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:43:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c06ea651-c372-496b-9500-2570af45c654] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:43:57 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid c06ea651-c372-496b-9500-2570af45c654 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:43:57 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c06ea651-c372-496b-9500-2570af45c654] Updating instance_info_cache with network_info: [{"id": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "address": "fa:16:3e:d8:66:ec", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2636e767-6b", "ovs_interfaceid": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:43:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-c06ea651-c372-496b-9500-2570af45c654" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:43:57 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c06ea651-c372-496b-9500-2570af45c654] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:43:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:43:59 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:44:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:02 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:44:02 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMkKSQlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:44:03 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:44:03 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:44:03 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e2e69a9-089f-4b79-a0ae-5f2e1f6d950e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:44:03 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6832c0a-a490-4b1d-b860-e02ce4d86a47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0] added
Oct 20 02:44:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a613cd-bf5b-4eec-a5f3-76b4aa14ca47]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efdd3e0-2011-4684-8ded-32448cf21bd8]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tMkKSQlx {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tMkKSQlx" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c0c73d-3152-4da9-ad02-057468777b3e]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tMkKSQlx'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[74d0ebcc-7aeb-4659-9da9-70239fe975cf]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[707105f2-1da8-4055-8989-c7003a09a5f8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 02:44:03 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 02:44:03 user nova-compute[74242]:  {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:44:03 user nova-compute[74242]: WARNING os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 02:44:03 user nova-compute[74242]: 
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1bfbf3-20ef-4a0f-9a46-f312a1cdc944]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0, portal: 172.16.0.220,3260]
Oct 20 02:44:03 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0, portal: 172.16.0.220,3260] successful.
Oct 20 02:44:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee3a653-f1c2-4fb1-afc3-bcda1483da56]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f406f2e-1293-45dc-99bd-d760525a8cd4]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 (non-flash)
Oct 20 02:44:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 (non-flash)
Oct 20 02:44:03 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.228s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[497b2071-8f25-40c9-bf25-b74b28f3a425]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:44:03 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMkKSQlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.262s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] <== connect_volume: return (1263ms) {'type': 'block', 'scsi_wwn': '26331343436343530', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331343436343530', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG nova.objects.instance [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'flavor' on Instance uuid c06ea651-c372-496b-9500-2570af45c654 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:44:04 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:44:04 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:44:04 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:44:04 user nova-compute[74242]:   <serial>35ac1144-f0a1-41f0-aa6b-b24c056d71c0</serial>
Oct 20 02:44:04 user nova-compute[74242]: </disk>
Oct 20 02:44:04 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] No VIF found with MAC fa:16:3e:d8:66:ec, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:04 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f022389f-d8c6-411f-b8bf-717560d8a415 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.285s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:44:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:05 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:44:05 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:44:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=24.910343170166016GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:44:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:44:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:44:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c06ea651-c372-496b-9500-2570af45c654 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:44:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 34b108c8-3029-4a2b-b2d0-15aae1b222b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:44:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:44:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:44:05 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing inventories for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 02:44:05 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Updating ProviderTree inventory for provider 07b40460-b6ac-48c1-8447-e1778d50b26e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 02:44:05 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Updating inventory in ProviderTree for provider 07b40460-b6ac-48c1-8447-e1778d50b26e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 02:44:05 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing aggregate associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, aggregates: None {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 02:44:05 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing trait associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 02:44:05 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:44:05 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:44:06 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:44:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.490s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:44:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:44:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:44:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:44:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:44:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:44:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:44:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "c06ea651-c372-496b-9500-2570af45c654" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:44:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:44:10 user nova-compute[74242]: DEBUG nova.objects.instance [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'flavor' on Instance uuid c06ea651-c372-496b-9500-2570af45c654 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:44:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "c06ea651-c372-496b-9500-2570af45c654" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:44:11 user nova-compute[74242]: INFO nova.compute.manager [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Attaching volume 52421533-9e6c-40c7-91bd-528efe3b397a to /dev/vdc
Oct 20 02:44:11 user nova-compute[74242]: DEBUG os_brick.utils [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f095d950-a82d-41c3-be75-b13bfc197532]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b962e4b4-8c5f-4f00-bad7-b90e5317d72c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[48387772-3fe2-4e28-9a12-75540f3f4354]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe472fd-016b-4097-8cbf-2d5f1ebfdd59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:44:11 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:44:11 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[79219b98-f2b8-403f-9b95-1ef31d772dc4]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG os_brick.utils [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:44:11 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Updating existing volume attachment record: 74f33591-b7dd-4930-8eb0-d50e2f15e096 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:44:12 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:44:12 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:44:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:13 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:44:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:18 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:18 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:44:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:23 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:23 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:44:23 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 02:44:23 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] There are 0 instances to clean {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 02:44:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74242) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WvrjqSgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:44:26 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:44:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:44:26 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:44:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:44:26 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6272c747-1e42-41a2-b8f0-b0bfc0a5eb1b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:44:26 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a5927d2-58c7-4b89-bd13-2de1acd2077e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a] added
Oct 20 02:44:26 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[33029e4c-ae7a-498b-8f5b-4d08d0772b29]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1599d76-6786-4faa-9111-e322a5f14d53]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WvrjqSgu {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WvrjqSgu" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c1430d-187f-41d2-aa36-729a4a72a165]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WvrjqSgu'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db2eb04-4453-4ffa-8468-f9bfaa2601e1]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d407c0c3-8859-4282-9041-965a7e40f747]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 (non-flash)
Oct 20 02:44:26 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 (non-flash)
Oct 20 02:44:26 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:44:26 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5396cd34-2afe-4a0f-b5ce-cec7b249abcc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a, portal: 172.16.0.220,3260]
Oct 20 02:44:27 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a, portal: 172.16.0.220,3260] successful.
Oct 20 02:44:27 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0fef3dd-1230-4620-a77c-e0086937112d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d08ecac-a10a-49fb-b0a5-f2107470cac2]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 (non-flash)
Oct 20 02:44:27 user nova-compute[74242]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a (non-flash)
Oct 20 02:44:27 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 (non-flash)
Oct 20 02:44:27 user nova-compute[74242]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a (non-flash)
Oct 20 02:44:27 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] HCTL ('34', '-', '-', 0) found on session 58 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06b5378-3be8-4938-9794-26dbb585ff4a]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:27 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: None {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:44:28 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Searching for a device in session 58 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:44:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WvrjqSgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:44:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:44:28 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23062393662326230', 'path': '/dev/sdc'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:44:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23062393662326230', 'path': '/dev/sdc'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:44:28 user nova-compute[74242]: DEBUG nova.objects.instance [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'flavor' on Instance uuid c06ea651-c372-496b-9500-2570af45c654 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:44:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:44:28 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:44:28 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:44:28 user nova-compute[74242]:   <target dev="vdc" bus="virtio"/>
Oct 20 02:44:28 user nova-compute[74242]:   <serial>52421533-9e6c-40c7-91bd-528efe3b397a</serial>
Oct 20 02:44:28 user nova-compute[74242]: </disk>
Oct 20 02:44:28 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:44:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:44:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:44:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:44:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] No VIF found with MAC fa:16:3e:d8:66:ec, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:44:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-5370b979-97ba-49fa-bcfb-dc9fba177dd7 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.687s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:44:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "c06ea651-c372-496b-9500-2570af45c654" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:44:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:44:29 user nova-compute[74242]: INFO nova.compute.manager [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Detaching volume 35ac1144-f0a1-41f0-aa6b-b24c056d71c0
Oct 20 02:44:29 user nova-compute[74242]: INFO nova.virt.block_device [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Attempting to driver detach volume 35ac1144-f0a1-41f0-aa6b-b24c056d71c0 from mountpoint /dev/vdb
Oct 20 02:44:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Attempting to detach device vdb from instance c06ea651-c372-496b-9500-2570af45c654 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:44:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:44:29 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:44:29 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:44:29 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:44:29 user nova-compute[74242]:   <serial>35ac1144-f0a1-41f0-aa6b-b24c056d71c0</serial>
Oct 20 02:44:29 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:44:29 user nova-compute[74242]: </disk>
Oct 20 02:44:29 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:44:29 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Successfully detached device vdb from instance c06ea651-c372-496b-9500-2570af45c654 from the persistent domain config.
Oct 20 02:44:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c06ea651-c372-496b-9500-2570af45c654 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:44:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:44:29 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:44:29 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:44:29 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:44:29 user nova-compute[74242]:   <serial>35ac1144-f0a1-41f0-aa6b-b24c056d71c0</serial>
Oct 20 02:44:29 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:44:29 user nova-compute[74242]: </disk>
Oct 20 02:44:29 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:44:30 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c06ea651-c372-496b-9500-2570af45c654 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:44:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:33 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:44:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:44:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:44:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:44:38 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:44:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:44:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:44:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:44:43 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:44:50 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c06ea651-c372-496b-9500-2570af45c654 is timed out.
Oct 20 02:44:50 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Successfully detached device vdb from instance c06ea651-c372-496b-9500-2570af45c654 from the live domain config.
Oct 20 02:44:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMkKSQlx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:44:50 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8b5aad-df42-4f87-9a9a-04ca9eb24025]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:44:50 user nova-compute[74242]: No targets found.
Oct 20 02:44:50 user nova-compute[74242]: iSNS:
Oct 20 02:44:50 user nova-compute[74242]: No targets found.
Oct 20 02:44:50 user nova-compute[74242]: STATIC:
Oct 20 02:44:50 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0
Oct 20 02:44:50 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:44:50 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:44:50 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a
Oct 20 02:44:50 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:44:50 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:44:50 user nova-compute[74242]: FIRMWARE:
Oct 20 02:44:50 user nova-compute[74242]: No targets found.
Oct 20 02:44:50 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:44:50 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:44:50 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8121c63-c3f8-4ad9-87c4-6f8961671567]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4452b7-1515-4277-9bf2-e56172fd8a47]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 (non-flash)
Oct 20 02:44:50 user nova-compute[74242]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a (non-flash)
Oct 20 02:44:50 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 (non-flash)
Oct 20 02:44:50 user nova-compute[74242]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a (non-flash)
Oct 20 02:44:50 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d8183400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0'): ({'sdb'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Removing single pathed devices sdb {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[caae207c-0e77-4185-bdca-51f7733d0446]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc5cb73-5417-4e88-a152-06f31264847b]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Flushing IO for device /dev/sdb {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0de7e7-b347-4ee8-959f-65f764fd6b50]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a05d9098-d03f-4e3c-acd2-b9afa3b7336f]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f93cf24-5196-4a3e-af16-69cfd9af0d0d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d2fdca-c328-4f8f-9186-cef33e2e2ae2]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0, portal: 172.16.0.220,3260]
Oct 20 02:44:50 user nova-compute[74242]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0, portal: 172.16.0.220,3260] successful.
Oct 20 02:44:50 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:35ac1144-f0a1-41f0-aa6b-b24c056d71c0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d5d388-c71f-46dd-af7b-7aba2f3b7063]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] <== disconnect_volume: return (298ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:44:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:44:51 user nova-compute[74242]: DEBUG nova.objects.instance [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'flavor' on Instance uuid c06ea651-c372-496b-9500-2570af45c654 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:44:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-bae97957-468f-42cf-8fc2-e6fd40a4dd70 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.717s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:44:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "c06ea651-c372-496b-9500-2570af45c654" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:44:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:44:52 user nova-compute[74242]: INFO nova.compute.manager [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Detaching volume 52421533-9e6c-40c7-91bd-528efe3b397a
Oct 20 02:44:52 user nova-compute[74242]: INFO nova.virt.block_device [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Attempting to driver detach volume 52421533-9e6c-40c7-91bd-528efe3b397a from mountpoint /dev/vdc
Oct 20 02:44:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Attempting to detach device vdc from instance c06ea651-c372-496b-9500-2570af45c654 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:44:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:44:52 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:44:52 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:44:52 user nova-compute[74242]:   <target dev="vdc" bus="virtio"/>
Oct 20 02:44:52 user nova-compute[74242]:   <serial>52421533-9e6c-40c7-91bd-528efe3b397a</serial>
Oct 20 02:44:52 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 02:44:52 user nova-compute[74242]: </disk>
Oct 20 02:44:52 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:44:52 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Successfully detached device vdc from instance c06ea651-c372-496b-9500-2570af45c654 from the persistent domain config.
Oct 20 02:44:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance c06ea651-c372-496b-9500-2570af45c654 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:44:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:44:52 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:44:52 user nova-compute[74242]:   <source dev="/dev/sdc"/>
Oct 20 02:44:52 user nova-compute[74242]:   <target dev="vdc" bus="virtio"/>
Oct 20 02:44:52 user nova-compute[74242]:   <serial>52421533-9e6c-40c7-91bd-528efe3b397a</serial>
Oct 20 02:44:52 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 20 02:44:52 user nova-compute[74242]: </disk>
Oct 20 02:44:52 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:44:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance c06ea651-c372-496b-9500-2570af45c654 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:44:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:44:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:44:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:44:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:44:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:44:54 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:44:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:44:58 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:44:58 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:44:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-34b108c8-3029-4a2b-b2d0-15aae1b222b5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:44:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-34b108c8-3029-4a2b-b2d0-15aae1b222b5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:44:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:44:58 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Updating instance_info_cache with network_info: [{"id": "037e3efc-59df-4b8a-a9bd-568421684fa4", "address": "fa:16:3e:d9:07:b9", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e3efc-59", "ovs_interfaceid": "037e3efc-59df-4b8a-a9bd-568421684fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:44:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-34b108c8-3029-4a2b-b2d0-15aae1b222b5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:44:58 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:44:59 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:45:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:45:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:45:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:45:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:45:03 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:03 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:45:03 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:45:05 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:45:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:45:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:45:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:45:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:45:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:06 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:45:06 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:45:06 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8853MB free_disk=24.881134033203125GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:45:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:45:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:45:06 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c06ea651-c372-496b-9500-2570af45c654 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:45:06 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 34b108c8-3029-4a2b-b2d0-15aae1b222b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:45:06 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:45:06 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:45:06 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:45:06 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:45:06 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:45:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.181s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:45:07 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:45:08 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:45:11 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:45:12 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance c06ea651-c372-496b-9500-2570af45c654 is timed out.
Oct 20 02:45:12 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Successfully detached device vdc from instance c06ea651-c372-496b-9500-2570af45c654 from the live domain config.
Oct 20 02:45:12 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WvrjqSgu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:45:12 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[862a3b00-92e9-4155-9552-c251ca0c2d9d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:45:12 user nova-compute[74242]: No targets found.
Oct 20 02:45:12 user nova-compute[74242]: iSNS:
Oct 20 02:45:12 user nova-compute[74242]: No targets found.
Oct 20 02:45:12 user nova-compute[74242]: STATIC:
Oct 20 02:45:12 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a
Oct 20 02:45:12 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:45:12 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:45:12 user nova-compute[74242]: FIRMWARE:
Oct 20 02:45:12 user nova-compute[74242]: No targets found.
Oct 20 02:45:12 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:45:12 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:45:12 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4242bb-d480-4047-8a79-0f265251f34b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb154dc-cc38-4e00-a360-989f04e3f66e]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a (non-flash)
Oct 20 02:45:12 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a (non-flash)
Oct 20 02:45:12 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8946f1bd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a'): ({'sdc'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Removing single pathed devices sdc {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e98db8e-db14-4c12-864f-cd9c4e5ffc6b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ebb6fb1-1716-43bb-896e-b7d140097f40]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Flushing IO for device /dev/sdc {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[09ca651a-94ed-40a2-a44a-e195b99b97e9]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.047s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db55b19-3501-4ec2-9c09-f32591ca2491]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9f6621-1791-46ec-941a-266c5bd0e15b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:45:12 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[59333ccf-b8a6-4c14-b201-8cbbbdc141bf]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a, portal: 172.16.0.220,3260]
Oct 20 02:45:13 user nova-compute[74242]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a, portal: 172.16.0.220,3260] successful.
Oct 20 02:45:13 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52421533-9e6c-40c7-91bd-528efe3b397a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b082328a-622a-428a-81db-bb49e7a7f69c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] <== disconnect_volume: return (323ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG nova.objects.instance [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'flavor' on Instance uuid c06ea651-c372-496b-9500-2570af45c654 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:45:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-17063d77-00ab-4e43-923d-b204f3309790 tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.651s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:45:14 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "c06ea651-c372-496b-9500-2570af45c654" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "c06ea651-c372-496b-9500-2570af45c654-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:45:15 user nova-compute[74242]: INFO nova.compute.manager [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Terminating instance
Oct 20 02:45:15 user nova-compute[74242]: DEBUG nova.compute.manager [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-aeb9c8f0-0609-45c9-945e-91f01cb96624 req-e3bd5ab9-4c39-4b96-8bf1-5c20739fd3a2 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Received event network-vif-unplugged-2636e767-6bcb-4d05-8fa4-1361c8aeb592 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-aeb9c8f0-0609-45c9-945e-91f01cb96624 req-e3bd5ab9-4c39-4b96-8bf1-5c20739fd3a2 service nova] Acquiring lock "c06ea651-c372-496b-9500-2570af45c654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-aeb9c8f0-0609-45c9-945e-91f01cb96624 req-e3bd5ab9-4c39-4b96-8bf1-5c20739fd3a2 service nova] Lock "c06ea651-c372-496b-9500-2570af45c654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-aeb9c8f0-0609-45c9-945e-91f01cb96624 req-e3bd5ab9-4c39-4b96-8bf1-5c20739fd3a2 service nova] Lock "c06ea651-c372-496b-9500-2570af45c654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-aeb9c8f0-0609-45c9-945e-91f01cb96624 req-e3bd5ab9-4c39-4b96-8bf1-5c20739fd3a2 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] No waiting events found dispatching network-vif-unplugged-2636e767-6bcb-4d05-8fa4-1361c8aeb592 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG nova.compute.manager [req-aeb9c8f0-0609-45c9-945e-91f01cb96624 req-e3bd5ab9-4c39-4b96-8bf1-5c20739fd3a2 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Received event network-vif-unplugged-2636e767-6bcb-4d05-8fa4-1361c8aeb592 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:15 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c06ea651-c372-496b-9500-2570af45c654] Instance destroyed successfully.
Oct 20 02:45:15 user nova-compute[74242]: DEBUG nova.objects.instance [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lazy-loading 'resources' on Instance uuid c06ea651-c372-496b-9500-2570af45c654 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:41:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1279419196',display_name='tempest-AttachVolumeTestJSON-server-1279419196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1279419196',id=48,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPRm7Qi1H6jYXEQpoHY/Jl/vV1mC2fWKPucm/W0k/tUZ/WhLepKaSrIOCQpYBqx6TSB8CpM1gXD+LeJuUfnohrTNBABFiQKcuAfGzHHQASwfeC6CBEdX7RlxxjqhSGF2/w==',key_name='tempest-keypair-506134978',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:41:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='86bf4c560c2a4a078d0f43aae70d4fd3',ramdisk_id='',reservation_id='r-193mlgtn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-47724960',owner_user_name='tempest-AttachVolumeTestJSON-47724960-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:41:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61536bdce5184c989843cc225dd547a0',uuid=c06ea651-c372-496b-9500-2570af45c654,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "address": "fa:16:3e:d8:66:ec", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2636e767-6b", "ovs_interfaceid": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converting VIF {"id": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "address": "fa:16:3e:d8:66:ec", "network": {"id": "53769ae9-271a-4d0a-b54d-66d7d47532f0", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-2054686102-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.163", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "86bf4c560c2a4a078d0f43aae70d4fd3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2636e767-6b", "ovs_interfaceid": "2636e767-6bcb-4d05-8fa4-1361c8aeb592", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:66:ec,bridge_name='br-int',has_traffic_filtering=True,id=2636e767-6bcb-4d05-8fa4-1361c8aeb592,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2636e767-6b') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG os_vif [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:66:ec,bridge_name='br-int',has_traffic_filtering=True,id=2636e767-6bcb-4d05-8fa4-1361c8aeb592,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2636e767-6b') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2636e767-6b, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d38a5951-1e92-481f-aaf9-9aa98f7dcc2c) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:45:15 user nova-compute[74242]: INFO os_vif [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:66:ec,bridge_name='br-int',has_traffic_filtering=True,id=2636e767-6bcb-4d05-8fa4-1361c8aeb592,network=Network(53769ae9-271a-4d0a-b54d-66d7d47532f0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2636e767-6b')
Oct 20 02:45:15 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Deleting instance files /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654_del
Oct 20 02:45:15 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Deletion of /opt/stack/data/nova/instances/c06ea651-c372-496b-9500-2570af45c654_del complete
Oct 20 02:45:15 user nova-compute[74242]: INFO nova.compute.manager [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] [instance: c06ea651-c372-496b-9500-2570af45c654] Took 0.84 seconds to destroy the instance on the hypervisor.
Oct 20 02:45:15 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: c06ea651-c372-496b-9500-2570af45c654] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:45:15 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: c06ea651-c372-496b-9500-2570af45c654] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:45:16 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: c06ea651-c372-496b-9500-2570af45c654] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:45:16 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: c06ea651-c372-496b-9500-2570af45c654] Took 0.93 seconds to deallocate network for instance.
Oct 20 02:45:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-413afb90-795a-44c3-8456-f1e607fcf2a2 req-cb859e32-1053-4ec4-9e5a-936c59c3a53b service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Received event network-vif-deleted-2636e767-6bcb-4d05-8fa4-1361c8aeb592 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:45:16 user nova-compute[74242]: INFO nova.compute.manager [req-413afb90-795a-44c3-8456-f1e607fcf2a2 req-cb859e32-1053-4ec4-9e5a-936c59c3a53b service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Neutron deleted interface 2636e767-6bcb-4d05-8fa4-1361c8aeb592; detaching it from the instance and deleting it from the info cache
Oct 20 02:45:16 user nova-compute[74242]: DEBUG nova.network.neutron [req-413afb90-795a-44c3-8456-f1e607fcf2a2 req-cb859e32-1053-4ec4-9e5a-936c59c3a53b service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:45:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-413afb90-795a-44c3-8456-f1e607fcf2a2 req-cb859e32-1053-4ec4-9e5a-936c59c3a53b service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Detach interface failed, port_id=2636e767-6bcb-4d05-8fa4-1361c8aeb592, reason: Instance c06ea651-c372-496b-9500-2570af45c654 could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:45:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:45:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:45:17 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:45:17 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:45:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.133s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:45:17 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Deleted allocations for instance c06ea651-c372-496b-9500-2570af45c654
Oct 20 02:45:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-f785bfdc-5405-4d46-8eb7-ea87f1b86bef tempest-AttachVolumeTestJSON-47724960 tempest-AttachVolumeTestJSON-47724960-project-member] Lock "c06ea651-c372-496b-9500-2570af45c654" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.085s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:45:17 user nova-compute[74242]: DEBUG nova.compute.manager [req-7a8f0447-50fe-4cc4-926f-f78a5cb0928b req-e0fe4bc7-ea89-45d3-aa53-b10f57a846d1 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Received event network-vif-plugged-2636e767-6bcb-4d05-8fa4-1361c8aeb592 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:45:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7a8f0447-50fe-4cc4-926f-f78a5cb0928b req-e0fe4bc7-ea89-45d3-aa53-b10f57a846d1 service nova] Acquiring lock "c06ea651-c372-496b-9500-2570af45c654-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:45:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7a8f0447-50fe-4cc4-926f-f78a5cb0928b req-e0fe4bc7-ea89-45d3-aa53-b10f57a846d1 service nova] Lock "c06ea651-c372-496b-9500-2570af45c654-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:45:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-7a8f0447-50fe-4cc4-926f-f78a5cb0928b req-e0fe4bc7-ea89-45d3-aa53-b10f57a846d1 service nova] Lock "c06ea651-c372-496b-9500-2570af45c654-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:45:17 user nova-compute[74242]: DEBUG nova.compute.manager [req-7a8f0447-50fe-4cc4-926f-f78a5cb0928b req-e0fe4bc7-ea89-45d3-aa53-b10f57a846d1 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] No waiting events found dispatching network-vif-plugged-2636e767-6bcb-4d05-8fa4-1361c8aeb592 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:45:17 user nova-compute[74242]: WARNING nova.compute.manager [req-7a8f0447-50fe-4cc4-926f-f78a5cb0928b req-e0fe4bc7-ea89-45d3-aa53-b10f57a846d1 service nova] [instance: c06ea651-c372-496b-9500-2570af45c654] Received unexpected event network-vif-plugged-2636e767-6bcb-4d05-8fa4-1361c8aeb592 for instance with vm_state deleted and task_state None.
Oct 20 02:45:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:30 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:45:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:45:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:45:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:45:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:45:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:45:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-ac54a602-39a5-413d-8f30-eb273e13496c req-391bfc4a-b5c3-43a6-9a08-0e6a6900a277 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Received event network-changed-037e3efc-59df-4b8a-a9bd-568421684fa4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:45:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-ac54a602-39a5-413d-8f30-eb273e13496c req-391bfc4a-b5c3-43a6-9a08-0e6a6900a277 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Refreshing instance network info cache due to event network-changed-037e3efc-59df-4b8a-a9bd-568421684fa4. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:45:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ac54a602-39a5-413d-8f30-eb273e13496c req-391bfc4a-b5c3-43a6-9a08-0e6a6900a277 service nova] Acquiring lock "refresh_cache-34b108c8-3029-4a2b-b2d0-15aae1b222b5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:45:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ac54a602-39a5-413d-8f30-eb273e13496c req-391bfc4a-b5c3-43a6-9a08-0e6a6900a277 service nova] Acquired lock "refresh_cache-34b108c8-3029-4a2b-b2d0-15aae1b222b5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:45:41 user nova-compute[74242]: DEBUG nova.network.neutron [req-ac54a602-39a5-413d-8f30-eb273e13496c req-391bfc4a-b5c3-43a6-9a08-0e6a6900a277 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Refreshing network info cache for port 037e3efc-59df-4b8a-a9bd-568421684fa4 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:45:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:45:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:45:41 user nova-compute[74242]: DEBUG nova.objects.instance [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lazy-loading 'flavor' on Instance uuid 34b108c8-3029-4a2b-b2d0-15aae1b222b5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:45:41 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Ignoring supplied device name: /dev/vdb
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG nova.network.neutron [req-ac54a602-39a5-413d-8f30-eb273e13496c req-391bfc4a-b5c3-43a6-9a08-0e6a6900a277 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Updated VIF entry in instance network info cache for port 037e3efc-59df-4b8a-a9bd-568421684fa4. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG nova.network.neutron [req-ac54a602-39a5-413d-8f30-eb273e13496c req-391bfc4a-b5c3-43a6-9a08-0e6a6900a277 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Updating instance_info_cache with network_info: [{"id": "037e3efc-59df-4b8a-a9bd-568421684fa4", "address": "fa:16:3e:d9:07:b9", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e3efc-59", "ovs_interfaceid": "037e3efc-59df-4b8a-a9bd-568421684fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:45:42 user nova-compute[74242]: INFO nova.compute.manager [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Attaching volume d297b93e-1668-4b85-a769-4c688520cb64 to /dev/vdb
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ac54a602-39a5-413d-8f30-eb273e13496c req-391bfc4a-b5c3-43a6-9a08-0e6a6900a277 service nova] Releasing lock "refresh_cache-34b108c8-3029-4a2b-b2d0-15aae1b222b5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG os_brick.utils [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[627b7142-0d86-41a1-ac23-79909c555835]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05f954a-fa26-4f52-8af8-39a842915319]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[672f5c2c-a47f-4c29-9d08-8ff87b0ff141]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f5b1a40-c9f0-49ab-829d-0b201abe4346]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:45:42 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:45:42 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ccd300-29c7-4c12-aa52-0916befd3639]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG os_brick.utils [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:45:42 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Updating existing volume attachment record: 4979dace-24a7-416e-a75d-dd2d4a785b43 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:45:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:45:54 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:45:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:45:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:45:57 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPGIUYCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:45:57 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:45:57 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:45:57 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:45:57 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:45:57 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:45:57 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:45:57 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:45:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:57 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[adc9ca98-e39b-4df1-8870-223895be8606]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:57 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:45:57 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:45:57 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b79a66-669a-43fa-bd7e-f5eced5711d3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64] added
Oct 20 02:45:58 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[32bdf60e-0ef2-4b9f-8295-24b120df43cf]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8a06e3-b83a-447c-93c5-2764dadf374d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPGIUYCH {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pPGIUYCH" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de90981-40c6-449d-9d15-27bf7132030d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pPGIUYCH'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb62d607-2654-4197-aad9-2179ca308e63]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40929e5-50ae-4a73-9277-47ab855482ab]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 02:45:58 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 02:45:58 user nova-compute[74242]:  {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:45:58 user nova-compute[74242]: WARNING os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 02:45:58 user nova-compute[74242]: 
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34dc317-4d52-47de-b159-08608d97432e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64, portal: 172.16.0.220,3260]
Oct 20 02:45:58 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64, portal: 172.16.0.220,3260] successful.
Oct 20 02:45:58 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a251f6-1662-4264-9744-5caecbf77db6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[521d5e18-60b4-4ced-8583-69b50e17d7be]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 (non-flash)
Oct 20 02:45:58 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 (non-flash)
Oct 20 02:45:58 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0d8880-5eb7-41a4-be86-33b605ee676c]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:45:58 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPGIUYCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '23664346461626266', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664346461626266', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG nova.objects.instance [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lazy-loading 'flavor' on Instance uuid 34b108c8-3029-4a2b-b2d0-15aae1b222b5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:45:59 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:45:59 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:45:59 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:45:59 user nova-compute[74242]:   <serial>d297b93e-1668-4b85-a769-4c688520cb64</serial>
Oct 20 02:45:59 user nova-compute[74242]: </disk>
Oct 20 02:45:59 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-34b108c8-3029-4a2b-b2d0-15aae1b222b5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-34b108c8-3029-4a2b-b2d0-15aae1b222b5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid 34b108c8-3029-4a2b-b2d0-15aae1b222b5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] No VIF found with MAC fa:16:3e:d9:07:b9, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Updating instance_info_cache with network_info: [{"id": "037e3efc-59df-4b8a-a9bd-568421684fa4", "address": "fa:16:3e:d9:07:b9", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e3efc-59", "ovs_interfaceid": "037e3efc-59df-4b8a-a9bd-568421684fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-34b108c8-3029-4a2b-b2d0-15aae1b222b5" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:45:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-cf92d6d5-d5d2-416d-a899-a7a09edc521d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.688s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:46:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:01 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:46:04 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:46:04 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:46:05 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:46:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:46:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:46:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:46:05 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:46:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:46:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:46:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:46:05 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:46:05 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:46:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:06 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:46:06 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:46:06 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8940MB free_disk=24.907878875732422GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:46:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:46:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:46:06 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 34b108c8-3029-4a2b-b2d0-15aae1b222b5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:46:06 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:46:06 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:46:06 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:46:06 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:46:06 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:46:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.204s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:46:07 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:46:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:46:11 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:46:12 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:46:15 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:46:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:46:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:46:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:46:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:46:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:46:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Acquiring lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:46:50 user nova-compute[74242]: INFO nova.compute.claims [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Claim successful on node user
Oct 20 02:46:50 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.217s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG nova.network.neutron [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:46:50 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:46:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG nova.policy [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'da03cee5739d4a8391c3c23ceac9b26b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '571c1401257c4fe6ab758fdb8d72ae0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG nova.compute.manager [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:46:50 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Creating image(s)
Oct 20 02:46:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Acquiring lock "/opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "/opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "/opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.196s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.194s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:46:50 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk 1073741824" returned: 0 in 0.057s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG nova.network.neutron [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Successfully created port: 88ebbf25-69f2-4d61-b125-4021c05588b7 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Cannot resize image /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Ensure instance console log exists: /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG nova.network.neutron [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Successfully updated port: 88ebbf25-69f2-4d61-b125-4021c05588b7 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Acquiring lock "refresh_cache-1dc47370-8b4e-4324-9a57-9699fe9c1bc7" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Acquired lock "refresh_cache-1dc47370-8b4e-4324-9a57-9699fe9c1bc7" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG nova.network.neutron [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-62a87f33-6bbf-4eb8-bfe9-f4a7a57f4b4e req-777d08a6-0fa5-4c20-b3bb-71e15214f3c6 service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Received event network-changed-88ebbf25-69f2-4d61-b125-4021c05588b7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG nova.compute.manager [req-62a87f33-6bbf-4eb8-bfe9-f4a7a57f4b4e req-777d08a6-0fa5-4c20-b3bb-71e15214f3c6 service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Refreshing instance network info cache due to event network-changed-88ebbf25-69f2-4d61-b125-4021c05588b7. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-62a87f33-6bbf-4eb8-bfe9-f4a7a57f4b4e req-777d08a6-0fa5-4c20-b3bb-71e15214f3c6 service nova] Acquiring lock "refresh_cache-1dc47370-8b4e-4324-9a57-9699fe9c1bc7" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:46:51 user nova-compute[74242]: DEBUG nova.network.neutron [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.network.neutron [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Updating instance_info_cache with network_info: [{"id": "88ebbf25-69f2-4d61-b125-4021c05588b7", "address": "fa:16:3e:78:c1:82", "network": {"id": "b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f53bfbdbe54c483e811b420774698154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ebbf25-69", "ovs_interfaceid": "88ebbf25-69f2-4d61-b125-4021c05588b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Releasing lock "refresh_cache-1dc47370-8b4e-4324-9a57-9699fe9c1bc7" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.compute.manager [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Instance network_info: |[{"id": "88ebbf25-69f2-4d61-b125-4021c05588b7", "address": "fa:16:3e:78:c1:82", "network": {"id": "b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f53bfbdbe54c483e811b420774698154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ebbf25-69", "ovs_interfaceid": "88ebbf25-69f2-4d61-b125-4021c05588b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-62a87f33-6bbf-4eb8-bfe9-f4a7a57f4b4e req-777d08a6-0fa5-4c20-b3bb-71e15214f3c6 service nova] Acquired lock "refresh_cache-1dc47370-8b4e-4324-9a57-9699fe9c1bc7" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.network.neutron [req-62a87f33-6bbf-4eb8-bfe9-f4a7a57f4b4e req-777d08a6-0fa5-4c20-b3bb-71e15214f3c6 service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Refreshing network info cache for port 88ebbf25-69f2-4d61-b125-4021c05588b7 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Start _get_guest_xml network_info=[{"id": "88ebbf25-69f2-4d61-b125-4021c05588b7", "address": "fa:16:3e:78:c1:82", "network": {"id": "b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f53bfbdbe54c483e811b420774698154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ebbf25-69", "ovs_interfaceid": "88ebbf25-69f2-4d61-b125-4021c05588b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:46:52 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:46:52 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-569819290',display_name='tempest-VolumesNegativeTest-instance-569819290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-569819290',id=50,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='571c1401257c4fe6ab758fdb8d72ae0c',ramdisk_id='',reservation_id='r-kemxg6ab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-170121169',owner_user_name='tempest-VolumesNegativeTest-170121169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:46:51Z,user_data=None,user_id='da03cee5739d4a8391c3c23ceac9b26b',uuid=1dc47370-8b4e-4324-9a57-9699fe9c1bc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88ebbf25-69f2-4d61-b125-4021c05588b7", "address": "fa:16:3e:78:c1:82", "network": {"id": "b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f53bfbdbe54c483e811b420774698154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ebbf25-69", "ovs_interfaceid": "88ebbf25-69f2-4d61-b125-4021c05588b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Converting VIF {"id": "88ebbf25-69f2-4d61-b125-4021c05588b7", "address": "fa:16:3e:78:c1:82", "network": {"id": "b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f53bfbdbe54c483e811b420774698154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ebbf25-69", "ovs_interfaceid": "88ebbf25-69f2-4d61-b125-4021c05588b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:c1:82,bridge_name='br-int',has_traffic_filtering=True,id=88ebbf25-69f2-4d61-b125-4021c05588b7,network=Network(b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ebbf25-69') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.objects.instance [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lazy-loading 'pci_devices' on Instance uuid 1dc47370-8b4e-4324-9a57-9699fe9c1bc7 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:46:52 user nova-compute[74242]:   <uuid>1dc47370-8b4e-4324-9a57-9699fe9c1bc7</uuid>
Oct 20 02:46:52 user nova-compute[74242]:   <name>instance-00000032</name>
Oct 20 02:46:52 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:46:52 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:46:52 user nova-compute[74242]:   <metadata>
Oct 20 02:46:52 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:46:52 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:46:52 user nova-compute[74242]:       <nova:name>tempest-VolumesNegativeTest-instance-569819290</nova:name>
Oct 20 02:46:52 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:46:52</nova:creationTime>
Oct 20 02:46:52 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:46:52 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:46:52 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:46:52 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:46:52 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:46:52 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:46:52 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:46:52 user nova-compute[74242]:       <nova:owner>
Oct 20 02:46:52 user nova-compute[74242]:         <nova:user uuid="da03cee5739d4a8391c3c23ceac9b26b">tempest-VolumesNegativeTest-170121169-project-member</nova:user>
Oct 20 02:46:52 user nova-compute[74242]:         <nova:project uuid="571c1401257c4fe6ab758fdb8d72ae0c">tempest-VolumesNegativeTest-170121169</nova:project>
Oct 20 02:46:52 user nova-compute[74242]:       </nova:owner>
Oct 20 02:46:52 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:46:52 user nova-compute[74242]:       <nova:ports>
Oct 20 02:46:52 user nova-compute[74242]:         <nova:port uuid="88ebbf25-69f2-4d61-b125-4021c05588b7">
Oct 20 02:46:52 user nova-compute[74242]:           <nova:ip type="fixed" address="192.168.233.194" ipVersion="4"/>
Oct 20 02:46:52 user nova-compute[74242]:         </nova:port>
Oct 20 02:46:52 user nova-compute[74242]:       </nova:ports>
Oct 20 02:46:52 user nova-compute[74242]:     </nova:instance>
Oct 20 02:46:52 user nova-compute[74242]:   </metadata>
Oct 20 02:46:52 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:46:52 user nova-compute[74242]:     <system>
Oct 20 02:46:52 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:46:52 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:46:52 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:46:52 user nova-compute[74242]:       <entry name="serial">1dc47370-8b4e-4324-9a57-9699fe9c1bc7</entry>
Oct 20 02:46:52 user nova-compute[74242]:       <entry name="uuid">1dc47370-8b4e-4324-9a57-9699fe9c1bc7</entry>
Oct 20 02:46:52 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:46:52 user nova-compute[74242]:     </system>
Oct 20 02:46:52 user nova-compute[74242]:   </sysinfo>
Oct 20 02:46:52 user nova-compute[74242]:   <os>
Oct 20 02:46:52 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:46:52 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:46:52 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:46:52 user nova-compute[74242]:   </os>
Oct 20 02:46:52 user nova-compute[74242]:   <features>
Oct 20 02:46:52 user nova-compute[74242]:     <acpi/>
Oct 20 02:46:52 user nova-compute[74242]:     <apic/>
Oct 20 02:46:52 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:46:52 user nova-compute[74242]:   </features>
Oct 20 02:46:52 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:46:52 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:46:52 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:46:52 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:46:52 user nova-compute[74242]:   </clock>
Oct 20 02:46:52 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:46:52 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:46:52 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:46:52 user nova-compute[74242]:   </cpu>
Oct 20 02:46:52 user nova-compute[74242]:   <devices>
Oct 20 02:46:52 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:46:52 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:46:52 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk"/>
Oct 20 02:46:52 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:46:52 user nova-compute[74242]:     </disk>
Oct 20 02:46:52 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:46:52 user nova-compute[74242]:       <mac address="fa:16:3e:78:c1:82"/>
Oct 20 02:46:52 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:46:52 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:46:52 user nova-compute[74242]:       <target dev="tap88ebbf25-69"/>
Oct 20 02:46:52 user nova-compute[74242]:     </interface>
Oct 20 02:46:52 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:46:52 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/console.log" append="off"/>
Oct 20 02:46:52 user nova-compute[74242]:     </serial>
Oct 20 02:46:52 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:46:52 user nova-compute[74242]:     <video>
Oct 20 02:46:52 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:46:52 user nova-compute[74242]:     </video>
Oct 20 02:46:52 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:46:52 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:46:52 user nova-compute[74242]:     </rng>
Oct 20 02:46:52 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:46:52 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:46:52 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:46:52 user nova-compute[74242]:     </memballoon>
Oct 20 02:46:52 user nova-compute[74242]:   </devices>
Oct 20 02:46:52 user nova-compute[74242]: </domain>
Oct 20 02:46:52 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-569819290',display_name='tempest-VolumesNegativeTest-instance-569819290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-569819290',id=50,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='571c1401257c4fe6ab758fdb8d72ae0c',ramdisk_id='',reservation_id='r-kemxg6ab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-170121169',owner_user_name='tempest-VolumesNegativeTest-170121169-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:46:51Z,user_data=None,user_id='da03cee5739d4a8391c3c23ceac9b26b',uuid=1dc47370-8b4e-4324-9a57-9699fe9c1bc7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "88ebbf25-69f2-4d61-b125-4021c05588b7", "address": "fa:16:3e:78:c1:82", "network": {"id": "b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f53bfbdbe54c483e811b420774698154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ebbf25-69", "ovs_interfaceid": "88ebbf25-69f2-4d61-b125-4021c05588b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Converting VIF {"id": "88ebbf25-69f2-4d61-b125-4021c05588b7", "address": "fa:16:3e:78:c1:82", "network": {"id": "b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f53bfbdbe54c483e811b420774698154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ebbf25-69", "ovs_interfaceid": "88ebbf25-69f2-4d61-b125-4021c05588b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:c1:82,bridge_name='br-int',has_traffic_filtering=True,id=88ebbf25-69f2-4d61-b125-4021c05588b7,network=Network(b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ebbf25-69') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG os_vif [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:c1:82,bridge_name='br-int',has_traffic_filtering=True,id=88ebbf25-69f2-4d61-b125-4021c05588b7,network=Network(b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ebbf25-69') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b65cddb-4b95-5da3-92f0-337bd0b03897', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap88ebbf25-69, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap88ebbf25-69, col_values=(('qos', UUID('c3dc7044-2096-4601-a53c-a3806e10860d')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap88ebbf25-69, col_values=(('external_ids', {'iface-id': '88ebbf25-69f2-4d61-b125-4021c05588b7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:c1:82', 'vm-uuid': '1dc47370-8b4e-4324-9a57-9699fe9c1bc7'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:52 user nova-compute[74242]: INFO os_vif [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:c1:82,bridge_name='br-int',has_traffic_filtering=True,id=88ebbf25-69f2-4d61-b125-4021c05588b7,network=Network(b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ebbf25-69')
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] No VIF found with MAC fa:16:3e:78:c1:82, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.network.neutron [req-62a87f33-6bbf-4eb8-bfe9-f4a7a57f4b4e req-777d08a6-0fa5-4c20-b3bb-71e15214f3c6 service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Updated VIF entry in instance network info cache for port 88ebbf25-69f2-4d61-b125-4021c05588b7. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG nova.network.neutron [req-62a87f33-6bbf-4eb8-bfe9-f4a7a57f4b4e req-777d08a6-0fa5-4c20-b3bb-71e15214f3c6 service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Updating instance_info_cache with network_info: [{"id": "88ebbf25-69f2-4d61-b125-4021c05588b7", "address": "fa:16:3e:78:c1:82", "network": {"id": "b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f53bfbdbe54c483e811b420774698154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ebbf25-69", "ovs_interfaceid": "88ebbf25-69f2-4d61-b125-4021c05588b7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:46:52 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-62a87f33-6bbf-4eb8-bfe9-f4a7a57f4b4e req-777d08a6-0fa5-4c20-b3bb-71e15214f3c6 service nova] Releasing lock "refresh_cache-1dc47370-8b4e-4324-9a57-9699fe9c1bc7" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:46:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:53 user nova-compute[74242]: DEBUG nova.compute.manager [req-5fe676e1-c1c5-4c57-9b69-19a06f998f1d req-e7a7cb98-8a2c-4a1d-bde2-df03f0eab038 service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Received event network-vif-plugged-88ebbf25-69f2-4d61-b125-4021c05588b7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:46:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5fe676e1-c1c5-4c57-9b69-19a06f998f1d req-e7a7cb98-8a2c-4a1d-bde2-df03f0eab038 service nova] Acquiring lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:46:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5fe676e1-c1c5-4c57-9b69-19a06f998f1d req-e7a7cb98-8a2c-4a1d-bde2-df03f0eab038 service nova] Lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:46:53 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-5fe676e1-c1c5-4c57-9b69-19a06f998f1d req-e7a7cb98-8a2c-4a1d-bde2-df03f0eab038 service nova] Lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:46:53 user nova-compute[74242]: DEBUG nova.compute.manager [req-5fe676e1-c1c5-4c57-9b69-19a06f998f1d req-e7a7cb98-8a2c-4a1d-bde2-df03f0eab038 service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] No waiting events found dispatching network-vif-plugged-88ebbf25-69f2-4d61-b125-4021c05588b7 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:46:53 user nova-compute[74242]: WARNING nova.compute.manager [req-5fe676e1-c1c5-4c57-9b69-19a06f998f1d req-e7a7cb98-8a2c-4a1d-bde2-df03f0eab038 service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Received unexpected event network-vif-plugged-88ebbf25-69f2-4d61-b125-4021c05588b7 for instance with vm_state building and task_state spawning.
Oct 20 02:46:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:55 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:46:55 user nova-compute[74242]: DEBUG nova.compute.manager [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:46:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:46:55 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Instance spawned successfully.
Oct 20 02:46:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:46:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:46:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:46:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:46:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:46:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:46:55 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:46:55 user nova-compute[74242]: INFO nova.compute.manager [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Took 5.23 seconds to spawn the instance on the hypervisor.
Oct 20 02:46:55 user nova-compute[74242]: DEBUG nova.compute.manager [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:46:55 user nova-compute[74242]: INFO nova.compute.manager [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Took 5.79 seconds to build instance.
Oct 20 02:46:55 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-04cfd8d1-cf06-4dc1-b45a-a984a4b3391d tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.888s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:46:55 user nova-compute[74242]: DEBUG nova.compute.manager [req-937ac904-5987-48c8-9073-d5d29d023de8 req-e7f5ba71-8c4f-45b9-ba24-b76452518e0f service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Received event network-vif-plugged-88ebbf25-69f2-4d61-b125-4021c05588b7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:46:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-937ac904-5987-48c8-9073-d5d29d023de8 req-e7f5ba71-8c4f-45b9-ba24-b76452518e0f service nova] Acquiring lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:46:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-937ac904-5987-48c8-9073-d5d29d023de8 req-e7f5ba71-8c4f-45b9-ba24-b76452518e0f service nova] Lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:46:56 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-937ac904-5987-48c8-9073-d5d29d023de8 req-e7f5ba71-8c4f-45b9-ba24-b76452518e0f service nova] Lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:46:56 user nova-compute[74242]: DEBUG nova.compute.manager [req-937ac904-5987-48c8-9073-d5d29d023de8 req-e7f5ba71-8c4f-45b9-ba24-b76452518e0f service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] No waiting events found dispatching network-vif-plugged-88ebbf25-69f2-4d61-b125-4021c05588b7 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:46:56 user nova-compute[74242]: WARNING nova.compute.manager [req-937ac904-5987-48c8-9073-d5d29d023de8 req-e7f5ba71-8c4f-45b9-ba24-b76452518e0f service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Received unexpected event network-vif-plugged-88ebbf25-69f2-4d61-b125-4021c05588b7 for instance with vm_state active and task_state None.
Oct 20 02:46:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:46:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:46:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:46:57 user nova-compute[74242]: INFO nova.compute.manager [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Detaching volume d297b93e-1668-4b85-a769-4c688520cb64
Oct 20 02:46:57 user nova-compute[74242]: INFO nova.virt.block_device [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Attempting to driver detach volume d297b93e-1668-4b85-a769-4c688520cb64 from mountpoint /dev/vdb
Oct 20 02:46:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Attempting to detach device vdb from instance 34b108c8-3029-4a2b-b2d0-15aae1b222b5 from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:46:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:46:57 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:46:57 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:46:57 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:46:57 user nova-compute[74242]:   <serial>d297b93e-1668-4b85-a769-4c688520cb64</serial>
Oct 20 02:46:57 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:46:57 user nova-compute[74242]: </disk>
Oct 20 02:46:57 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:46:57 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Successfully detached device vdb from instance 34b108c8-3029-4a2b-b2d0-15aae1b222b5 from the persistent domain config.
Oct 20 02:46:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34b108c8-3029-4a2b-b2d0-15aae1b222b5 from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:46:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:46:57 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:46:57 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:46:57 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:46:57 user nova-compute[74242]:   <serial>d297b93e-1668-4b85-a769-4c688520cb64</serial>
Oct 20 02:46:57 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:46:57 user nova-compute[74242]: </disk>
Oct 20 02:46:57 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:46:57 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:46:57 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34b108c8-3029-4a2b-b2d0-15aae1b222b5 {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:46:59 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:46:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:46:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:46:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Skipping network cache update for instance because it is being deleted. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 20 02:46:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-1dc47370-8b4e-4324-9a57-9699fe9c1bc7" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:46:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-1dc47370-8b4e-4324-9a57-9699fe9c1bc7" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:46:59 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:46:59 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid 1dc47370-8b4e-4324-9a57-9699fe9c1bc7 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:46:59 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Updating instance_info_cache with network_info: [{"id": "88ebbf25-69f2-4d61-b125-4021c05588b7", "address": "fa:16:3e:78:c1:82", "network": {"id": "b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f53bfbdbe54c483e811b420774698154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ebbf25-69", "ovs_interfaceid": "88ebbf25-69f2-4d61-b125-4021c05588b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:46:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-1dc47370-8b4e-4324-9a57-9699fe9c1bc7" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:46:59 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:47:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:02 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:47:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:47:06 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:47:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:47:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:47:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:47:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:47:06 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:47:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:47:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:47:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:47:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:47:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:47:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:47:06 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:47:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:47:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:07 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:47:07 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:47:07 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8757MB free_disk=24.904422760009766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:47:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:47:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:47:07 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 34b108c8-3029-4a2b-b2d0-15aae1b222b5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:47:07 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 1dc47370-8b4e-4324-9a57-9699fe9c1bc7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:47:07 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:47:07 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:47:07 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:47:07 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:47:07 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:47:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:47:08 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:47:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:12 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:47:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:14 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:47:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:17 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:47:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:17 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 34b108c8-3029-4a2b-b2d0-15aae1b222b5 is timed out.
Oct 20 02:47:17 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Successfully detached device vdb from instance 34b108c8-3029-4a2b-b2d0-15aae1b222b5 from the live domain config.
Oct 20 02:47:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:47:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPGIUYCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:47:17 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:47:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:47:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:47:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[102d8082-4150-415c-b858-4ecfd2d178ce]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:47:18 user nova-compute[74242]: No targets found.
Oct 20 02:47:18 user nova-compute[74242]: iSNS:
Oct 20 02:47:18 user nova-compute[74242]: No targets found.
Oct 20 02:47:18 user nova-compute[74242]: STATIC:
Oct 20 02:47:18 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64
Oct 20 02:47:18 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:47:18 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:47:18 user nova-compute[74242]: FIRMWARE:
Oct 20 02:47:18 user nova-compute[74242]: No targets found.
Oct 20 02:47:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:47:18 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:47:18 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3b4928-c157-41bc-8762-975e24962467]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb15028-a073-4a94-86d1-bb10303169e1]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 (non-flash)
Oct 20 02:47:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 (non-flash)
Oct 20 02:47:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b84d6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64'): ({'sdb'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Removing single pathed devices sdb {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[9132fb5a-420d-44fd-bbb5-8f54efe589ad]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[74051a33-cb50-444d-b9a0-91daec80da29]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Flushing IO for device /dev/sdb {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[3117dd07-1977-48cf-9b13-c0fe9cbb317c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b09276bf-39b2-466a-92d7-9cb0eb4cfda2]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb431f15-dc8a-48f1-932a-f70d8873fe4f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf3f959-6003-4291-9b3e-c7524d1e16aa]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64, portal: 172.16.0.220,3260]
Oct 20 02:47:18 user nova-compute[74242]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64, portal: 172.16.0.220,3260] successful.
Oct 20 02:47:18 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7694fff5-84bc-42c6-84ca-0c134e66ee8b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] <== disconnect_volume: return (284ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:47:18 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG nova.objects.instance [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lazy-loading 'flavor' on Instance uuid 34b108c8-3029-4a2b-b2d0-15aae1b222b5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b60fd75e-af94-4efe-b76e-db2382de505d tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.722s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.593s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:47:19 user nova-compute[74242]: INFO nova.compute.manager [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Terminating instance
Oct 20 02:47:19 user nova-compute[74242]: DEBUG nova.compute.manager [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG nova.compute.manager [req-ef07aa30-d734-4b1e-82bc-4a79921d835c req-7edf06be-252e-4a84-8e59-48384fc4bd1c service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Received event network-vif-unplugged-037e3efc-59df-4b8a-a9bd-568421684fa4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ef07aa30-d734-4b1e-82bc-4a79921d835c req-7edf06be-252e-4a84-8e59-48384fc4bd1c service nova] Acquiring lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ef07aa30-d734-4b1e-82bc-4a79921d835c req-7edf06be-252e-4a84-8e59-48384fc4bd1c service nova] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ef07aa30-d734-4b1e-82bc-4a79921d835c req-7edf06be-252e-4a84-8e59-48384fc4bd1c service nova] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG nova.compute.manager [req-ef07aa30-d734-4b1e-82bc-4a79921d835c req-7edf06be-252e-4a84-8e59-48384fc4bd1c service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] No waiting events found dispatching network-vif-unplugged-037e3efc-59df-4b8a-a9bd-568421684fa4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG nova.compute.manager [req-ef07aa30-d734-4b1e-82bc-4a79921d835c req-7edf06be-252e-4a84-8e59-48384fc4bd1c service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Received event network-vif-unplugged-037e3efc-59df-4b8a-a9bd-568421684fa4 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:47:19 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Instance destroyed successfully.
Oct 20 02:47:19 user nova-compute[74242]: DEBUG nova.objects.instance [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lazy-loading 'resources' on Instance uuid 34b108c8-3029-4a2b-b2d0-15aae1b222b5 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:43:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1341229109',display_name='tempest-VolumesSnapshotTestJSON-instance-1341229109',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1341229109',id=49,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB3fo4/oaBu/gVGHt1NOwTYzI3ZXHBcyxb6eSMDPs7VPmsyHCfZfo5AuS0mla0VN+OQTQzeJ2CgvXFov2KR/K7mhBIup0Wi9iA+7x+gdG5L/0QQVcTUfH+WTs6EBNr/OaQ==',key_name='tempest-keypair-533725408',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:43:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='060e30702e08441b981009a6f2f17007',ramdisk_id='',reservation_id='r-if0t47x3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-553194039',owner_user_name='tempest-VolumesSnapshotTestJSON-553194039-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:43:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='417d4230c6c94c3c93cd0b2f251b7212',uuid=34b108c8-3029-4a2b-b2d0-15aae1b222b5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "037e3efc-59df-4b8a-a9bd-568421684fa4", "address": "fa:16:3e:d9:07:b9", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e3efc-59", "ovs_interfaceid": "037e3efc-59df-4b8a-a9bd-568421684fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Converting VIF {"id": "037e3efc-59df-4b8a-a9bd-568421684fa4", "address": "fa:16:3e:d9:07:b9", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.60", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap037e3efc-59", "ovs_interfaceid": "037e3efc-59df-4b8a-a9bd-568421684fa4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d9:07:b9,bridge_name='br-int',has_traffic_filtering=True,id=037e3efc-59df-4b8a-a9bd-568421684fa4,network=Network(516bdc21-bbb8-4415-b700-903042bd794a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037e3efc-59') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG os_vif [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:07:b9,bridge_name='br-int',has_traffic_filtering=True,id=037e3efc-59df-4b8a-a9bd-568421684fa4,network=Network(516bdc21-bbb8-4415-b700-903042bd794a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037e3efc-59') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap037e3efc-59, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=58e8a7bf-2c31-4d45-b7fc-5b0ebf1cb394) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:19 user nova-compute[74242]: INFO os_vif [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d9:07:b9,bridge_name='br-int',has_traffic_filtering=True,id=037e3efc-59df-4b8a-a9bd-568421684fa4,network=Network(516bdc21-bbb8-4415-b700-903042bd794a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap037e3efc-59')
Oct 20 02:47:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:47:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:d297b93e-1668-4b85-a769-4c688520cb64', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pPGIUYCH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:47:20 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:47:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:47:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:47:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:47:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:47:20 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:47:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[f6a8e24e-13a7-4db7-b4aa-19df1b78fa3d]: Unexpected error while running command.
Oct 20 02:47:20 user nova-compute[74242]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 02:47:20 user nova-compute[74242]: Exit code: 21
Oct 20 02:47:20 user nova-compute[74242]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 02:47:20 user nova-compute[74242]: Stderr: '' {{(pid=85329) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 20 02:47:20 user nova-compute[74242]: Traceback (most recent call last):
Oct 20 02:47:20 user nova-compute[74242]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 20 02:47:20 user nova-compute[74242]:     ret = func(*f_args, **f_kwargs)
Oct 20 02:47:20 user nova-compute[74242]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 20 02:47:20 user nova-compute[74242]:     return func(*args, **kwargs)
Oct 20 02:47:20 user nova-compute[74242]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 20 02:47:20 user nova-compute[74242]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 20 02:47:20 user nova-compute[74242]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 20 02:47:20 user nova-compute[74242]:     return putils.execute(on_execute=on_execute,
Oct 20 02:47:20 user nova-compute[74242]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 20 02:47:20 user nova-compute[74242]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 20 02:47:20 user nova-compute[74242]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 02:47:20 user nova-compute[74242]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 02:47:20 user nova-compute[74242]: Exit code: 21
Oct 20 02:47:20 user nova-compute[74242]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 02:47:20 user nova-compute[74242]: Stderr: ''
Oct 20 02:47:20 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a8e24e-13a7-4db7-b4aa-19df1b78fa3d]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 02:47:20 user nova-compute[74242]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 02:47:20 user nova-compute[74242]: Exit code: 21
Oct 20 02:47:20 user nova-compute[74242]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 02:47:20 user nova-compute[74242]: Stderr: ''
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 20 02:47:20 user nova-compute[74242]: ERROR os_brick.initiator.connectors.iscsi 
Oct 20 02:47:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74242) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 20 02:47:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.071s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:47:20 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] <== disconnect_volume: return (73ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:47:20 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:47:20 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Deleting instance files /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5_del
Oct 20 02:47:20 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Deletion of /opt/stack/data/nova/instances/34b108c8-3029-4a2b-b2d0-15aae1b222b5_del complete
Oct 20 02:47:20 user nova-compute[74242]: INFO nova.compute.manager [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Took 1.00 seconds to destroy the instance on the hypervisor.
Oct 20 02:47:20 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:47:20 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:47:20 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:47:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:21 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:47:21 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Took 1.13 seconds to deallocate network for instance.
Oct 20 02:47:21 user nova-compute[74242]: DEBUG nova.compute.manager [req-e34080fe-189f-4771-aa59-5ba37c0530eb req-e35215de-a295-41bb-8e68-453dfba1d897 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Received event network-vif-deleted-037e3efc-59df-4b8a-a9bd-568421684fa4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:47:21 user nova-compute[74242]: WARNING nova.volume.cinder [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Attachment 4979dace-24a7-416e-a75d-dd2d4a785b43 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 4979dace-24a7-416e-a75d-dd2d4a785b43. (HTTP 404) (Request-ID: req-d017b8c9-4a32-4b8e-8a37-0e236ba45c65)
Oct 20 02:47:21 user nova-compute[74242]: INFO nova.compute.manager [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Took 0.03 seconds to detach 1 volumes for instance.
Oct 20 02:47:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:47:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:47:21 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:47:21 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:47:21 user nova-compute[74242]: DEBUG nova.compute.manager [req-61c360e7-982b-4b98-a8c6-4cd64c377b5a req-a040076b-7a23-4102-8689-e36295630233 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Received event network-vif-plugged-037e3efc-59df-4b8a-a9bd-568421684fa4 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:47:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-61c360e7-982b-4b98-a8c6-4cd64c377b5a req-a040076b-7a23-4102-8689-e36295630233 service nova] Acquiring lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:47:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-61c360e7-982b-4b98-a8c6-4cd64c377b5a req-a040076b-7a23-4102-8689-e36295630233 service nova] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:47:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-61c360e7-982b-4b98-a8c6-4cd64c377b5a req-a040076b-7a23-4102-8689-e36295630233 service nova] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:47:21 user nova-compute[74242]: DEBUG nova.compute.manager [req-61c360e7-982b-4b98-a8c6-4cd64c377b5a req-a040076b-7a23-4102-8689-e36295630233 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] No waiting events found dispatching network-vif-plugged-037e3efc-59df-4b8a-a9bd-568421684fa4 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:47:21 user nova-compute[74242]: WARNING nova.compute.manager [req-61c360e7-982b-4b98-a8c6-4cd64c377b5a req-a040076b-7a23-4102-8689-e36295630233 service nova] [instance: 34b108c8-3029-4a2b-b2d0-15aae1b222b5] Received unexpected event network-vif-plugged-037e3efc-59df-4b8a-a9bd-568421684fa4 for instance with vm_state deleted and task_state None.
Oct 20 02:47:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.132s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:47:21 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Deleted allocations for instance 34b108c8-3029-4a2b-b2d0-15aae1b222b5
Oct 20 02:47:21 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-78a3e82b-7227-497d-941b-234a24c17612 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "34b108c8-3029-4a2b-b2d0-15aae1b222b5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.473s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:47:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:33 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:47:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:47:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:47:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:47:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:47:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:48 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:47:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:47:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:47:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:47:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:47:56 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:48:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:48:01 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:48:01 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:48:01 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:48:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-1dc47370-8b4e-4324-9a57-9699fe9c1bc7" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:48:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-1dc47370-8b4e-4324-9a57-9699fe9c1bc7" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:48:01 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:48:01 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid 1dc47370-8b4e-4324-9a57-9699fe9c1bc7 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:48:01 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Updating instance_info_cache with network_info: [{"id": "88ebbf25-69f2-4d61-b125-4021c05588b7", "address": "fa:16:3e:78:c1:82", "network": {"id": "b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f53bfbdbe54c483e811b420774698154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ebbf25-69", "ovs_interfaceid": "88ebbf25-69f2-4d61-b125-4021c05588b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:48:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-1dc47370-8b4e-4324-9a57-9699fe9c1bc7" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:48:01 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:48:02 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:48:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:48:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:48:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:48:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:48:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:07 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:48:07 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:48:08 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:48:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:48:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:48:08 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:48:08 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:48:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:48:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:48:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:48:08 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:48:09 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:48:09 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:48:09 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8936MB free_disk=24.89550018310547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:48:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:48:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:48:09 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 1dc47370-8b4e-4324-9a57-9699fe9c1bc7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:48:09 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:48:09 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:48:09 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:48:09 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:48:09 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:48:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.192s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:48:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:48:10 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:48:12 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:48:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:15 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:48:19 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:48:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:48:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:48:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:48:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:48:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:48:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:48:27 user nova-compute[74242]: INFO nova.compute.claims [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Claim successful on node user
Oct 20 02:48:27 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.226s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG nova.network.neutron [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:48:27 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:48:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG nova.policy [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '417d4230c6c94c3c93cd0b2f251b7212', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '060e30702e08441b981009a6f2f17007', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG nova.compute.manager [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:48:27 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Creating image(s)
Oct 20 02:48:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "/opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "/opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "/opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.177s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:48:27 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.170s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk 1073741824 {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8,backing_fmt=raw /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk 1073741824" returned: 0 in 0.059s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "25d16a982d5d81d323c4741bf0fbe9044ec6cec8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG nova.network.neutron [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Successfully created port: 183d5991-79a9-4c21-8617-1d45eda96c45 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/25d16a982d5d81d323c4741bf0fbe9044ec6cec8 --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Checking if we can resize image /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk. size=1073741824 {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG nova.virt.disk.api [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Cannot resize image /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk to a smaller size. {{(pid=74242) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Created local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Ensure instance console log exists: /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG nova.network.neutron [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Successfully updated port: 183d5991-79a9-4c21-8617-1d45eda96c45 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquired lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG nova.network.neutron [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-ab102fff-ffb2-451b-a728-38fcbdbe975a req-95612c60-7e3d-4e8c-950f-b4cff8f0d7e7 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Received event network-changed-183d5991-79a9-4c21-8617-1d45eda96c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG nova.compute.manager [req-ab102fff-ffb2-451b-a728-38fcbdbe975a req-95612c60-7e3d-4e8c-950f-b4cff8f0d7e7 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Refreshing instance network info cache due to event network-changed-183d5991-79a9-4c21-8617-1d45eda96c45. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ab102fff-ffb2-451b-a728-38fcbdbe975a req-95612c60-7e3d-4e8c-950f-b4cff8f0d7e7 service nova] Acquiring lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:48:28 user nova-compute[74242]: DEBUG nova.network.neutron [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.network.neutron [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Updating instance_info_cache with network_info: [{"id": "183d5991-79a9-4c21-8617-1d45eda96c45", "address": "fa:16:3e:c5:7d:37", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183d5991-79", "ovs_interfaceid": "183d5991-79a9-4c21-8617-1d45eda96c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Releasing lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Instance network_info: |[{"id": "183d5991-79a9-4c21-8617-1d45eda96c45", "address": "fa:16:3e:c5:7d:37", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183d5991-79", "ovs_interfaceid": "183d5991-79a9-4c21-8617-1d45eda96c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ab102fff-ffb2-451b-a728-38fcbdbe975a req-95612c60-7e3d-4e8c-950f-b4cff8f0d7e7 service nova] Acquired lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.network.neutron [req-ab102fff-ffb2-451b-a728-38fcbdbe975a req-95612c60-7e3d-4e8c-950f-b4cff8f0d7e7 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Refreshing network info cache for port 183d5991-79a9-4c21-8617-1d45eda96c45 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Start _get_guest_xml network_info=[{"id": "183d5991-79a9-4c21-8617-1d45eda96c45", "address": "fa:16:3e:c5:7d:37", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183d5991-79", "ovs_interfaceid": "183d5991-79a9-4c21-8617-1d45eda96c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'device_type': 'disk', 'encryption_format': None, 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'guest_format': None, 'size': 0, 'encryption_options': None, 'encrypted': False, 'device_name': '/dev/vda', 'image_id': '1ba817e4-0454-4c11-9ff7-3af381824874'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:48:29 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:48:29 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-20T01:58:49Z,direct_url=<?>,disk_format='qcow2',id=1ba817e4-0454-4c11-9ff7-3af381824874,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f53bfbdbe54c483e811b420774698154',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-20T01:58:50Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-797931908',display_name='tempest-VolumesSnapshotTestJSON-instance-797931908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-797931908',id=51,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrk2/6EiGhMuqTpv5D/0vAC3o8qtaujHdZvwU7/9WFWz1+oErV3XhVTXfQL0Z67hMOscdoT7XAGx4fjK2i07jaTzrGcgIHkuWj22uT8TItsqUZ8cxAi89aojZ/H8g+x1Q==',key_name='tempest-keypair-700692130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='060e30702e08441b981009a6f2f17007',ramdisk_id='',reservation_id='r-fd00bd4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-553194039',owner_user_name='tempest-VolumesSnapshotTestJSON-553194039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:48:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='417d4230c6c94c3c93cd0b2f251b7212',uuid=21de2a46-ff82-4f25-8728-9729d33a9c8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "183d5991-79a9-4c21-8617-1d45eda96c45", "address": "fa:16:3e:c5:7d:37", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183d5991-79", "ovs_interfaceid": "183d5991-79a9-4c21-8617-1d45eda96c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Converting VIF {"id": "183d5991-79a9-4c21-8617-1d45eda96c45", "address": "fa:16:3e:c5:7d:37", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183d5991-79", "ovs_interfaceid": "183d5991-79a9-4c21-8617-1d45eda96c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:7d:37,bridge_name='br-int',has_traffic_filtering=True,id=183d5991-79a9-4c21-8617-1d45eda96c45,network=Network(516bdc21-bbb8-4415-b700-903042bd794a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183d5991-79') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.objects.instance [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lazy-loading 'pci_devices' on Instance uuid 21de2a46-ff82-4f25-8728-9729d33a9c8c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:48:29 user nova-compute[74242]:   <uuid>21de2a46-ff82-4f25-8728-9729d33a9c8c</uuid>
Oct 20 02:48:29 user nova-compute[74242]:   <name>instance-00000033</name>
Oct 20 02:48:29 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:48:29 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:48:29 user nova-compute[74242]:   <metadata>
Oct 20 02:48:29 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:48:29 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:48:29 user nova-compute[74242]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-797931908</nova:name>
Oct 20 02:48:29 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:48:29</nova:creationTime>
Oct 20 02:48:29 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:48:29 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:48:29 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:48:29 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:48:29 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:48:29 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:48:29 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:48:29 user nova-compute[74242]:       <nova:owner>
Oct 20 02:48:29 user nova-compute[74242]:         <nova:user uuid="417d4230c6c94c3c93cd0b2f251b7212">tempest-VolumesSnapshotTestJSON-553194039-project-member</nova:user>
Oct 20 02:48:29 user nova-compute[74242]:         <nova:project uuid="060e30702e08441b981009a6f2f17007">tempest-VolumesSnapshotTestJSON-553194039</nova:project>
Oct 20 02:48:29 user nova-compute[74242]:       </nova:owner>
Oct 20 02:48:29 user nova-compute[74242]:       <nova:root type="image" uuid="1ba817e4-0454-4c11-9ff7-3af381824874"/>
Oct 20 02:48:29 user nova-compute[74242]:       <nova:ports>
Oct 20 02:48:29 user nova-compute[74242]:         <nova:port uuid="183d5991-79a9-4c21-8617-1d45eda96c45">
Oct 20 02:48:29 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 20 02:48:29 user nova-compute[74242]:         </nova:port>
Oct 20 02:48:29 user nova-compute[74242]:       </nova:ports>
Oct 20 02:48:29 user nova-compute[74242]:     </nova:instance>
Oct 20 02:48:29 user nova-compute[74242]:   </metadata>
Oct 20 02:48:29 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:48:29 user nova-compute[74242]:     <system>
Oct 20 02:48:29 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:48:29 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:48:29 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:48:29 user nova-compute[74242]:       <entry name="serial">21de2a46-ff82-4f25-8728-9729d33a9c8c</entry>
Oct 20 02:48:29 user nova-compute[74242]:       <entry name="uuid">21de2a46-ff82-4f25-8728-9729d33a9c8c</entry>
Oct 20 02:48:29 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:48:29 user nova-compute[74242]:     </system>
Oct 20 02:48:29 user nova-compute[74242]:   </sysinfo>
Oct 20 02:48:29 user nova-compute[74242]:   <os>
Oct 20 02:48:29 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:48:29 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:48:29 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:48:29 user nova-compute[74242]:   </os>
Oct 20 02:48:29 user nova-compute[74242]:   <features>
Oct 20 02:48:29 user nova-compute[74242]:     <acpi/>
Oct 20 02:48:29 user nova-compute[74242]:     <apic/>
Oct 20 02:48:29 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:48:29 user nova-compute[74242]:   </features>
Oct 20 02:48:29 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:48:29 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:48:29 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:48:29 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:48:29 user nova-compute[74242]:   </clock>
Oct 20 02:48:29 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:48:29 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:48:29 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:48:29 user nova-compute[74242]:   </cpu>
Oct 20 02:48:29 user nova-compute[74242]:   <devices>
Oct 20 02:48:29 user nova-compute[74242]:     <disk type="file" device="disk">
Oct 20 02:48:29 user nova-compute[74242]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 20 02:48:29 user nova-compute[74242]:       <source file="/opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk"/>
Oct 20 02:48:29 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:48:29 user nova-compute[74242]:     </disk>
Oct 20 02:48:29 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:48:29 user nova-compute[74242]:       <mac address="fa:16:3e:c5:7d:37"/>
Oct 20 02:48:29 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:48:29 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:48:29 user nova-compute[74242]:       <target dev="tap183d5991-79"/>
Oct 20 02:48:29 user nova-compute[74242]:     </interface>
Oct 20 02:48:29 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:48:29 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/console.log" append="off"/>
Oct 20 02:48:29 user nova-compute[74242]:     </serial>
Oct 20 02:48:29 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:48:29 user nova-compute[74242]:     <video>
Oct 20 02:48:29 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:48:29 user nova-compute[74242]:     </video>
Oct 20 02:48:29 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:48:29 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:48:29 user nova-compute[74242]:     </rng>
Oct 20 02:48:29 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:48:29 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:48:29 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:48:29 user nova-compute[74242]:     </memballoon>
Oct 20 02:48:29 user nova-compute[74242]:   </devices>
Oct 20 02:48:29 user nova-compute[74242]: </domain>
Oct 20 02:48:29 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-797931908',display_name='tempest-VolumesSnapshotTestJSON-instance-797931908',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-797931908',id=51,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrk2/6EiGhMuqTpv5D/0vAC3o8qtaujHdZvwU7/9WFWz1+oErV3XhVTXfQL0Z67hMOscdoT7XAGx4fjK2i07jaTzrGcgIHkuWj22uT8TItsqUZ8cxAi89aojZ/H8g+x1Q==',key_name='tempest-keypair-700692130',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='060e30702e08441b981009a6f2f17007',ramdisk_id='',reservation_id='r-fd00bd4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-553194039',owner_user_name='tempest-VolumesSnapshotTestJSON-553194039-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:48:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='417d4230c6c94c3c93cd0b2f251b7212',uuid=21de2a46-ff82-4f25-8728-9729d33a9c8c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "183d5991-79a9-4c21-8617-1d45eda96c45", "address": "fa:16:3e:c5:7d:37", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183d5991-79", "ovs_interfaceid": "183d5991-79a9-4c21-8617-1d45eda96c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Converting VIF {"id": "183d5991-79a9-4c21-8617-1d45eda96c45", "address": "fa:16:3e:c5:7d:37", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183d5991-79", "ovs_interfaceid": "183d5991-79a9-4c21-8617-1d45eda96c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:7d:37,bridge_name='br-int',has_traffic_filtering=True,id=183d5991-79a9-4c21-8617-1d45eda96c45,network=Network(516bdc21-bbb8-4415-b700-903042bd794a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183d5991-79') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG os_vif [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:7d:37,bridge_name='br-int',has_traffic_filtering=True,id=183d5991-79a9-4c21-8617-1d45eda96c45,network=Network(516bdc21-bbb8-4415-b700-903042bd794a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183d5991-79') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd5b97166-912a-5c6f-8494-01fac2e7643d', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap183d5991-79, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap183d5991-79, col_values=(('qos', UUID('7cc83203-801b-45e1-9667-081a3860e42c')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap183d5991-79, col_values=(('external_ids', {'iface-id': '183d5991-79a9-4c21-8617-1d45eda96c45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:7d:37', 'vm-uuid': '21de2a46-ff82-4f25-8728-9729d33a9c8c'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:29 user nova-compute[74242]: INFO os_vif [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:7d:37,bridge_name='br-int',has_traffic_filtering=True,id=183d5991-79a9-4c21-8617-1d45eda96c45,network=Network(516bdc21-bbb8-4415-b700-903042bd794a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183d5991-79')
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] No VIF found with MAC fa:16:3e:c5:7d:37, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.network.neutron [req-ab102fff-ffb2-451b-a728-38fcbdbe975a req-95612c60-7e3d-4e8c-950f-b4cff8f0d7e7 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Updated VIF entry in instance network info cache for port 183d5991-79a9-4c21-8617-1d45eda96c45. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG nova.network.neutron [req-ab102fff-ffb2-451b-a728-38fcbdbe975a req-95612c60-7e3d-4e8c-950f-b4cff8f0d7e7 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Updating instance_info_cache with network_info: [{"id": "183d5991-79a9-4c21-8617-1d45eda96c45", "address": "fa:16:3e:c5:7d:37", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183d5991-79", "ovs_interfaceid": "183d5991-79a9-4c21-8617-1d45eda96c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:48:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ab102fff-ffb2-451b-a728-38fcbdbe975a req-95612c60-7e3d-4e8c-950f-b4cff8f0d7e7 service nova] Releasing lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:48:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-a0f0c0fd-f606-49aa-97fa-6ef8742e91b9 req-6d431568-d509-41c6-a6ee-1e51fe31c4f9 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Received event network-vif-plugged-183d5991-79a9-4c21-8617-1d45eda96c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:48:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a0f0c0fd-f606-49aa-97fa-6ef8742e91b9 req-6d431568-d509-41c6-a6ee-1e51fe31c4f9 service nova] Acquiring lock "21de2a46-ff82-4f25-8728-9729d33a9c8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:48:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a0f0c0fd-f606-49aa-97fa-6ef8742e91b9 req-6d431568-d509-41c6-a6ee-1e51fe31c4f9 service nova] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:48:30 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a0f0c0fd-f606-49aa-97fa-6ef8742e91b9 req-6d431568-d509-41c6-a6ee-1e51fe31c4f9 service nova] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:48:30 user nova-compute[74242]: DEBUG nova.compute.manager [req-a0f0c0fd-f606-49aa-97fa-6ef8742e91b9 req-6d431568-d509-41c6-a6ee-1e51fe31c4f9 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] No waiting events found dispatching network-vif-plugged-183d5991-79a9-4c21-8617-1d45eda96c45 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:48:30 user nova-compute[74242]: WARNING nova.compute.manager [req-a0f0c0fd-f606-49aa-97fa-6ef8742e91b9 req-6d431568-d509-41c6-a6ee-1e51fe31c4f9 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Received unexpected event network-vif-plugged-183d5991-79a9-4c21-8617-1d45eda96c45 for instance with vm_state building and task_state spawning.
Oct 20 02:48:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:32 user nova-compute[74242]: DEBUG nova.compute.manager [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:48:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:48:32 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Instance spawned successfully.
Oct 20 02:48:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:48:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-b27bcd9e-fd65-4cbd-a40d-89239f9bd7cb req-4b27d56f-3e9b-40f6-a51a-15b6c2d9f5bc service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Received event network-vif-plugged-183d5991-79a9-4c21-8617-1d45eda96c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:48:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b27bcd9e-fd65-4cbd-a40d-89239f9bd7cb req-4b27d56f-3e9b-40f6-a51a-15b6c2d9f5bc service nova] Acquiring lock "21de2a46-ff82-4f25-8728-9729d33a9c8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:48:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b27bcd9e-fd65-4cbd-a40d-89239f9bd7cb req-4b27d56f-3e9b-40f6-a51a-15b6c2d9f5bc service nova] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:48:32 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b27bcd9e-fd65-4cbd-a40d-89239f9bd7cb req-4b27d56f-3e9b-40f6-a51a-15b6c2d9f5bc service nova] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:48:32 user nova-compute[74242]: DEBUG nova.compute.manager [req-b27bcd9e-fd65-4cbd-a40d-89239f9bd7cb req-4b27d56f-3e9b-40f6-a51a-15b6c2d9f5bc service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] No waiting events found dispatching network-vif-plugged-183d5991-79a9-4c21-8617-1d45eda96c45 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:48:32 user nova-compute[74242]: WARNING nova.compute.manager [req-b27bcd9e-fd65-4cbd-a40d-89239f9bd7cb req-4b27d56f-3e9b-40f6-a51a-15b6c2d9f5bc service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Received unexpected event network-vif-plugged-183d5991-79a9-4c21-8617-1d45eda96c45 for instance with vm_state building and task_state spawning.
Oct 20 02:48:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:48:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:48:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:48:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:48:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:48:32 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:48:33 user nova-compute[74242]: INFO nova.compute.manager [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Took 5.35 seconds to spawn the instance on the hypervisor.
Oct 20 02:48:33 user nova-compute[74242]: DEBUG nova.compute.manager [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:48:33 user nova-compute[74242]: INFO nova.compute.manager [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Took 5.91 seconds to build instance.
Oct 20 02:48:33 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-59e5306f-2507-4c9d-82d8-ad8761f691e0 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.998s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:48:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Acquiring lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:48:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:48:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Acquiring lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:48:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:48:40 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:48:40 user nova-compute[74242]: INFO nova.compute.manager [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Terminating instance
Oct 20 02:48:40 user nova-compute[74242]: DEBUG nova.compute.manager [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:48:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-ef276d6d-50b6-4188-bc4f-a670abae9e5b req-6a3163da-a844-457d-8d2f-d99168f73b89 service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Received event network-vif-unplugged-88ebbf25-69f2-4d61-b125-4021c05588b7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ef276d6d-50b6-4188-bc4f-a670abae9e5b req-6a3163da-a844-457d-8d2f-d99168f73b89 service nova] Acquiring lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ef276d6d-50b6-4188-bc4f-a670abae9e5b req-6a3163da-a844-457d-8d2f-d99168f73b89 service nova] Lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ef276d6d-50b6-4188-bc4f-a670abae9e5b req-6a3163da-a844-457d-8d2f-d99168f73b89 service nova] Lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-ef276d6d-50b6-4188-bc4f-a670abae9e5b req-6a3163da-a844-457d-8d2f-d99168f73b89 service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] No waiting events found dispatching network-vif-unplugged-88ebbf25-69f2-4d61-b125-4021c05588b7 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG nova.compute.manager [req-ef276d6d-50b6-4188-bc4f-a670abae9e5b req-6a3163da-a844-457d-8d2f-d99168f73b89 service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Received event network-vif-unplugged-88ebbf25-69f2-4d61-b125-4021c05588b7 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:48:41 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Instance destroyed successfully.
Oct 20 02:48:41 user nova-compute[74242]: DEBUG nova.objects.instance [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lazy-loading 'resources' on Instance uuid 1dc47370-8b4e-4324-9a57-9699fe9c1bc7 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:46:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-569819290',display_name='tempest-VolumesNegativeTest-instance-569819290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-569819290',id=50,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:46:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='571c1401257c4fe6ab758fdb8d72ae0c',ramdisk_id='',reservation_id='r-kemxg6ab',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-170121169',owner_user_name='tempest-VolumesNegativeTest-170121169-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:46:56Z,user_data=None,user_id='da03cee5739d4a8391c3c23ceac9b26b',uuid=1dc47370-8b4e-4324-9a57-9699fe9c1bc7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "88ebbf25-69f2-4d61-b125-4021c05588b7", "address": "fa:16:3e:78:c1:82", "network": {"id": "b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f53bfbdbe54c483e811b420774698154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ebbf25-69", "ovs_interfaceid": "88ebbf25-69f2-4d61-b125-4021c05588b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Converting VIF {"id": "88ebbf25-69f2-4d61-b125-4021c05588b7", "address": "fa:16:3e:78:c1:82", "network": {"id": "b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.194", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f53bfbdbe54c483e811b420774698154", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap88ebbf25-69", "ovs_interfaceid": "88ebbf25-69f2-4d61-b125-4021c05588b7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:c1:82,bridge_name='br-int',has_traffic_filtering=True,id=88ebbf25-69f2-4d61-b125-4021c05588b7,network=Network(b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ebbf25-69') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG os_vif [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:c1:82,bridge_name='br-int',has_traffic_filtering=True,id=88ebbf25-69f2-4d61-b125-4021c05588b7,network=Network(b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ebbf25-69') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap88ebbf25-69, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3dc7044-2096-4601-a53c-a3806e10860d) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:48:41 user nova-compute[74242]: INFO os_vif [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:c1:82,bridge_name='br-int',has_traffic_filtering=True,id=88ebbf25-69f2-4d61-b125-4021c05588b7,network=Network(b3bf5295-94d9-4d2a-8cbc-22fd0c6909a7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap88ebbf25-69')
Oct 20 02:48:41 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Deleting instance files /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7_del
Oct 20 02:48:41 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Deletion of /opt/stack/data/nova/instances/1dc47370-8b4e-4324-9a57-9699fe9c1bc7_del complete
Oct 20 02:48:41 user nova-compute[74242]: INFO nova.compute.manager [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 20 02:48:41 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:48:41 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:48:42 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:48:42 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Took 0.41 seconds to deallocate network for instance.
Oct 20 02:48:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-ac3bfb19-9759-4eca-b509-4e81b5833b8c req-a0c9d273-2fe4-46d3-b17c-1a8d522b5024 service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Received event network-vif-deleted-88ebbf25-69f2-4d61-b125-4021c05588b7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:48:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:48:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:48:42 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:48:42 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:48:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.130s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:48:42 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Deleted allocations for instance 1dc47370-8b4e-4324-9a57-9699fe9c1bc7
Oct 20 02:48:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-0361e6c6-98bf-4ca8-850b-b7df9a42ae26 tempest-VolumesNegativeTest-170121169 tempest-VolumesNegativeTest-170121169-project-member] Lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.966s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:48:43 user nova-compute[74242]: DEBUG nova.compute.manager [req-a3cfdc8f-ac9b-4d31-891c-34e1d25163b0 req-50602e5f-f2e8-4801-81cd-0365c7ec90e7 service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Received event network-vif-plugged-88ebbf25-69f2-4d61-b125-4021c05588b7 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:48:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a3cfdc8f-ac9b-4d31-891c-34e1d25163b0 req-50602e5f-f2e8-4801-81cd-0365c7ec90e7 service nova] Acquiring lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:48:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a3cfdc8f-ac9b-4d31-891c-34e1d25163b0 req-50602e5f-f2e8-4801-81cd-0365c7ec90e7 service nova] Lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:48:43 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a3cfdc8f-ac9b-4d31-891c-34e1d25163b0 req-50602e5f-f2e8-4801-81cd-0365c7ec90e7 service nova] Lock "1dc47370-8b4e-4324-9a57-9699fe9c1bc7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:48:43 user nova-compute[74242]: DEBUG nova.compute.manager [req-a3cfdc8f-ac9b-4d31-891c-34e1d25163b0 req-50602e5f-f2e8-4801-81cd-0365c7ec90e7 service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] No waiting events found dispatching network-vif-plugged-88ebbf25-69f2-4d61-b125-4021c05588b7 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:48:43 user nova-compute[74242]: WARNING nova.compute.manager [req-a3cfdc8f-ac9b-4d31-891c-34e1d25163b0 req-50602e5f-f2e8-4801-81cd-0365c7ec90e7 service nova] [instance: 1dc47370-8b4e-4324-9a57-9699fe9c1bc7] Received unexpected event network-vif-plugged-88ebbf25-69f2-4d61-b125-4021c05588b7 for instance with vm_state deleted and task_state None.
Oct 20 02:48:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:48:58 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:49:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:49:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:49:03 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:49:03 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:49:03 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:49:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:49:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:49:03 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:49:03 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid 21de2a46-ff82-4f25-8728-9729d33a9c8c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:49:03 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Updating instance_info_cache with network_info: [{"id": "183d5991-79a9-4c21-8617-1d45eda96c45", "address": "fa:16:3e:c5:7d:37", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183d5991-79", "ovs_interfaceid": "183d5991-79a9-4c21-8617-1d45eda96c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:49:03 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:49:03 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:49:04 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:49:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:49:09 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:49:09 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:49:09 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:49:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:49:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:49:09 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:49:09 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:49:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:49:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:49:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:49:09 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:49:10 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:49:10 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:49:10 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8893MB free_disk=24.893531799316406GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:49:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:49:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:49:10 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 21de2a46-ff82-4f25-8728-9729d33a9c8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:49:10 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:49:10 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:49:10 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing inventories for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 02:49:10 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Updating ProviderTree inventory for provider 07b40460-b6ac-48c1-8447-e1778d50b26e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 02:49:10 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Updating inventory in ProviderTree for provider 07b40460-b6ac-48c1-8447-e1778d50b26e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 02:49:10 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing aggregate associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, aggregates: None {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 02:49:10 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing trait associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 02:49:10 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:49:10 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:49:10 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:49:10 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.404s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:49:11 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:49:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:49:14 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:49:15 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:49:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:49:19 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:49:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:49:25 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:49:26 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:49:26 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74242) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 02:49:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:49:31 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:49:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 02:49:31 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] There are 0 instances to clean {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 02:49:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:49:36 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:49:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:49:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:49:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:49:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:49:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:49:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:49:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:00 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:50:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:04 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:50:04 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:50:04 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:50:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:50:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:50:04 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:50:04 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid 21de2a46-ff82-4f25-8728-9729d33a9c8c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:50:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:05 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Updating instance_info_cache with network_info: [{"id": "183d5991-79a9-4c21-8617-1d45eda96c45", "address": "fa:16:3e:c5:7d:37", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183d5991-79", "ovs_interfaceid": "183d5991-79a9-4c21-8617-1d45eda96c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:50:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:50:05 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:50:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:07 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:50:10 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:50:10 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:50:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:11 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:50:11 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:50:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:50:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:50:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:50:11 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:50:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:12 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:50:12 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:50:12 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8941MB free_disk=24.891281127929688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:50:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:50:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:50:12 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 21de2a46-ff82-4f25-8728-9729d33a9c8c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:50:12 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:50:12 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:50:12 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:50:12 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:50:12 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:50:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.155s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:50:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:17 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:50:17 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:50:18 user nova-compute[74242]: DEBUG nova.compute.manager [req-09dac03d-7816-4087-a0fe-0602788a631f req-1aa8ead6-7bf3-41c2-a8e1-23da8cf4875d service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Received event network-changed-183d5991-79a9-4c21-8617-1d45eda96c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:50:18 user nova-compute[74242]: DEBUG nova.compute.manager [req-09dac03d-7816-4087-a0fe-0602788a631f req-1aa8ead6-7bf3-41c2-a8e1-23da8cf4875d service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Refreshing instance network info cache due to event network-changed-183d5991-79a9-4c21-8617-1d45eda96c45. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:50:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-09dac03d-7816-4087-a0fe-0602788a631f req-1aa8ead6-7bf3-41c2-a8e1-23da8cf4875d service nova] Acquiring lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:50:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-09dac03d-7816-4087-a0fe-0602788a631f req-1aa8ead6-7bf3-41c2-a8e1-23da8cf4875d service nova] Acquired lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:50:18 user nova-compute[74242]: DEBUG nova.network.neutron [req-09dac03d-7816-4087-a0fe-0602788a631f req-1aa8ead6-7bf3-41c2-a8e1-23da8cf4875d service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Refreshing network info cache for port 183d5991-79a9-4c21-8617-1d45eda96c45 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:50:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:50:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:50:18 user nova-compute[74242]: DEBUG nova.objects.instance [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lazy-loading 'flavor' on Instance uuid 21de2a46-ff82-4f25-8728-9729d33a9c8c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:50:18 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Ignoring supplied device name: /dev/vdb
Oct 20 02:50:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:50:18 user nova-compute[74242]: DEBUG nova.network.neutron [req-09dac03d-7816-4087-a0fe-0602788a631f req-1aa8ead6-7bf3-41c2-a8e1-23da8cf4875d service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Updated VIF entry in instance network info cache for port 183d5991-79a9-4c21-8617-1d45eda96c45. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:50:18 user nova-compute[74242]: DEBUG nova.network.neutron [req-09dac03d-7816-4087-a0fe-0602788a631f req-1aa8ead6-7bf3-41c2-a8e1-23da8cf4875d service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Updating instance_info_cache with network_info: [{"id": "183d5991-79a9-4c21-8617-1d45eda96c45", "address": "fa:16:3e:c5:7d:37", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183d5991-79", "ovs_interfaceid": "183d5991-79a9-4c21-8617-1d45eda96c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:50:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-09dac03d-7816-4087-a0fe-0602788a631f req-1aa8ead6-7bf3-41c2-a8e1-23da8cf4875d service nova] Releasing lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:50:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:50:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:50:18 user nova-compute[74242]: INFO nova.compute.manager [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Attaching volume 3562389c-6148-457f-a11c-b2ab9ebecfd0 to /dev/vdb
Oct 20 02:50:19 user nova-compute[74242]: DEBUG os_brick.utils [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2005215b-72c1-4d6d-a5fe-5673cf8a3ec7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c463d38a-604c-4d93-95f3-1e9b39d2dcf7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f1f386-cd47-45c5-8c98-23351f57fd57]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f07a118-7035-4d5f-8c05-efbf0352e163]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:50:19 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[42aa0c9d-7a66-4c47-afc2-05c934658a3d]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG os_brick.utils [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Updating existing volume attachment record: 3d8bcc76-0d39-4f76-bcef-a0ff9bf958c4 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:50:19 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:50:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:50:22 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:50:22 user nova-compute[74242]: DEBUG nova.compute.manager [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Starting instance... {{(pid=74242) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:50:23 user nova-compute[74242]: INFO nova.compute.claims [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Claim successful on node user
Oct 20 02:50:23 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.206s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG nova.compute.manager [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Start building networks asynchronously for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG nova.compute.manager [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Allocating IP information in the background. {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG nova.network.neutron [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] allocate_for_instance() {{(pid=74242) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 20 02:50:23 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 20 02:50:23 user nova-compute[74242]: DEBUG nova.compute.manager [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Start building block device mappings for instance. {{(pid=74242) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG nova.policy [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '698464fcfc7c48ff90ccbf2636508ef5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8a1d892a5f4849bea73c1b4c4a0a2a6f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74242) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 20 02:50:23 user nova-compute[74242]: INFO nova.virt.block_device [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Booting with volume b0cb2426-c05c-4657-9099-931233506695 at /dev/vda
Oct 20 02:50:23 user nova-compute[74242]: DEBUG os_brick.utils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce47a00-cfcc-4c93-8248-273495739d62]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[21cf328f-d850-44fb-81e5-fa200378549d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaa08420-223f-4f74-8d4b-c2a6f177d2c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[848cdd4e-6d8e-447a-a6dc-4a34e987cf2c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:50:23 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:50:23 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bd269a-5479-4ef6-905a-3d245d506c0b]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG os_brick.utils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updating existing volume attachment record: 0f0ecb20-7062-4a8b-a832-81af62d5c1f8 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:50:23 user nova-compute[74242]: DEBUG nova.network.neutron [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Successfully created port: 5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 20 02:50:24 user nova-compute[74242]: DEBUG nova.network.neutron [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Successfully updated port: 5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 20 02:50:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:50:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquired lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:50:24 user nova-compute[74242]: DEBUG nova.network.neutron [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:50:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-215ce704-3442-4568-b8cf-333222a34cde req-a3d5a238-17db-47bf-b4bd-c179b2730f8a service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received event network-changed-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:50:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-215ce704-3442-4568-b8cf-333222a34cde req-a3d5a238-17db-47bf-b4bd-c179b2730f8a service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Refreshing instance network info cache due to event network-changed-5247d96d-f3c5-418d-871e-a55ab2123c45. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:50:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-215ce704-3442-4568-b8cf-333222a34cde req-a3d5a238-17db-47bf-b4bd-c179b2730f8a service nova] Acquiring lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:50:24 user nova-compute[74242]: DEBUG nova.network.neutron [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Instance cache missing network info. {{(pid=74242) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 20 02:50:24 user nova-compute[74242]: DEBUG nova.network.neutron [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updating instance_info_cache with network_info: [{"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:50:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Releasing lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:50:24 user nova-compute[74242]: DEBUG nova.compute.manager [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Instance network_info: |[{"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74242) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 20 02:50:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-215ce704-3442-4568-b8cf-333222a34cde req-a3d5a238-17db-47bf-b4bd-c179b2730f8a service nova] Acquired lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:50:24 user nova-compute[74242]: DEBUG nova.network.neutron [req-215ce704-3442-4568-b8cf-333222a34cde req-a3d5a238-17db-47bf-b4bd-c179b2730f8a service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Refreshing network info cache for port 5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:50:25 user nova-compute[74242]: DEBUG nova.network.neutron [req-215ce704-3442-4568-b8cf-333222a34cde req-a3d5a238-17db-47bf-b4bd-c179b2730f8a service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updated VIF entry in instance network info cache for port 5247d96d-f3c5-418d-871e-a55ab2123c45. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:50:25 user nova-compute[74242]: DEBUG nova.network.neutron [req-215ce704-3442-4568-b8cf-333222a34cde req-a3d5a238-17db-47bf-b4bd-c179b2730f8a service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updating instance_info_cache with network_info: [{"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:50:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-215ce704-3442-4568-b8cf-333222a34cde req-a3d5a238-17db-47bf-b4bd-c179b2730f8a service nova] Releasing lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:50:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFADfeTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:50:34 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:50:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:50:34 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:50:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:50:34 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[418a5692-7600-4dc8-8079-a89edd513912]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:50:34 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[87519a14-a802-4986-920b-f6b1db510fd3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0] added
Oct 20 02:50:34 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6fb1a0-df78-4764-aa54-e8e205c9a2f6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5801bc8e-7583-453e-abe5-36d320e529b8]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFADfeTY {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QFADfeTY" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa02d093-ebdd-4c4f-b757-2480ebd9124c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QFADfeTY'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef69bb1-9afd-43a0-be0e-c85769cf8b17]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[508de3d8-8dfb-4b6e-ba79-0d7baf2effd4]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 02:50:34 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:50:34 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 02:50:34 user nova-compute[74242]:  {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:50:34 user nova-compute[74242]: WARNING os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 02:50:34 user nova-compute[74242]: 
Oct 20 02:50:34 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24c4a7c-0c73-4004-9c9a-26129d2a258a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0, portal: 172.16.0.220,3260]
Oct 20 02:50:35 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0, portal: 172.16.0.220,3260] successful.
Oct 20 02:50:35 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6363a3c-0898-4d54-888f-788a208567ac]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a1024e-70d1-4b3c-8236-a47a9488f9b9]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 (non-flash)
Oct 20 02:50:35 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 (non-flash)
Oct 20 02:50:35 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.245s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] HCTL ('33', '-', '-', 0) found on session 60 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55e4667-691b-4ba0-ab8c-11029894c8e3]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Searching for a device in session 60 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFADfeTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:50:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.273s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:50:36 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] <== connect_volume: return (1275ms) {'type': 'block', 'scsi_wwn': '26631383864333965', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:50:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631383864333965', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:50:36 user nova-compute[74242]: DEBUG nova.objects.instance [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lazy-loading 'flavor' on Instance uuid 21de2a46-ff82-4f25-8728-9729d33a9c8c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:50:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] attach device xml: <disk type="block" device="disk">
Oct 20 02:50:36 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:50:36 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:50:36 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:50:36 user nova-compute[74242]:   <serial>3562389c-6148-457f-a11c-b2ab9ebecfd0</serial>
Oct 20 02:50:36 user nova-compute[74242]: </disk>
Oct 20 02:50:36 user nova-compute[74242]:  {{(pid=74242) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 20 02:50:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:50:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:50:36 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] No VIF found with MAC fa:16:3e:c5:7d:37, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:50:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:36 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-6ac2a5a7-777c-4772-a1ad-e0de2bcaf6c3 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.780s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.compute.manager [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Start spawning the instance on the hypervisor. {{(pid=74242) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:50:39 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Creating image(s)
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Ensure instance console log exists: /opt/stack/data/nova/instances/c50216a6-a0cd-4566-b4e6-ffd9eeff1629/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Start _get_guest_xml network_info=[{"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '0f0ecb20-7062-4a8b-a832-81af62d5c1f8', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLcoqxuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c50216a6-a0cd-4566-b4e6-ffd9eeff1629', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0cb2426-c05c-4657-9099-931233506695', 'serial': 'b0cb2426-c05c-4657-9099-931233506695'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:50:39 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:50:39 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLcoqxuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:50:39 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:50:39 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:50:39 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[694fa3af-51ac-4f7a-853b-456aa0d3c0a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:50:39 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[add0a564-4e11-48a2-b235-0edc4a5beb13]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695] added
Oct 20 02:50:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3c48718-77f3-4dcf-b833-f8052b8a35c7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd67dd2-99da-4134-bfaf-403ce08676d6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLcoqxuP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLcoqxuP" returned: 0 in 0.024s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf93f702-9e6b-4adb-b374-c66a73b59a88]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rLcoqxuP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d0b5e5-cc81-411e-be24-c6181c36af72]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[120d3fac-c249-43a1-8cc5-d4149bc9c200]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 (non-flash)
Oct 20 02:50:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 (non-flash)
Oct 20 02:50:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6aa452-b486-4ece-ae27-ad3e8e1811ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260]
Oct 20 02:50:39 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260] successful.
Oct 20 02:50:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88f09a1-8a0d-4671-8bfb-0653d07702ee]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec940701-bb52-435e-8297-d596ba1a28c9]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 (non-flash)
Oct 20 02:50:39 user nova-compute[74242]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)
Oct 20 02:50:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 (non-flash)
Oct 20 02:50:39 user nova-compute[74242]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)
Oct 20 02:50:39 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] HCTL ('34', '-', '-', 0) found on session 61 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61c6ec5-d9c9-4aa6-8bd8-ffc1193770d8]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Searching for a device in session 61 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:50:39 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLcoqxuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26431313465353538', 'path': '/dev/sdc'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431313465353538', 'path': '/dev/sdc'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1407200199',display_name='tempest-TestShelveInstance-server-1407200199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1407200199',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNZ78+lV4Tgetykk6GbM0enr8XIjlk7QrLufh1HTfOOMuUyGaPgSATa7w3kCGPkrfD5fRr89uGyG33qlQ3HJsVTbwQ/BSCBCknrjGTBV9kpcke3lur3SCfPSlFb9doLNw==',key_name='tempest-TestShelveInstance-2138519179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a1d892a5f4849bea73c1b4c4a0a2a6f',ramdisk_id='',reservation_id='r-4qig0o00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1204752060',owner_user_name='tempest-TestShelveInstance-1204752060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:50:23Z,user_data=None,user_id='698464fcfc7c48ff90ccbf2636508ef5',uuid=c50216a6-a0cd-4566-b4e6-ffd9eeff1629,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Converting VIF {"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7d:96,bridge_name='br-int',has_traffic_filtering=True,id=5247d96d-f3c5-418d-871e-a55ab2123c45,network=Network(b634b705-e4e4-479c-8300-5c81ef242107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5247d96d-f3') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG nova.objects.instance [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lazy-loading 'pci_devices' on Instance uuid c50216a6-a0cd-4566-b4e6-ffd9eeff1629 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:50:40 user nova-compute[74242]:   <uuid>c50216a6-a0cd-4566-b4e6-ffd9eeff1629</uuid>
Oct 20 02:50:40 user nova-compute[74242]:   <name>instance-00000034</name>
Oct 20 02:50:40 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:50:40 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:50:40 user nova-compute[74242]:   <metadata>
Oct 20 02:50:40 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:50:40 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:50:40 user nova-compute[74242]:       <nova:name>tempest-TestShelveInstance-server-1407200199</nova:name>
Oct 20 02:50:40 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:50:39</nova:creationTime>
Oct 20 02:50:40 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:50:40 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:50:40 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:50:40 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:50:40 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:50:40 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:50:40 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:50:40 user nova-compute[74242]:       <nova:owner>
Oct 20 02:50:40 user nova-compute[74242]:         <nova:user uuid="698464fcfc7c48ff90ccbf2636508ef5">tempest-TestShelveInstance-1204752060-project-member</nova:user>
Oct 20 02:50:40 user nova-compute[74242]:         <nova:project uuid="8a1d892a5f4849bea73c1b4c4a0a2a6f">tempest-TestShelveInstance-1204752060</nova:project>
Oct 20 02:50:40 user nova-compute[74242]:       </nova:owner>
Oct 20 02:50:40 user nova-compute[74242]:       <nova:ports>
Oct 20 02:50:40 user nova-compute[74242]:         <nova:port uuid="5247d96d-f3c5-418d-871e-a55ab2123c45">
Oct 20 02:50:40 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 02:50:40 user nova-compute[74242]:         </nova:port>
Oct 20 02:50:40 user nova-compute[74242]:       </nova:ports>
Oct 20 02:50:40 user nova-compute[74242]:     </nova:instance>
Oct 20 02:50:40 user nova-compute[74242]:   </metadata>
Oct 20 02:50:40 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:50:40 user nova-compute[74242]:     <system>
Oct 20 02:50:40 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:50:40 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:50:40 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:50:40 user nova-compute[74242]:       <entry name="serial">c50216a6-a0cd-4566-b4e6-ffd9eeff1629</entry>
Oct 20 02:50:40 user nova-compute[74242]:       <entry name="uuid">c50216a6-a0cd-4566-b4e6-ffd9eeff1629</entry>
Oct 20 02:50:40 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:50:40 user nova-compute[74242]:     </system>
Oct 20 02:50:40 user nova-compute[74242]:   </sysinfo>
Oct 20 02:50:40 user nova-compute[74242]:   <os>
Oct 20 02:50:40 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:50:40 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:50:40 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:50:40 user nova-compute[74242]:   </os>
Oct 20 02:50:40 user nova-compute[74242]:   <features>
Oct 20 02:50:40 user nova-compute[74242]:     <acpi/>
Oct 20 02:50:40 user nova-compute[74242]:     <apic/>
Oct 20 02:50:40 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:50:40 user nova-compute[74242]:   </features>
Oct 20 02:50:40 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:50:40 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:50:40 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:50:40 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:50:40 user nova-compute[74242]:   </clock>
Oct 20 02:50:40 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:50:40 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:50:40 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:50:40 user nova-compute[74242]:   </cpu>
Oct 20 02:50:40 user nova-compute[74242]:   <devices>
Oct 20 02:50:40 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:50:40 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:50:40 user nova-compute[74242]:       <source dev="/dev/sdc"/>
Oct 20 02:50:40 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:50:40 user nova-compute[74242]:       <serial>b0cb2426-c05c-4657-9099-931233506695</serial>
Oct 20 02:50:40 user nova-compute[74242]:     </disk>
Oct 20 02:50:40 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:50:40 user nova-compute[74242]:       <mac address="fa:16:3e:a4:7d:96"/>
Oct 20 02:50:40 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:50:40 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:50:40 user nova-compute[74242]:       <target dev="tap5247d96d-f3"/>
Oct 20 02:50:40 user nova-compute[74242]:     </interface>
Oct 20 02:50:40 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:50:40 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/c50216a6-a0cd-4566-b4e6-ffd9eeff1629/console.log" append="off"/>
Oct 20 02:50:40 user nova-compute[74242]:     </serial>
Oct 20 02:50:40 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:50:40 user nova-compute[74242]:     <video>
Oct 20 02:50:40 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:50:40 user nova-compute[74242]:     </video>
Oct 20 02:50:40 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:50:40 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:50:40 user nova-compute[74242]:     </rng>
Oct 20 02:50:40 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:50:40 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:50:40 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:50:40 user nova-compute[74242]:     </memballoon>
Oct 20 02:50:40 user nova-compute[74242]:   </devices>
Oct 20 02:50:40 user nova-compute[74242]: </domain>
Oct 20 02:50:40 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1407200199',display_name='tempest-TestShelveInstance-server-1407200199',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1407200199',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNZ78+lV4Tgetykk6GbM0enr8XIjlk7QrLufh1HTfOOMuUyGaPgSATa7w3kCGPkrfD5fRr89uGyG33qlQ3HJsVTbwQ/BSCBCknrjGTBV9kpcke3lur3SCfPSlFb9doLNw==',key_name='tempest-TestShelveInstance-2138519179',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8a1d892a5f4849bea73c1b4c4a0a2a6f',ramdisk_id='',reservation_id='r-4qig0o00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1204752060',owner_user_name='tempest-TestShelveInstance-1204752060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-20T02:50:23Z,user_data=None,user_id='698464fcfc7c48ff90ccbf2636508ef5',uuid=c50216a6-a0cd-4566-b4e6-ffd9eeff1629,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Converting VIF {"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7d:96,bridge_name='br-int',has_traffic_filtering=True,id=5247d96d-f3c5-418d-871e-a55ab2123c45,network=Network(b634b705-e4e4-479c-8300-5c81ef242107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5247d96d-f3') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG os_vif [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7d:96,bridge_name='br-int',has_traffic_filtering=True,id=5247d96d-f3c5-418d-871e-a55ab2123c45,network=Network(b634b705-e4e4-479c-8300-5c81ef242107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5247d96d-f3') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc085778-2aff-5220-b44f-83e38a942bed', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5247d96d-f3, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5247d96d-f3, col_values=(('qos', UUID('24755142-0f5d-404e-98b5-32759a0534d2')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5247d96d-f3, col_values=(('external_ids', {'iface-id': '5247d96d-f3c5-418d-871e-a55ab2123c45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:7d:96', 'vm-uuid': 'c50216a6-a0cd-4566-b4e6-ffd9eeff1629'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:40 user nova-compute[74242]: INFO os_vif [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7d:96,bridge_name='br-int',has_traffic_filtering=True,id=5247d96d-f3c5-418d-871e-a55ab2123c45,network=Network(b634b705-e4e4-479c-8300-5c81ef242107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5247d96d-f3')
Oct 20 02:50:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] No VIF found with MAC fa:16:3e:a4:7d:96, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:50:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8a32181-877a-4b9b-b302-046f95e0431f req-4e9c5582-1b0f-40b8-bce5-3d66f3add1fe service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received event network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:50:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8a32181-877a-4b9b-b302-046f95e0431f req-4e9c5582-1b0f-40b8-bce5-3d66f3add1fe service nova] Acquiring lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:50:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8a32181-877a-4b9b-b302-046f95e0431f req-4e9c5582-1b0f-40b8-bce5-3d66f3add1fe service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:50:42 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a8a32181-877a-4b9b-b302-046f95e0431f req-4e9c5582-1b0f-40b8-bce5-3d66f3add1fe service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:50:42 user nova-compute[74242]: DEBUG nova.compute.manager [req-a8a32181-877a-4b9b-b302-046f95e0431f req-4e9c5582-1b0f-40b8-bce5-3d66f3add1fe service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] No waiting events found dispatching network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:50:42 user nova-compute[74242]: WARNING nova.compute.manager [req-a8a32181-877a-4b9b-b302-046f95e0431f req-4e9c5582-1b0f-40b8-bce5-3d66f3add1fe service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received unexpected event network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 for instance with vm_state building and task_state spawning.
Oct 20 02:50:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:50:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:50:44 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Instance spawned successfully.
Oct 20 02:50:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 20 02:50:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Found default for hw_cdrom_bus of ide {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:50:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Found default for hw_disk_bus of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:50:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Found default for hw_input_bus of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:50:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Found default for hw_pointer_model of None {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:50:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Found default for hw_video_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:50:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Found default for hw_vif_model of virtio {{(pid=74242) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 20 02:50:44 user nova-compute[74242]: INFO nova.compute.manager [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Took 5.08 seconds to spawn the instance on the hypervisor.
Oct 20 02:50:44 user nova-compute[74242]: DEBUG nova.compute.manager [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:50:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-e479f660-4ca2-4eda-a69b-75eb8a8e6a9e req-13a8effd-43fc-442f-8a22-69286e4947c7 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received event network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:50:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e479f660-4ca2-4eda-a69b-75eb8a8e6a9e req-13a8effd-43fc-442f-8a22-69286e4947c7 service nova] Acquiring lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:50:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e479f660-4ca2-4eda-a69b-75eb8a8e6a9e req-13a8effd-43fc-442f-8a22-69286e4947c7 service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:50:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-e479f660-4ca2-4eda-a69b-75eb8a8e6a9e req-13a8effd-43fc-442f-8a22-69286e4947c7 service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:50:44 user nova-compute[74242]: DEBUG nova.compute.manager [req-e479f660-4ca2-4eda-a69b-75eb8a8e6a9e req-13a8effd-43fc-442f-8a22-69286e4947c7 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] No waiting events found dispatching network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:50:44 user nova-compute[74242]: WARNING nova.compute.manager [req-e479f660-4ca2-4eda-a69b-75eb8a8e6a9e req-13a8effd-43fc-442f-8a22-69286e4947c7 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received unexpected event network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 for instance with vm_state building and task_state spawning.
Oct 20 02:50:44 user nova-compute[74242]: INFO nova.compute.manager [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Took 21.44 seconds to build instance.
Oct 20 02:50:44 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-273227d0-bb8d-468b-8b42-0c9c414ed401 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.525s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:50:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:50:51 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:50:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid 21de2a46-ff82-4f25-8728-9729d33a9c8c {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:50:51 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Triggering sync for uuid c50216a6-a0cd-4566-b4e6-ffd9eeff1629 {{(pid=74242) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 20 02:50:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:50:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:50:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:50:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:50:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.031s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:50:51 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:50:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:00 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:51:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:51:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:04 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:51:04 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:51:04 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:51:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:51:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:51:04 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:51:04 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid 21de2a46-ff82-4f25-8728-9729d33a9c8c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:51:04 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Updating instance_info_cache with network_info: [{"id": "183d5991-79a9-4c21-8617-1d45eda96c45", "address": "fa:16:3e:c5:7d:37", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183d5991-79", "ovs_interfaceid": "183d5991-79a9-4c21-8617-1d45eda96c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:51:04 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-21de2a46-ff82-4f25-8728-9729d33a9c8c" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:51:04 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:51:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:05 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:51:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:10 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:11 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:51:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:51:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:51:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:51:11 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:51:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:51:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:51:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:51:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk --force-share --output=json {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:51:11 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:51:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:51:12 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:51:12 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:51:12 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=24.888896942138672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:51:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:51:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:51:12 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance 21de2a46-ff82-4f25-8728-9729d33a9c8c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:51:12 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c50216a6-a0cd-4566-b4e6-ffd9eeff1629 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:51:12 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:51:12 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:51:12 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:51:12 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:51:12 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:51:12 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.235s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:51:13 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:51:13 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:51:13 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:51:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:16 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:51:17 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:51:19 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:51:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:51:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:51:24 user nova-compute[74242]: INFO nova.compute.manager [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Detaching volume 3562389c-6148-457f-a11c-b2ab9ebecfd0
Oct 20 02:51:24 user nova-compute[74242]: INFO nova.virt.block_device [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Attempting to driver detach volume 3562389c-6148-457f-a11c-b2ab9ebecfd0 from mountpoint /dev/vdb
Oct 20 02:51:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Attempting to detach device vdb from instance 21de2a46-ff82-4f25-8728-9729d33a9c8c from the persistent domain config. {{(pid=74242) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 20 02:51:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:51:24 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:51:24 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:51:24 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:51:24 user nova-compute[74242]:   <serial>3562389c-6148-457f-a11c-b2ab9ebecfd0</serial>
Oct 20 02:51:24 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:51:24 user nova-compute[74242]: </disk>
Oct 20 02:51:24 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:51:24 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Successfully detached device vdb from instance 21de2a46-ff82-4f25-8728-9729d33a9c8c from the persistent domain config.
Oct 20 02:51:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 21de2a46-ff82-4f25-8728-9729d33a9c8c from the live domain config. {{(pid=74242) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 20 02:51:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.guest [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] detach device xml: <disk type="block" device="disk">
Oct 20 02:51:24 user nova-compute[74242]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:51:24 user nova-compute[74242]:   <source dev="/dev/sdb"/>
Oct 20 02:51:24 user nova-compute[74242]:   <target dev="vdb" bus="virtio"/>
Oct 20 02:51:24 user nova-compute[74242]:   <serial>3562389c-6148-457f-a11c-b2ab9ebecfd0</serial>
Oct 20 02:51:24 user nova-compute[74242]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 20 02:51:24 user nova-compute[74242]: </disk>
Oct 20 02:51:24 user nova-compute[74242]:  {{(pid=74242) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 20 02:51:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:51:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 21de2a46-ff82-4f25-8728-9729d33a9c8c {{(pid=74242) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 20 02:51:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:51:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:51:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:51:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:51:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:35 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:40 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:51:40 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:51:44 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 21de2a46-ff82-4f25-8728-9729d33a9c8c is timed out.
Oct 20 02:51:44 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Successfully detached device vdb from instance 21de2a46-ff82-4f25-8728-9729d33a9c8c from the live domain config.
Oct 20 02:51:44 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFADfeTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:51:44 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:51:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c88e9f6-ff68-409e-be37-573f800d4c6f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:51:44 user nova-compute[74242]: No targets found.
Oct 20 02:51:44 user nova-compute[74242]: iSNS:
Oct 20 02:51:44 user nova-compute[74242]: No targets found.
Oct 20 02:51:44 user nova-compute[74242]: STATIC:
Oct 20 02:51:44 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0
Oct 20 02:51:44 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:51:44 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:51:44 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695
Oct 20 02:51:44 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:51:44 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:51:44 user nova-compute[74242]: FIRMWARE:
Oct 20 02:51:44 user nova-compute[74242]: No targets found.
Oct 20 02:51:44 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:51:44 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:51:44 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8373aa1-030f-42bc-a558-5e2b774d14e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[d031411b-ad43-4ce2-85f5-f109f63d790e]: (4, ('tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 (non-flash)\ntcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 (non-flash)
Oct 20 02:51:44 user nova-compute[74242]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)
Oct 20 02:51:44 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsi session list stdout=tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 (non-flash)
Oct 20 02:51:44 user nova-compute[74242]: tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)
Oct 20 02:51:44 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b86a1120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0'): ({'sdb'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Removing single pathed devices sdb {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f65248-62d8-486b-b679-29ecacd8d0d8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[661dfa1c-63bd-4025-9196-5bffba9f5985]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Flushing IO for device /dev/sdb {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f61a58-448b-48a4-bcbe-97411fc52985]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:51:44 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4282f7e6-0fd9-473e-8573-e425293a34cf]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[12384ed5-12fa-4abd-9cf5-5063efa40ad1]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b8c6237-0f66-4a46-ba71-851e3a9397bd]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0, portal: 172.16.0.220,3260]
Oct 20 02:51:45 user nova-compute[74242]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0, portal: 172.16.0.220,3260] successful.
Oct 20 02:51:45 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[52064fa4-8f49-4b5f-8579-1177425f44d6]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] <== disconnect_volume: return (283ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:51:45 user nova-compute[74242]: DEBUG nova.objects.instance [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lazy-loading 'flavor' on Instance uuid 21de2a46-ff82-4f25-8728-9729d33a9c8c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-13493ac8-cfc7-4c9d-ba47-9a7de8ed0acc tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.629s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.515s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "21de2a46-ff82-4f25-8728-9729d33a9c8c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:51:46 user nova-compute[74242]: INFO nova.compute.manager [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Terminating instance
Oct 20 02:51:46 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-29fc78de-7a26-4f78-9b16-007a42b9dd95 req-e77294b2-6020-451e-a1e7-e1315911bd16 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Received event network-vif-unplugged-183d5991-79a9-4c21-8617-1d45eda96c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-29fc78de-7a26-4f78-9b16-007a42b9dd95 req-e77294b2-6020-451e-a1e7-e1315911bd16 service nova] Acquiring lock "21de2a46-ff82-4f25-8728-9729d33a9c8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-29fc78de-7a26-4f78-9b16-007a42b9dd95 req-e77294b2-6020-451e-a1e7-e1315911bd16 service nova] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-29fc78de-7a26-4f78-9b16-007a42b9dd95 req-e77294b2-6020-451e-a1e7-e1315911bd16 service nova] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-29fc78de-7a26-4f78-9b16-007a42b9dd95 req-e77294b2-6020-451e-a1e7-e1315911bd16 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] No waiting events found dispatching network-vif-unplugged-183d5991-79a9-4c21-8617-1d45eda96c45 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG nova.compute.manager [req-29fc78de-7a26-4f78-9b16-007a42b9dd95 req-e77294b2-6020-451e-a1e7-e1315911bd16 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Received event network-vif-unplugged-183d5991-79a9-4c21-8617-1d45eda96c45 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:46 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Instance destroyed successfully.
Oct 20 02:51:46 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lazy-loading 'resources' on Instance uuid 21de2a46-ff82-4f25-8728-9729d33a9c8c {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:48:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-797931908',display_name='tempest-VolumesSnapshotTestJSON-instance-797931908',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-797931908',id=51,image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDrk2/6EiGhMuqTpv5D/0vAC3o8qtaujHdZvwU7/9WFWz1+oErV3XhVTXfQL0Z67hMOscdoT7XAGx4fjK2i07jaTzrGcgIHkuWj22uT8TItsqUZ8cxAi89aojZ/H8g+x1Q==',key_name='tempest-keypair-700692130',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:48:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='060e30702e08441b981009a6f2f17007',ramdisk_id='',reservation_id='r-fd00bd4b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='1ba817e4-0454-4c11-9ff7-3af381824874',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-553194039',owner_user_name='tempest-VolumesSnapshotTestJSON-553194039-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:48:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='417d4230c6c94c3c93cd0b2f251b7212',uuid=21de2a46-ff82-4f25-8728-9729d33a9c8c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "183d5991-79a9-4c21-8617-1d45eda96c45", "address": "fa:16:3e:c5:7d:37", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183d5991-79", "ovs_interfaceid": "183d5991-79a9-4c21-8617-1d45eda96c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Converting VIF {"id": "183d5991-79a9-4c21-8617-1d45eda96c45", "address": "fa:16:3e:c5:7d:37", "network": {"id": "516bdc21-bbb8-4415-b700-903042bd794a", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1655698218-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "060e30702e08441b981009a6f2f17007", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap183d5991-79", "ovs_interfaceid": "183d5991-79a9-4c21-8617-1d45eda96c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:7d:37,bridge_name='br-int',has_traffic_filtering=True,id=183d5991-79a9-4c21-8617-1d45eda96c45,network=Network(516bdc21-bbb8-4415-b700-903042bd794a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183d5991-79') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG os_vif [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:7d:37,bridge_name='br-int',has_traffic_filtering=True,id=183d5991-79a9-4c21-8617-1d45eda96c45,network=Network(516bdc21-bbb8-4415-b700-903042bd794a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183d5991-79') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap183d5991-79, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7cc83203-801b-45e1-9667-081a3860e42c) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:51:46 user nova-compute[74242]: INFO os_vif [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:7d:37,bridge_name='br-int',has_traffic_filtering=True,id=183d5991-79a9-4c21-8617-1d45eda96c45,network=Network(516bdc21-bbb8-4415-b700-903042bd794a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap183d5991-79')
Oct 20 02:51:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QFADfeTY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:51:46 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:51:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4871f724-1528-4f56-8f6e-f65e6670bd85]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:51:46 user nova-compute[74242]: No targets found.
Oct 20 02:51:46 user nova-compute[74242]: iSNS:
Oct 20 02:51:46 user nova-compute[74242]: No targets found.
Oct 20 02:51:46 user nova-compute[74242]: STATIC:
Oct 20 02:51:46 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695
Oct 20 02:51:46 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:51:46 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:51:46 user nova-compute[74242]: FIRMWARE:
Oct 20 02:51:46 user nova-compute[74242]: No targets found.
Oct 20 02:51:46 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:51:46 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:51:46 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3562389c-6148-457f-a11c-b2ab9ebecfd0', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbfc783-13c5-4e81-8c5a-bc7c7da2eab9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d6bba9-1afc-4bd2-be9f-82416527d3b0]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)
Oct 20 02:51:46 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)
Oct 20 02:51:46 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8b86a2320>, {}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Disconnecting from: [] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.070s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] <== disconnect_volume: return (71ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:51:46 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Deleting instance files /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c_del
Oct 20 02:51:46 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Deletion of /opt/stack/data/nova/instances/21de2a46-ff82-4f25-8728-9729d33a9c8c_del complete
Oct 20 02:51:46 user nova-compute[74242]: INFO nova.compute.manager [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 20 02:51:46 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:51:46 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:51:47 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:51:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-2c37b2a3-6703-4535-8200-22c94218b9f9 req-bf6f4935-6db7-44b1-8b33-e54a25ddf3b0 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Received event network-vif-deleted-183d5991-79a9-4c21-8617-1d45eda96c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:51:47 user nova-compute[74242]: INFO nova.compute.manager [req-2c37b2a3-6703-4535-8200-22c94218b9f9 req-bf6f4935-6db7-44b1-8b33-e54a25ddf3b0 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Neutron deleted interface 183d5991-79a9-4c21-8617-1d45eda96c45; detaching it from the instance and deleting it from the info cache
Oct 20 02:51:47 user nova-compute[74242]: DEBUG nova.network.neutron [req-2c37b2a3-6703-4535-8200-22c94218b9f9 req-bf6f4935-6db7-44b1-8b33-e54a25ddf3b0 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:51:47 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Took 0.97 seconds to deallocate network for instance.
Oct 20 02:51:47 user nova-compute[74242]: DEBUG nova.compute.manager [req-2c37b2a3-6703-4535-8200-22c94218b9f9 req-bf6f4935-6db7-44b1-8b33-e54a25ddf3b0 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Detach interface failed, port_id=183d5991-79a9-4c21-8617-1d45eda96c45, reason: Instance 21de2a46-ff82-4f25-8728-9729d33a9c8c could not be found. {{(pid=74242) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 20 02:51:47 user nova-compute[74242]: WARNING nova.volume.cinder [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Attachment 3d8bcc76-0d39-4f76-bcef-a0ff9bf958c4 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 3d8bcc76-0d39-4f76-bcef-a0ff9bf958c4. (HTTP 404) (Request-ID: req-0c4e6a1f-2f51-4cfa-920d-dcaecd9fd9e8)
Oct 20 02:51:47 user nova-compute[74242]: INFO nova.compute.manager [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Took 0.06 seconds to detach 1 volumes for instance.
Oct 20 02:51:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:51:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:51:48 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:51:48 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:51:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.136s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:51:48 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Deleted allocations for instance 21de2a46-ff82-4f25-8728-9729d33a9c8c
Oct 20 02:51:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1638bd62-847e-4ba9-907f-39d304d94b83 tempest-VolumesSnapshotTestJSON-553194039 tempest-VolumesSnapshotTestJSON-553194039-project-member] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.281s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:51:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-02e54918-6fc2-4803-97e9-d8ee0bc5ad43 req-56cf4541-896d-4c3c-867c-210ab4f7cbb0 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Received event network-vif-plugged-183d5991-79a9-4c21-8617-1d45eda96c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:51:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-02e54918-6fc2-4803-97e9-d8ee0bc5ad43 req-56cf4541-896d-4c3c-867c-210ab4f7cbb0 service nova] Acquiring lock "21de2a46-ff82-4f25-8728-9729d33a9c8c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:51:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-02e54918-6fc2-4803-97e9-d8ee0bc5ad43 req-56cf4541-896d-4c3c-867c-210ab4f7cbb0 service nova] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:51:48 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-02e54918-6fc2-4803-97e9-d8ee0bc5ad43 req-56cf4541-896d-4c3c-867c-210ab4f7cbb0 service nova] Lock "21de2a46-ff82-4f25-8728-9729d33a9c8c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:51:48 user nova-compute[74242]: DEBUG nova.compute.manager [req-02e54918-6fc2-4803-97e9-d8ee0bc5ad43 req-56cf4541-896d-4c3c-867c-210ab4f7cbb0 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] No waiting events found dispatching network-vif-plugged-183d5991-79a9-4c21-8617-1d45eda96c45 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:51:48 user nova-compute[74242]: WARNING nova.compute.manager [req-02e54918-6fc2-4803-97e9-d8ee0bc5ad43 req-56cf4541-896d-4c3c-867c-210ab4f7cbb0 service nova] [instance: 21de2a46-ff82-4f25-8728-9729d33a9c8c] Received unexpected event network-vif-plugged-183d5991-79a9-4c21-8617-1d45eda96c45 for instance with vm_state deleted and task_state None.
Oct 20 02:51:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:51:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:00 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:52:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:52:05 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:52:05 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:52:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:52:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:52:05 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:52:05 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updating instance_info_cache with network_info: [{"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:52:05 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:52:05 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:52:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:52:08 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:52:11 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:52:11 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:52:11 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8924MB free_disk=24.915882110595703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c50216a6-a0cd-4566-b4e6-ffd9eeff1629 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:52:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:52:13 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:52:13 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:52:13 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:52:14 user nova-compute[74242]: DEBUG nova.compute.manager [req-753f171e-742f-40c2-9953-5ba5b476b308 req-65605d1a-b6c0-4b27-99e7-1d5c6a8dc3d6 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received event network-changed-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:52:14 user nova-compute[74242]: DEBUG nova.compute.manager [req-753f171e-742f-40c2-9953-5ba5b476b308 req-65605d1a-b6c0-4b27-99e7-1d5c6a8dc3d6 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Refreshing instance network info cache due to event network-changed-5247d96d-f3c5-418d-871e-a55ab2123c45. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:52:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-753f171e-742f-40c2-9953-5ba5b476b308 req-65605d1a-b6c0-4b27-99e7-1d5c6a8dc3d6 service nova] Acquiring lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:52:14 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-753f171e-742f-40c2-9953-5ba5b476b308 req-65605d1a-b6c0-4b27-99e7-1d5c6a8dc3d6 service nova] Acquired lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:52:14 user nova-compute[74242]: DEBUG nova.network.neutron [req-753f171e-742f-40c2-9953-5ba5b476b308 req-65605d1a-b6c0-4b27-99e7-1d5c6a8dc3d6 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Refreshing network info cache for port 5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:52:15 user nova-compute[74242]: DEBUG nova.network.neutron [req-753f171e-742f-40c2-9953-5ba5b476b308 req-65605d1a-b6c0-4b27-99e7-1d5c6a8dc3d6 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updated VIF entry in instance network info cache for port 5247d96d-f3c5-418d-871e-a55ab2123c45. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:52:15 user nova-compute[74242]: DEBUG nova.network.neutron [req-753f171e-742f-40c2-9953-5ba5b476b308 req-65605d1a-b6c0-4b27-99e7-1d5c6a8dc3d6 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updating instance_info_cache with network_info: [{"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:52:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-753f171e-742f-40c2-9953-5ba5b476b308 req-65605d1a-b6c0-4b27-99e7-1d5c6a8dc3d6 service nova] Releasing lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:52:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:52:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:52:15 user nova-compute[74242]: INFO nova.compute.manager [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Shelve offloading
Oct 20 02:52:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:15 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:16 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Instance destroyed successfully.
Oct 20 02:52:16 user nova-compute[74242]: DEBUG nova.compute.manager [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquired lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG nova.network.neutron [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updating instance_info_cache with network_info: [{"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Releasing lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-403e36c5-4908-498b-9fa0-1c45aa6cf205 req-261384de-d5dd-4239-872d-2a1cbfe9447a service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received event network-vif-unplugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-403e36c5-4908-498b-9fa0-1c45aa6cf205 req-261384de-d5dd-4239-872d-2a1cbfe9447a service nova] Acquiring lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-403e36c5-4908-498b-9fa0-1c45aa6cf205 req-261384de-d5dd-4239-872d-2a1cbfe9447a service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-403e36c5-4908-498b-9fa0-1c45aa6cf205 req-261384de-d5dd-4239-872d-2a1cbfe9447a service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-403e36c5-4908-498b-9fa0-1c45aa6cf205 req-261384de-d5dd-4239-872d-2a1cbfe9447a service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] No waiting events found dispatching network-vif-unplugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:52:16 user nova-compute[74242]: WARNING nova.compute.manager [req-403e36c5-4908-498b-9fa0-1c45aa6cf205 req-261384de-d5dd-4239-872d-2a1cbfe9447a service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received unexpected event network-vif-unplugged-5247d96d-f3c5-418d-871e-a55ab2123c45 for instance with vm_state active and task_state shelving.
Oct 20 02:52:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-403e36c5-4908-498b-9fa0-1c45aa6cf205 req-261384de-d5dd-4239-872d-2a1cbfe9447a service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received event network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-403e36c5-4908-498b-9fa0-1c45aa6cf205 req-261384de-d5dd-4239-872d-2a1cbfe9447a service nova] Acquiring lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-403e36c5-4908-498b-9fa0-1c45aa6cf205 req-261384de-d5dd-4239-872d-2a1cbfe9447a service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-403e36c5-4908-498b-9fa0-1c45aa6cf205 req-261384de-d5dd-4239-872d-2a1cbfe9447a service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG nova.compute.manager [req-403e36c5-4908-498b-9fa0-1c45aa6cf205 req-261384de-d5dd-4239-872d-2a1cbfe9447a service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] No waiting events found dispatching network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:52:16 user nova-compute[74242]: WARNING nova.compute.manager [req-403e36c5-4908-498b-9fa0-1c45aa6cf205 req-261384de-d5dd-4239-872d-2a1cbfe9447a service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received unexpected event network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 for instance with vm_state active and task_state shelving.
Oct 20 02:52:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:17 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Instance destroyed successfully.
Oct 20 02:52:17 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lazy-loading 'resources' on Instance uuid c50216a6-a0cd-4566-b4e6-ffd9eeff1629 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-20T02:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1407200199',display_name='tempest-TestShelveInstance-server-1407200199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1407200199',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNZ78+lV4Tgetykk6GbM0enr8XIjlk7QrLufh1HTfOOMuUyGaPgSATa7w3kCGPkrfD5fRr89uGyG33qlQ3HJsVTbwQ/BSCBCknrjGTBV9kpcke3lur3SCfPSlFb9doLNw==',key_name='tempest-TestShelveInstance-2138519179',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a1d892a5f4849bea73c1b4c4a0a2a6f',ramdisk_id='',reservation_id='r-4qig0o00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1204752060',owner_user_name='tempest-TestShelveInstance-1204752060-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:50:44Z,user_data=None,user_id='698464fcfc7c48ff90ccbf2636508ef5',uuid=c50216a6-a0cd-4566-b4e6-ffd9eeff1629,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Converting VIF {"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7d:96,bridge_name='br-int',has_traffic_filtering=True,id=5247d96d-f3c5-418d-871e-a55ab2123c45,network=Network(b634b705-e4e4-479c-8300-5c81ef242107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5247d96d-f3') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_vif [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7d:96,bridge_name='br-int',has_traffic_filtering=True,id=5247d96d-f3c5-418d-871e-a55ab2123c45,network=Network(b634b705-e4e4-479c-8300-5c81ef242107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5247d96d-f3') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5247d96d-f3, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=24755142-0f5d-404e-98b5-32759a0534d2) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:17 user nova-compute[74242]: INFO os_vif [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7d:96,bridge_name='br-int',has_traffic_filtering=True,id=5247d96d-f3c5-418d-871e-a55ab2123c45,network=Network(b634b705-e4e4-479c-8300-5c81ef242107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5247d96d-f3')
Oct 20 02:52:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLcoqxuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:52:17 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[adb21eb1-26f4-4250-88b4-00d0e841ec1f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:52:17 user nova-compute[74242]: No targets found.
Oct 20 02:52:17 user nova-compute[74242]: iSNS:
Oct 20 02:52:17 user nova-compute[74242]: No targets found.
Oct 20 02:52:17 user nova-compute[74242]: STATIC:
Oct 20 02:52:17 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695
Oct 20 02:52:17 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:52:17 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:52:17 user nova-compute[74242]: FIRMWARE:
Oct 20 02:52:17 user nova-compute[74242]: No targets found.
Oct 20 02:52:17 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:52:17 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:52:17 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdeb2916-a375-4ff7-95c9-28c4f3b5c5d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5322cee5-be97-4eda-9402-2e92fdf171f8]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)
Oct 20 02:52:17 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)
Oct 20 02:52:17 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb8d930a200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695'): ({'sdc'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Removing single pathed devices sdc {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7ed5e7-c8c3-4dfb-bac6-d173e24e2e58]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b55bdb-4700-4680-b9dc-16ac38405bfa]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Flushing IO for device /dev/sdc {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b44f875-c997-4b0c-9564-805540967f3b]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c55486d-0d9b-4b4f-96db-322765af5f3c]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] SCSI volumes sdc have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f9e51f-7302-4bea-b1fa-9f9bd16b50ba]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a514cfdb-6d13-4e38-844e-7d86e7c18b21]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260]
Oct 20 02:52:17 user nova-compute[74242]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260] successful.
Oct 20 02:52:17 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b9f187-879c-4bad-aa98-8f9bcc7c0d97]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.292s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] <== disconnect_volume: return (293ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:52:17 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:52:17 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Deleting instance files /opt/stack/data/nova/instances/c50216a6-a0cd-4566-b4e6-ffd9eeff1629_del
Oct 20 02:52:17 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Deletion of /opt/stack/data/nova/instances/c50216a6-a0cd-4566-b4e6-ffd9eeff1629_del complete
Oct 20 02:52:18 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Deleted allocations for instance c50216a6-a0cd-4566-b4e6-ffd9eeff1629
Oct 20 02:52:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:52:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:52:18 user nova-compute[74242]: DEBUG nova.objects.instance [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lazy-loading 'numa_topology' on Instance uuid c50216a6-a0cd-4566-b4e6-ffd9eeff1629 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:52:18 user nova-compute[74242]: DEBUG nova.objects.base [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Object Instance<c50216a6-a0cd-4566-b4e6-ffd9eeff1629> lazy-loaded attributes: resources,numa_topology {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:52:18 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:52:18 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:52:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.125s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:52:18 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-1c0bf2ea-dc23-42e0-b2d2-161b5b9df9d7 tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.449s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:52:19 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:52:19 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:52:20 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:25 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:52:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:52:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:53:02 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:53:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:53:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:53:06 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:53:06 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:53:06 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Didn't find any instances for network info cache update. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 02:53:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:53:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:53:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:53:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:53:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:53:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:53:09 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:53:11 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:53:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:53:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:53:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:53:11 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:53:11 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:53:11 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:53:11 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=9081MB free_disk=24.906288146972656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:53:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:53:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:53:11 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:53:11 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:53:11 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:53:11 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:53:11 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:53:11 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:53:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:53:14 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:53:15 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:53:15 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:53:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:53:18 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:53:21 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:53:21 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:53:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:53:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:53:32 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:53:37 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:53:42 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:53:45 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:53:47 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:53:52 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:53:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:53:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:53:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:02 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:03 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:54:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:54:06 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:54:06 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:54:06 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Didn't find any instances for network info cache update. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:54:07 user nova-compute[74242]: INFO nova.compute.manager [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Unshelving
Oct 20 02:54:07 user nova-compute[74242]: INFO nova.virt.block_device [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Booting with volume b0cb2426-c05c-4657-9099-931233506695 at /dev/vda
Oct 20 02:54:07 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG os_brick.utils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a536aa79-9d82-435d-8882-6507afcab838]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:6c3aa692d952\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c872ca-96f7-40ea-85d0-feb563ace47b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75d9b6a-5536-4fbb-b23a-af8c69758128]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a6b80c-4b4d-4f5b-b103-c2043359f373]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Running cmd (subprocess): nvme version {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] 'nvme version' failed. Not Retrying. {{(pid=74242) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] nvme not present on system {{(pid=74242) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 20 02:54:07 user nova-compute[74242]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 20 02:54:07 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[da494b6a-c817-452c-bc02-90f39418ffeb]: (4, '') {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74242) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.lightos [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] LIGHTOS: no hostnqn found. {{(pid=74242) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG os_brick.utils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:6c3aa692d952', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:54:07 user nova-compute[74242]: DEBUG nova.virt.block_device [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updating existing volume attachment record: 2dec3db0-596e-4cd3-8076-931534e14e76 {{(pid=74242) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 20 02:54:11 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:54:12 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:54:13 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:54:13 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:54:13 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=9069MB free_disk=24.904712677001953GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c50216a6-a0cd-4566-b4e6-ffd9eeff1629 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing inventories for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Updating ProviderTree inventory for provider 07b40460-b6ac-48c1-8447-e1778d50b26e from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Updating inventory in ProviderTree for provider 07b40460-b6ac-48c1-8447-e1778d50b26e with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing aggregate associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, aggregates: None {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Refreshing trait associations for resource provider 07b40460-b6ac-48c1-8447-e1778d50b26e, traits: COMPUTE_IMAGE_TYPE_RAW,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSE42,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_VIRTIO,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_USB,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_MULTI_ATTACH,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_TRUSTED_CERTS,COMPUTE_GRAPHICS_MODEL_QXL,HW_CPU_X86_SSE41,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NODE,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_SOCKET_PCI_NUMA_AFFINITY {{(pid=74242) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:54:13 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.340s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:54:14 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:54:16 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:54:16 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:54:17 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:54:19 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:54:21 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:54:22 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:23 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:54:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:54:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:54:23 user nova-compute[74242]: DEBUG nova.objects.instance [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lazy-loading 'pci_requests' on Instance uuid c50216a6-a0cd-4566-b4e6-ffd9eeff1629 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:54:23 user nova-compute[74242]: DEBUG nova.objects.instance [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lazy-loading 'numa_topology' on Instance uuid c50216a6-a0cd-4566-b4e6-ffd9eeff1629 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:54:23 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74242) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Oct 20 02:54:23 user nova-compute[74242]: INFO nova.compute.claims [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Claim successful on node user
Oct 20 02:54:23 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:54:23 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:54:23 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.210s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:54:23 user nova-compute[74242]: INFO nova.network.neutron [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updating port 5247d96d-f3c5-418d-871e-a55ab2123c45 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquired lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.network.neutron [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Building network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-d34a7a20-b6cb-4c87-b08e-a872a1917ab0 req-348444ae-cab8-41b8-a257-913c47696a14 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received event network-changed-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.compute.manager [req-d34a7a20-b6cb-4c87-b08e-a872a1917ab0 req-348444ae-cab8-41b8-a257-913c47696a14 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Refreshing instance network info cache due to event network-changed-5247d96d-f3c5-418d-871e-a55ab2123c45. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d34a7a20-b6cb-4c87-b08e-a872a1917ab0 req-348444ae-cab8-41b8-a257-913c47696a14 service nova] Acquiring lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.network.neutron [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updating instance_info_cache with network_info: [{"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Releasing lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Creating instance directory {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 20 02:54:24 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Creating image(s)
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Did not create local disks {{(pid=74242) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Ensure instance console log exists: /opt/stack/data/nova/instances/c50216a6-a0cd-4566-b4e6-ffd9eeff1629/console.log {{(pid=74242) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Start _get_guest_xml network_info=[{"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'boot_index': 0, 'delete_on_termination': True, 'device_type': 'disk', 'mount_device': '/dev/vda', 'disk_bus': 'virtio', 'attachment_id': '2dec3db0-596e-4cd3-8076-931534e14e76', 'guest_format': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLcoqxuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c50216a6-a0cd-4566-b4e6-ffd9eeff1629', 'attached_at': '', 'detached_at': '', 'volume_id': 'b0cb2426-c05c-4657-9099-931233506695', 'serial': 'b0cb2426-c05c-4657-9099-931233506695'}, 'volume_type': None} {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d34a7a20-b6cb-4c87-b08e-a872a1917ab0 req-348444ae-cab8-41b8-a257-913c47696a14 service nova] Acquired lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.network.neutron [req-d34a7a20-b6cb-4c87-b08e-a872a1917ab0 req-348444ae-cab8-41b8-a257-913c47696a14 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Refreshing network info cache for port 5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:54:24 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:54:24 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] CPU controller missing on host. {{(pid=74242) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.host [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] CPU controller found on host. {{(pid=74242) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74242) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-20T01:58:38Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Flavor limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Image limits 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Flavor pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Image pref 0:0:0 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74242) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Got 1 possible topologies {{(pid=74242) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.hardware [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74242) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.objects.instance [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lazy-loading 'vcpu_model' on Instance uuid c50216a6-a0cd-4566-b4e6-ffd9eeff1629 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.objects.base [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Object Instance<c50216a6-a0cd-4566-b4e6-ffd9eeff1629> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Calling os-brick to attach iSCSI Volume {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLcoqxuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:54:24 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:54:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:54:24 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:54:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:54:24 user nova-compute[74242]: INFO os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 20 02:54:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[0167a318-cfa0-4415-94c8-5b47ada6b734]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 20 02:54:24 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --interface default --op new {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c323ea-6f55-40dd-b700-6092987a1dbd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695] added\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695] added
Oct 20 02:54:24 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:54:24 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d2fa66-0c70-452d-9e91-cb49bb701ecb]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[144f4bdd-5812-40dd-9801-88f50f2c0f4f]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLcoqxuP {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rLcoqxuP" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e828650a-9e79-46a1-94f8-bbde15ce9be1]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rLcoqxuP'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[06602f56-303d-4d98-bca5-e53f4a8f0f5c]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e66f75b-e755-4bb8-8bad-ddd0da093d6b]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 20 02:54:25 user nova-compute[74242]:  {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 20 02:54:25 user nova-compute[74242]:  {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:54:25 user nova-compute[74242]: WARNING os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 20 02:54:25 user nova-compute[74242]: 
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --login {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa0f8e1-e82c-4a9a-9f8c-327d2cf2fa8c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260]
Oct 20 02:54:25 user nova-compute[74242]: Login to [iface: default, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260] successful.
Oct 20 02:54:25 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c06461d3-8829-4f0c-b113-7d0f02c8a14d]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc3decb-b8e3-4bcd-9e28-db6d73a5500e]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)
Oct 20 02:54:25 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)
Oct 20 02:54:25 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Connected to 172.16.0.220:3260 {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=74242) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74242) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1baebdb-e260-4de5-a72f-853f9e99d796]: (4, ('- - 0', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74242) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLcoqxuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74242) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG nova.network.neutron [req-d34a7a20-b6cb-4c87-b08e-a872a1917ab0 req-348444ae-cab8-41b8-a257-913c47696a14 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updated VIF entry in instance network info cache for port 5247d96d-f3c5-418d-871e-a55ab2123c45. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG nova.network.neutron [req-d34a7a20-b6cb-4c87-b08e-a872a1917ab0 req-348444ae-cab8-41b8-a257-913c47696a14 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updating instance_info_cache with network_info: [{"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:54:25 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-d34a7a20-b6cb-4c87-b08e-a872a1917ab0 req-348444ae-cab8-41b8-a257-913c47696a14 service nova] Releasing lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '26431313465353538', 'path': '/dev/sdb'} {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26431313465353538', 'path': '/dev/sdb'} {{(pid=74242) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T02:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1407200199',display_name='tempest-TestShelveInstance-server-1407200199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1407200199',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2138519179',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8a1d892a5f4849bea73c1b4c4a0a2a6f',ramdisk_id='',reservation_id='r-4qig0o00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1204752060',owner_user_name='tempest-TestShelveInstance-1204752060-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:54:07Z,user_data=None,user_id='698464fcfc7c48ff90ccbf2636508ef5',uuid=c50216a6-a0cd-4566-b4e6-ffd9eeff1629,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74242) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Converting VIF {"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7d:96,bridge_name='br-int',has_traffic_filtering=True,id=5247d96d-f3c5-418d-871e-a55ab2123c45,network=Network(b634b705-e4e4-479c-8300-5c81ef242107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5247d96d-f3') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG nova.objects.instance [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lazy-loading 'pci_devices' on Instance uuid c50216a6-a0cd-4566-b4e6-ffd9eeff1629 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG nova.objects.base [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Object Instance<c50216a6-a0cd-4566-b4e6-ffd9eeff1629> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74242) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] End _get_guest_xml xml=<domain type="kvm">
Oct 20 02:54:26 user nova-compute[74242]:   <uuid>c50216a6-a0cd-4566-b4e6-ffd9eeff1629</uuid>
Oct 20 02:54:26 user nova-compute[74242]:   <name>instance-00000034</name>
Oct 20 02:54:26 user nova-compute[74242]:   <memory>524288</memory>
Oct 20 02:54:26 user nova-compute[74242]:   <vcpu>1</vcpu>
Oct 20 02:54:26 user nova-compute[74242]:   <metadata>
Oct 20 02:54:26 user nova-compute[74242]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 20 02:54:26 user nova-compute[74242]:       <nova:package version="0.0.0"/>
Oct 20 02:54:26 user nova-compute[74242]:       <nova:name>tempest-TestShelveInstance-server-1407200199</nova:name>
Oct 20 02:54:26 user nova-compute[74242]:       <nova:creationTime>2023-10-20 02:54:24</nova:creationTime>
Oct 20 02:54:26 user nova-compute[74242]:       <nova:flavor name="m1.tiny">
Oct 20 02:54:26 user nova-compute[74242]:         <nova:memory>512</nova:memory>
Oct 20 02:54:26 user nova-compute[74242]:         <nova:disk>1</nova:disk>
Oct 20 02:54:26 user nova-compute[74242]:         <nova:swap>0</nova:swap>
Oct 20 02:54:26 user nova-compute[74242]:         <nova:ephemeral>0</nova:ephemeral>
Oct 20 02:54:26 user nova-compute[74242]:         <nova:vcpus>1</nova:vcpus>
Oct 20 02:54:26 user nova-compute[74242]:       </nova:flavor>
Oct 20 02:54:26 user nova-compute[74242]:       <nova:owner>
Oct 20 02:54:26 user nova-compute[74242]:         <nova:user uuid="698464fcfc7c48ff90ccbf2636508ef5">tempest-TestShelveInstance-1204752060-project-member</nova:user>
Oct 20 02:54:26 user nova-compute[74242]:         <nova:project uuid="8a1d892a5f4849bea73c1b4c4a0a2a6f">tempest-TestShelveInstance-1204752060</nova:project>
Oct 20 02:54:26 user nova-compute[74242]:       </nova:owner>
Oct 20 02:54:26 user nova-compute[74242]:       <nova:ports>
Oct 20 02:54:26 user nova-compute[74242]:         <nova:port uuid="5247d96d-f3c5-418d-871e-a55ab2123c45">
Oct 20 02:54:26 user nova-compute[74242]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 20 02:54:26 user nova-compute[74242]:         </nova:port>
Oct 20 02:54:26 user nova-compute[74242]:       </nova:ports>
Oct 20 02:54:26 user nova-compute[74242]:     </nova:instance>
Oct 20 02:54:26 user nova-compute[74242]:   </metadata>
Oct 20 02:54:26 user nova-compute[74242]:   <sysinfo type="smbios">
Oct 20 02:54:26 user nova-compute[74242]:     <system>
Oct 20 02:54:26 user nova-compute[74242]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 20 02:54:26 user nova-compute[74242]:       <entry name="product">OpenStack Nova</entry>
Oct 20 02:54:26 user nova-compute[74242]:       <entry name="version">0.0.0</entry>
Oct 20 02:54:26 user nova-compute[74242]:       <entry name="serial">c50216a6-a0cd-4566-b4e6-ffd9eeff1629</entry>
Oct 20 02:54:26 user nova-compute[74242]:       <entry name="uuid">c50216a6-a0cd-4566-b4e6-ffd9eeff1629</entry>
Oct 20 02:54:26 user nova-compute[74242]:       <entry name="family">Virtual Machine</entry>
Oct 20 02:54:26 user nova-compute[74242]:     </system>
Oct 20 02:54:26 user nova-compute[74242]:   </sysinfo>
Oct 20 02:54:26 user nova-compute[74242]:   <os>
Oct 20 02:54:26 user nova-compute[74242]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 20 02:54:26 user nova-compute[74242]:     <boot dev="hd"/>
Oct 20 02:54:26 user nova-compute[74242]:     <smbios mode="sysinfo"/>
Oct 20 02:54:26 user nova-compute[74242]:   </os>
Oct 20 02:54:26 user nova-compute[74242]:   <features>
Oct 20 02:54:26 user nova-compute[74242]:     <acpi/>
Oct 20 02:54:26 user nova-compute[74242]:     <apic/>
Oct 20 02:54:26 user nova-compute[74242]:     <vmcoreinfo/>
Oct 20 02:54:26 user nova-compute[74242]:   </features>
Oct 20 02:54:26 user nova-compute[74242]:   <clock offset="utc">
Oct 20 02:54:26 user nova-compute[74242]:     <timer name="pit" tickpolicy="delay"/>
Oct 20 02:54:26 user nova-compute[74242]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 20 02:54:26 user nova-compute[74242]:     <timer name="hpet" present="no"/>
Oct 20 02:54:26 user nova-compute[74242]:   </clock>
Oct 20 02:54:26 user nova-compute[74242]:   <cpu mode="custom" match="exact">
Oct 20 02:54:26 user nova-compute[74242]:     <model>Nehalem</model>
Oct 20 02:54:26 user nova-compute[74242]:     <topology sockets="1" cores="1" threads="1"/>
Oct 20 02:54:26 user nova-compute[74242]:   </cpu>
Oct 20 02:54:26 user nova-compute[74242]:   <devices>
Oct 20 02:54:26 user nova-compute[74242]:     <disk type="block" device="disk">
Oct 20 02:54:26 user nova-compute[74242]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 20 02:54:26 user nova-compute[74242]:       <source dev="/dev/sdb"/>
Oct 20 02:54:26 user nova-compute[74242]:       <target dev="vda" bus="virtio"/>
Oct 20 02:54:26 user nova-compute[74242]:       <serial>b0cb2426-c05c-4657-9099-931233506695</serial>
Oct 20 02:54:26 user nova-compute[74242]:     </disk>
Oct 20 02:54:26 user nova-compute[74242]:     <interface type="ethernet">
Oct 20 02:54:26 user nova-compute[74242]:       <mac address="fa:16:3e:a4:7d:96"/>
Oct 20 02:54:26 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:54:26 user nova-compute[74242]:       <mtu size="1442"/>
Oct 20 02:54:26 user nova-compute[74242]:       <target dev="tap5247d96d-f3"/>
Oct 20 02:54:26 user nova-compute[74242]:     </interface>
Oct 20 02:54:26 user nova-compute[74242]:     <serial type="pty">
Oct 20 02:54:26 user nova-compute[74242]:       <log file="/opt/stack/data/nova/instances/c50216a6-a0cd-4566-b4e6-ffd9eeff1629/console.log" append="off"/>
Oct 20 02:54:26 user nova-compute[74242]:     </serial>
Oct 20 02:54:26 user nova-compute[74242]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 20 02:54:26 user nova-compute[74242]:     <video>
Oct 20 02:54:26 user nova-compute[74242]:       <model type="virtio"/>
Oct 20 02:54:26 user nova-compute[74242]:     </video>
Oct 20 02:54:26 user nova-compute[74242]:     <rng model="virtio">
Oct 20 02:54:26 user nova-compute[74242]:       <backend model="random">/dev/urandom</backend>
Oct 20 02:54:26 user nova-compute[74242]:     </rng>
Oct 20 02:54:26 user nova-compute[74242]:     <controller type="usb" index="0" model="none"/>
Oct 20 02:54:26 user nova-compute[74242]:     <memballoon model="virtio">
Oct 20 02:54:26 user nova-compute[74242]:       <stats period="10"/>
Oct 20 02:54:26 user nova-compute[74242]:     </memballoon>
Oct 20 02:54:26 user nova-compute[74242]:   </devices>
Oct 20 02:54:26 user nova-compute[74242]: </domain>
Oct 20 02:54:26 user nova-compute[74242]:  {{(pid=74242) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T02:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1407200199',display_name='tempest-TestShelveInstance-server-1407200199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1407200199',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-2138519179',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='8a1d892a5f4849bea73c1b4c4a0a2a6f',ramdisk_id='',reservation_id='r-4qig0o00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1204752060',owner_user_name='tempest-TestShelveInstance-1204752060-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:54:07Z,user_data=None,user_id='698464fcfc7c48ff90ccbf2636508ef5',uuid=c50216a6-a0cd-4566-b4e6-ffd9eeff1629,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Converting VIF {"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7d:96,bridge_name='br-int',has_traffic_filtering=True,id=5247d96d-f3c5-418d-871e-a55ab2123c45,network=Network(b634b705-e4e4-479c-8300-5c81ef242107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5247d96d-f3') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG os_vif [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7d:96,bridge_name='br-int',has_traffic_filtering=True,id=5247d96d-f3c5-418d-871e-a55ab2123c45,network=Network(b634b705-e4e4-479c-8300-5c81ef242107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5247d96d-f3') {{(pid=74242) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cc085778-2aff-5220-b44f-83e38a942bed', '_type': 'linux-noop'}}, row=False) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5247d96d-f3, may_exist=True, interface_attrs={}) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5247d96d-f3, col_values=(('qos', UUID('f8004d88-2fd1-437e-848b-3ecd4c544f08')),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5247d96d-f3, col_values=(('external_ids', {'iface-id': '5247d96d-f3c5-418d-871e-a55ab2123c45', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:7d:96', 'vm-uuid': 'c50216a6-a0cd-4566-b4e6-ffd9eeff1629'}),), if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:26 user nova-compute[74242]: INFO os_vif [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:7d:96,bridge_name='br-int',has_traffic_filtering=True,id=5247d96d-f3c5-418d-871e-a55ab2123c45,network=Network(b634b705-e4e4-479c-8300-5c81ef242107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5247d96d-f3')
Oct 20 02:54:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74242) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 20 02:54:26 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] No VIF found with MAC fa:16:3e:a4:7d:96, not building metadata {{(pid=74242) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 20 02:54:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:27 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-36a617d3-29e6-430b-b478-12ac51b098ed req-9a0cefa6-d682-48bd-a014-1287f92b719a service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received event network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:54:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-36a617d3-29e6-430b-b478-12ac51b098ed req-9a0cefa6-d682-48bd-a014-1287f92b719a service nova] Acquiring lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:54:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-36a617d3-29e6-430b-b478-12ac51b098ed req-9a0cefa6-d682-48bd-a014-1287f92b719a service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:54:27 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-36a617d3-29e6-430b-b478-12ac51b098ed req-9a0cefa6-d682-48bd-a014-1287f92b719a service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:54:27 user nova-compute[74242]: DEBUG nova.compute.manager [req-36a617d3-29e6-430b-b478-12ac51b098ed req-9a0cefa6-d682-48bd-a014-1287f92b719a service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] No waiting events found dispatching network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:54:27 user nova-compute[74242]: WARNING nova.compute.manager [req-36a617d3-29e6-430b-b478-12ac51b098ed req-9a0cefa6-d682-48bd-a014-1287f92b719a service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received unexpected event network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 20 02:54:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:28 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:29 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:54:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74242) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 20 02:54:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Instance event wait completed in 0 seconds for  {{(pid=74242) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 20 02:54:29 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Guest created on hypervisor {{(pid=74242) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 20 02:54:29 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Instance spawned successfully.
Oct 20 02:54:29 user nova-compute[74242]: DEBUG nova.compute.manager [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Checking state {{(pid=74242) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 20 02:54:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-b48e7b89-cbfb-4859-ae90-3f2a8ef5fb6c tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 22.543s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:54:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-a7497570-de6f-4338-a85e-bb22eca7cd85 req-777071de-3fe1-46d4-824a-e82759e3d0af service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received event network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:54:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a7497570-de6f-4338-a85e-bb22eca7cd85 req-777071de-3fe1-46d4-824a-e82759e3d0af service nova] Acquiring lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:54:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a7497570-de6f-4338-a85e-bb22eca7cd85 req-777071de-3fe1-46d4-824a-e82759e3d0af service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:54:29 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-a7497570-de6f-4338-a85e-bb22eca7cd85 req-777071de-3fe1-46d4-824a-e82759e3d0af service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:54:29 user nova-compute[74242]: DEBUG nova.compute.manager [req-a7497570-de6f-4338-a85e-bb22eca7cd85 req-777071de-3fe1-46d4-824a-e82759e3d0af service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] No waiting events found dispatching network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:54:29 user nova-compute[74242]: WARNING nova.compute.manager [req-a7497570-de6f-4338-a85e-bb22eca7cd85 req-777071de-3fe1-46d4-824a-e82759e3d0af service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received unexpected event network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 for instance with vm_state active and task_state None.
Oct 20 02:54:30 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:54:39 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:54:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:54:43 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:54:43 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Cleaning up deleted instances {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 20 02:54:43 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] There are 0 instances to clean {{(pid=74242) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 20 02:54:45 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:50 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:55 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:54:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:01 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:03 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:55:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:55:06 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:55:06 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:55:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:55:06 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquired lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:55:06 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Forcefully refreshing network info cache for instance {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 20 02:55:06 user nova-compute[74242]: DEBUG nova.objects.instance [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lazy-loading 'info_cache' on Instance uuid c50216a6-a0cd-4566-b4e6-ffd9eeff1629 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:55:06 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:55:06 user nova-compute[74242]: DEBUG nova.network.neutron [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updating instance_info_cache with network_info: [{"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:55:07 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Releasing lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:55:07 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updated the network info_cache for instance {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 20 02:55:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:11 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:12 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:55:15 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:55:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:55:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:55:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:55:15 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:55:15 user nova-compute[74242]: DEBUG nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74242) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 20 02:55:15 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:55:15 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:55:15 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=8998MB free_disk=24.902587890625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:55:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:55:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:55:15 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Instance c50216a6-a0cd-4566-b4e6-ffd9eeff1629 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74242) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 20 02:55:15 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:55:15 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:55:15 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:55:15 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:55:15 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:55:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:55:16 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:55:16 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:55:18 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:55:18 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:55:19 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:55:21 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:55:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:55:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:55:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:55:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:55:21 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:23 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:55:26 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:55:31 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:36 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:55:41 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:55:45 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:55:46 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:55:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:55:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:55:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:55:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:55:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:55:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:55:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:55:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:55:56 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:57 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:55:58 user nova-compute[74242]: INFO nova.compute.manager [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Terminating instance
Oct 20 02:55:58 user nova-compute[74242]: DEBUG nova.compute.manager [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Start destroying the instance on the hypervisor. {{(pid=74242) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-42631b23-44d5-40bb-892c-6616d1ce4e1a req-e6b3fb12-77bb-46c7-9b66-3bbcf59ca99e service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received event network-changed-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-42631b23-44d5-40bb-892c-6616d1ce4e1a req-e6b3fb12-77bb-46c7-9b66-3bbcf59ca99e service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Refreshing instance network info cache due to event network-changed-5247d96d-f3c5-418d-871e-a55ab2123c45. {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-42631b23-44d5-40bb-892c-6616d1ce4e1a req-e6b3fb12-77bb-46c7-9b66-3bbcf59ca99e service nova] Acquiring lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-42631b23-44d5-40bb-892c-6616d1ce4e1a req-e6b3fb12-77bb-46c7-9b66-3bbcf59ca99e service nova] Acquired lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG nova.network.neutron [req-42631b23-44d5-40bb-892c-6616d1ce4e1a req-e6b3fb12-77bb-46c7-9b66-3bbcf59ca99e service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Refreshing network info cache for port 5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-ae9b840e-de7d-4e37-826b-b7f3af59a521 req-3d07ad3f-cb5f-4345-8d03-11aff4420e7d service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received event network-vif-unplugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ae9b840e-de7d-4e37-826b-b7f3af59a521 req-3d07ad3f-cb5f-4345-8d03-11aff4420e7d service nova] Acquiring lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ae9b840e-de7d-4e37-826b-b7f3af59a521 req-3d07ad3f-cb5f-4345-8d03-11aff4420e7d service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-ae9b840e-de7d-4e37-826b-b7f3af59a521 req-3d07ad3f-cb5f-4345-8d03-11aff4420e7d service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-ae9b840e-de7d-4e37-826b-b7f3af59a521 req-3d07ad3f-cb5f-4345-8d03-11aff4420e7d service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] No waiting events found dispatching network-vif-unplugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG nova.compute.manager [req-ae9b840e-de7d-4e37-826b-b7f3af59a521 req-3d07ad3f-cb5f-4345-8d03-11aff4420e7d service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received event network-vif-unplugged-5247d96d-f3c5-418d-871e-a55ab2123c45 for instance with task_state deleting. {{(pid=74242) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG nova.network.neutron [req-42631b23-44d5-40bb-892c-6616d1ce4e1a req-e6b3fb12-77bb-46c7-9b66-3bbcf59ca99e service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updated VIF entry in instance network info cache for port 5247d96d-f3c5-418d-871e-a55ab2123c45. {{(pid=74242) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 20 02:55:58 user nova-compute[74242]: DEBUG nova.network.neutron [req-42631b23-44d5-40bb-892c-6616d1ce4e1a req-e6b3fb12-77bb-46c7-9b66-3bbcf59ca99e service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updating instance_info_cache with network_info: [{"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-42631b23-44d5-40bb-892c-6616d1ce4e1a req-e6b3fb12-77bb-46c7-9b66-3bbcf59ca99e service nova] Releasing lock "refresh_cache-c50216a6-a0cd-4566-b4e6-ffd9eeff1629" {{(pid=74242) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 20 02:55:59 user nova-compute[74242]: INFO nova.virt.libvirt.driver [-] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Instance destroyed successfully.
Oct 20 02:55:59 user nova-compute[74242]: DEBUG nova.objects.instance [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lazy-loading 'resources' on Instance uuid c50216a6-a0cd-4566-b4e6-ffd9eeff1629 {{(pid=74242) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.vif [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-20T02:50:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1407200199',display_name='tempest-TestShelveInstance-server-1407200199',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1407200199',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLNZ78+lV4Tgetykk6GbM0enr8XIjlk7QrLufh1HTfOOMuUyGaPgSATa7w3kCGPkrfD5fRr89uGyG33qlQ3HJsVTbwQ/BSCBCknrjGTBV9kpcke3lur3SCfPSlFb9doLNw==',key_name='tempest-TestShelveInstance-2138519179',keypairs=<?>,launch_index=0,launched_at=2023-10-20T02:54:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8a1d892a5f4849bea73c1b4c4a0a2a6f',ramdisk_id='',reservation_id='r-4qig0o00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1204752060',owner_user_name='tempest-TestShelveInstance-1204752060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-20T02:54:30Z,user_data=None,user_id='698464fcfc7c48ff90ccbf2636508ef5',uuid=c50216a6-a0cd-4566-b4e6-ffd9eeff1629,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Converting VIF {"id": "5247d96d-f3c5-418d-871e-a55ab2123c45", "address": "fa:16:3e:a4:7d:96", "network": {"id": "b634b705-e4e4-479c-8300-5c81ef242107", "bridge": "br-int", "label": "tempest-TestShelveInstance-1241047185-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.103", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8a1d892a5f4849bea73c1b4c4a0a2a6f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5247d96d-f3", "ovs_interfaceid": "5247d96d-f3c5-418d-871e-a55ab2123c45", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG nova.network.os_vif_util [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7d:96,bridge_name='br-int',has_traffic_filtering=True,id=5247d96d-f3c5-418d-871e-a55ab2123c45,network=Network(b634b705-e4e4-479c-8300-5c81ef242107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5247d96d-f3') {{(pid=74242) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_vif [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7d:96,bridge_name='br-int',has_traffic_filtering=True,id=5247d96d-f3c5-418d-871e-a55ab2123c45,network=Network(b634b705-e4e4-479c-8300-5c81ef242107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5247d96d-f3') {{(pid=74242) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5247d96d-f3, bridge=br-int, if_exists=True) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f8004d88-2fd1-437e-848b-3ecd4c544f08) {{(pid=74242) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:55:59 user nova-compute[74242]: INFO os_vif [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a4:7d:96,bridge_name='br-int',has_traffic_filtering=True,id=5247d96d-f3c5-418d-871e-a55ab2123c45,network=Network(b634b705-e4e4-479c-8300-5c81ef242107),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5247d96d-f3')
Oct 20 02:55:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] calling os-brick to detach iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fb8d0209f30>, {'target_iqn': 'iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rLcoqxuP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 20 02:55:59 user nova-compute[74242]: WARNING os_brick.initiator.connectors.base [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed190fa7-25a4-4bd8-a053-fb593c0a1367]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 20 02:55:59 user nova-compute[74242]: No targets found.
Oct 20 02:55:59 user nova-compute[74242]: iSNS:
Oct 20 02:55:59 user nova-compute[74242]: No targets found.
Oct 20 02:55:59 user nova-compute[74242]: STATIC:
Oct 20 02:55:59 user nova-compute[74242]: Target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695
Oct 20 02:55:59 user nova-compute[74242]:         Portal: 172.16.0.220:3260,-1
Oct 20 02:55:59 user nova-compute[74242]:                 Iface Name: default
Oct 20 02:55:59 user nova-compute[74242]: FIRMWARE:
Oct 20 02:55:59 user nova-compute[74242]: No targets found.
Oct 20 02:55:59 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 20 02:55:59 user nova-compute[74242]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 20 02:55:59 user nova-compute[74242]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74242) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695', 0)] {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbaa6897-b182-4e5c-ada4-bc40248e3fef]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[222235bb-bef2-4628-a683-28164b7c8ce5]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)
Oct 20 02:55:59 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 (non-flash)
Oct 20 02:55:59 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fb89477fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695'): ({'sdb'}, set())}) {{(pid=74242) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Removing single pathed devices sdb {{(pid=74242) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4901e8c-4340-46e2-a4d6-c51c6bd66400]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[50183b73-3a01-4661-ad3a-9bd9c57c94d4]: (4, ('ok\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Flushing IO for device /dev/sdb {{(pid=74242) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[732845aa-4168-4486-8c2f-0c84955d5a48]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74242) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.053s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d161dc-7ee4-4cc1-9d7a-4f4833b332b6]: (4, ('1', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.linuxscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] SCSI volumes sdb have been removed. {{(pid=74242) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO7752668c-d114e5585871a668', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_7752668c', '/dev/disk/by-id/scsi-26431313465353538') {{(pid=85329) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7c3a08-90d5-4255-936e-34809b51dd8c]: (4, None) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695')] {{(pid=74242) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80d8e84-3dc6-46ac-a298-9d60731d95e7]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --logout {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[c142869c-bf93-46cc-beb8-789dd8715ee0]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260]
Oct 20 02:55:59 user nova-compute[74242]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695, portal: 172.16.0.220,3260] successful.
Oct 20 02:55:59 user nova-compute[74242]:  stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op delete {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b0cb2426-c05c-4657-9099-931233506695 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85329) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55af63b-4964-495f-be4c-c62ecb6171c1]: (4, ('', '')) {{(pid=85329) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74242) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.base [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.316s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG os_brick.initiator.connectors.iscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] <== disconnect_volume: return (317ms) None {{(pid=74242) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG nova.virt.libvirt.volume.iscsi [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Disconnected iSCSI Volume {{(pid=74242) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 20 02:55:59 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Deleting instance files /opt/stack/data/nova/instances/c50216a6-a0cd-4566-b4e6-ffd9eeff1629_del
Oct 20 02:55:59 user nova-compute[74242]: INFO nova.virt.libvirt.driver [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Deletion of /opt/stack/data/nova/instances/c50216a6-a0cd-4566-b4e6-ffd9eeff1629_del complete
Oct 20 02:55:59 user nova-compute[74242]: INFO nova.compute.manager [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Took 1.16 seconds to destroy the instance on the hypervisor.
Oct 20 02:55:59 user nova-compute[74242]: DEBUG oslo.service.loopingcall [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74242) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG nova.compute.manager [-] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Deallocating network for instance {{(pid=74242) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] deallocate_for_instance() {{(pid=74242) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:55:59 user nova-compute[74242]: DEBUG nova.network.neutron [-] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Updating instance_info_cache with network_info: [] {{(pid=74242) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 20 02:55:59 user nova-compute[74242]: INFO nova.compute.manager [-] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Took 0.41 seconds to deallocate network for instance.
Oct 20 02:56:00 user nova-compute[74242]: INFO nova.compute.manager [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Took 0.84 seconds to detach 1 volumes for instance.
Oct 20 02:56:00 user nova-compute[74242]: DEBUG nova.compute.manager [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Deleting volume: b0cb2426-c05c-4657-9099-931233506695 {{(pid=74242) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 20 02:56:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:56:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:56:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-b94bf101-a006-4f33-8458-2f726756ef7c req-918f7c1b-a25b-4763-852c-b02e26669783 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received event network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:56:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b94bf101-a006-4f33-8458-2f726756ef7c req-918f7c1b-a25b-4763-852c-b02e26669783 service nova] Acquiring lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:56:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b94bf101-a006-4f33-8458-2f726756ef7c req-918f7c1b-a25b-4763-852c-b02e26669783 service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:56:00 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [req-b94bf101-a006-4f33-8458-2f726756ef7c req-918f7c1b-a25b-4763-852c-b02e26669783 service nova] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:56:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-b94bf101-a006-4f33-8458-2f726756ef7c req-918f7c1b-a25b-4763-852c-b02e26669783 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] No waiting events found dispatching network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 20 02:56:00 user nova-compute[74242]: WARNING nova.compute.manager [req-b94bf101-a006-4f33-8458-2f726756ef7c req-918f7c1b-a25b-4763-852c-b02e26669783 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received unexpected event network-vif-plugged-5247d96d-f3c5-418d-871e-a55ab2123c45 for instance with vm_state deleted and task_state None.
Oct 20 02:56:00 user nova-compute[74242]: DEBUG nova.compute.manager [req-b94bf101-a006-4f33-8458-2f726756ef7c req-918f7c1b-a25b-4763-852c-b02e26669783 service nova] [instance: c50216a6-a0cd-4566-b4e6-ffd9eeff1629] Received event network-vif-deleted-5247d96d-f3c5-418d-871e-a55ab2123c45 {{(pid=74242) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 20 02:56:00 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:00 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:56:00 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:56:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.197s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:56:01 user nova-compute[74242]: INFO nova.scheduler.client.report [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Deleted allocations for instance c50216a6-a0cd-4566-b4e6-ffd9eeff1629
Oct 20 02:56:01 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-23cf9dbc-2fa8-4a0b-b950-29345be3de7d tempest-TestShelveInstance-1204752060 tempest-TestShelveInstance-1204752060-project-member] Lock "c50216a6-a0cd-4566-b4e6-ffd9eeff1629" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.866s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:56:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:05 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:56:07 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:56:07 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:56:07 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:56:07 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Didn't find any instances for network info cache update. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 02:56:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:56:13 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:56:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:56:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:56:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:56:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:56:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:56:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:15 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:56:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:56:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:56:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:56:15 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:56:15 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:56:15 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:56:15 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=9104MB free_disk=24.90170669555664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:56:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:56:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:56:15 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:56:15 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:56:15 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:56:15 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:56:15 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:56:15 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.160s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:56:18 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:56:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:19 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:56:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:56:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:56:23 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:56:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:24 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:56:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:56:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:56:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:56:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:56:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:56:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:56:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:56:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:56:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:56:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:56:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:56:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:56:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:56:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:56:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:56:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:56:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:56:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:56:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:51 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:56:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:57:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:57:06 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:57:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:57:09 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:57:09 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:57:09 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:57:09 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Didn't find any instances for network info cache update. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 02:57:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:57:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:57:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:57:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:57:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:57:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:57:14 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:57:17 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:57:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:57:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:57:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:57:17 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Auditing locally available compute resources for user (node: user) {{(pid=74242) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 20 02:57:17 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:57:17 user nova-compute[74242]: WARNING nova.virt.libvirt.driver [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 20 02:57:17 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Hypervisor/Node resource view: name=user free_ram=9143MB free_disk=24.900165557861328GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74242) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 20 02:57:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 20 02:57:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 20 02:57:17 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 20 02:57:17 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74242) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 20 02:57:17 user nova-compute[74242]: DEBUG nova.compute.provider_tree [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed in ProviderTree for provider: 07b40460-b6ac-48c1-8447-e1778d50b26e {{(pid=74242) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 20 02:57:17 user nova-compute[74242]: DEBUG nova.scheduler.client.report [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Inventory has not changed for provider 07b40460-b6ac-48c1-8447-e1778d50b26e based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74242) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 20 02:57:17 user nova-compute[74242]: DEBUG nova.compute.resource_tracker [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Compute_service record updated for user:user {{(pid=74242) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 20 02:57:17 user nova-compute[74242]: DEBUG oslo_concurrency.lockutils [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.313s {{(pid=74242) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 20 02:57:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:57:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:57:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:57:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:57:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:57:19 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:57:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:57:20 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:57:20 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74242) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 20 02:57:21 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:57:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:57:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:57:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:57:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:57:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:57:24 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:57:24 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:57:24 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:57:29 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:57:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:57:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:57:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:57:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:57:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:57:34 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:57:39 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:57:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:57:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:57:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74242) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 20 02:57:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:57:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74242) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 20 02:57:44 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:57:49 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:57:50 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:57:53 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:57:54 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:57:59 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:58:04 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:58:07 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:58:09 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 20 02:58:10 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 20 02:58:10 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Starting heal instance info cache {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 20 02:58:10 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Rebuilding the list of instances to heal {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 20 02:58:10 user nova-compute[74242]: DEBUG nova.compute.manager [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Didn't find any instances for network info cache update. {{(pid=74242) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 20 02:58:14 user nova-compute[74242]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=74242) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 20 02:58:15 user nova-compute[74242]: DEBUG oslo_service.periodic_task [None req-63fd84b9-465e-4b4f-9bba-b7a512f57731 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74242) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}